MaziyarPanahi/calme-2.4-qwen2-7b
`MaziyarPanahi/calme-2.4-qwen2-7b` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https…
azureFoundry/HuggingFace/maziyarpanahi-calme-2.4-qwen2-7b@1
MaziyarPanahi/calme-2.4-qwen2-7b powered by Text Generation Inference (TGI)
Send Request
You can use cURL or any REST Client to send a request to the AzureML endpoint with your AzureML token.
curl <AZUREML_ENDPOINT_URL> \
-X POST \
-d '{"inputs":"What is Deep Learning?"}' \
-H "Authorization: Bearer <AZUREML_TOKEN>" \
-H "Content-Type: application/json"
Supported Parameters
- inputs (string): Input prompt.
- parameters (object):
- best_of (integer): Generate best_of sequences and return the one if the highest token logprobs.
- decoder_input_details (boolean): Whether to return decoder input token logprobs and ids.
- details (boolean): Whether to return generation details.
- do_sample (boolean): Activate logits sampling.
- frequency_penalty (float): The parameter for frequency penalty. 1.0 means no penalty Penalize new tokens based on their existing frequency in the text so far, decreasing the model’s likelihood to repeat the same line verbatim.
- grammar (object): One of the following
- #1 (object):
- type (enum): Possible values: json.
- value (string): A string that represents a JSON Schema. JSON Schema is a declarative language that allows to annotate JSON documents with types and descriptions.
- #2 (object):
- type (enum): Possible values: regex.
- value (string): The regular expression.
- #3 (object):
- type (enum): Possible values: json_schema.
- value (object):
- name (string): Optional name identifier for the schema
- schema (object): The actual JSON schema definition
- max_new_tokens (integer): Maximum number of tokens to generate.
- repetition_penalty (float): The parameter for repetition penalty. 1.0 means no penalty. See this paper for more details.
- return_full_text (boolean): Whether to prepend the prompt to the generated text
- seed (integer): Random sampling seed.
- stop (string[]): Stop generating tokens if a member of stop is generated.
- temperature (float): The value used to module the logits distribution.
- top_k (integer): The number of highest probability vocabulary tokens to keep for top-k-filtering.
- top_n_tokens (integer): The number of highest probability vocabulary tokens to keep for top-n-filtering.
- top_p (float): Top-p value for nucleus sampling.
- truncate (integer): Truncate inputs tokens to the given size.
- typical_p (float): Typical Decoding mass See Typical Decoding for Natural Language Generation for more information.
- watermark (boolean): Watermarking with A Watermark for Large Language Models.
- stream (boolean): Whether to stream the output tokens or not. Defaults to false.
Example payload
{
"inputs": "What is Deep Learning?",
"parameters": {
"do_sample": true,
"top_p": 0.95,
"temperature": 0.2,
"top_k": 50,
"max_new_tokens": 256,
"repetition_penalty": 1.03,
"stop": ["\nUser:", "<|endoftext|>", "</s>"]
}
}
OpenAI Chat Completion API compatibility
Additionally, Text Generation Inference (TGI) offers an OpenAI Chat Completion API compatible layer under the endpoint /v1/chat/completions,
check the full specification in the OpenAI Chat Completion Create Documentation.
Specifications & capabilities
- Input
- text
- Output
- text
- Published model ID
- calme-2.4-qwen2-7b
Evaluations
21–27 / 27
31.818%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 BBH · Normalized
- dimension
- reasoning
- metric
- Normalized score
- rank
- 1883
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 3.2369807670677138
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- d683c3ef1feb13e92227f5fd92fe5bc4b55ea4a2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- MaziyarPanahi/calme-2.4-qwen2-7b
Original result ↗51.014%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 BBH · Raw
- dimension
- reasoning
- metric
- Raw accuracy
- rank
- 2108
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 3.2369807670677138
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- d683c3ef1feb13e92227f5fd92fe5bc4b55ea4a2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- MaziyarPanahi/calme-2.4-qwen2-7b
Original result ↗22.851%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 Average
- dimension
- general
- metric
- Normalized six-task average
- rank
- 2122
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 3.2369807670677138
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized six-task average
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- d683c3ef1feb13e92227f5fd92fe5bc4b55ea4a2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- MaziyarPanahi/calme-2.4-qwen2-7b
Original result ↗28.356%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 GPQA · Raw
- dimension
- knowledge
- metric
- Raw accuracy
- rank
- 2782
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 3.2369807670677138
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- d683c3ef1feb13e92227f5fd92fe5bc4b55ea4a2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- MaziyarPanahi/calme-2.4-qwen2-7b
Original result ↗4.474%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 GPQA · Normalized
- dimension
- knowledge
- metric
- Normalized score
- rank
- 2782
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 3.2369807670677138
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- d683c3ef1feb13e92227f5fd92fe5bc4b55ea4a2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- MaziyarPanahi/calme-2.4-qwen2-7b
Original result ↗32.995%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 IFEval · Raw
- dimension
- instructionFollowing
- metric
- Raw accuracy
- rank
- 3149
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 3.2369807670677138
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- d683c3ef1feb13e92227f5fd92fe5bc4b55ea4a2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- MaziyarPanahi/calme-2.4-qwen2-7b
Original result ↗32.995%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 IFEval · Normalized
- dimension
- instructionFollowing
- metric
- Normalized score
- rank
- 3149
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 3.2369807670677138
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- d683c3ef1feb13e92227f5fd92fe5bc4b55ea4a2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- MaziyarPanahi/calme-2.4-qwen2-7b
Original result ↗Provider specifications & access
1–1 / 1
- source model id
- HuggingFace/maziyarpanahi-calme-2.4-qwen2-7b@1
- hosting
- foundry-managed-compute
- license
- apache-2.0
Safety assessments
1–1 / 1
26 / 100
- source id
- stanfordFMTI
- canonical model id
- azureFoundry/HuggingFace/maziyarpanahi-calme-2.4-qwen2-7b@1
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Alibaba
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 26 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Explore more models