MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2
`MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2` powered by Text Generation Inference. - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card]…
azureFoundry/HuggingFace/maziyarpanahi-llama-3-70b-instruct-dpo-v0.2@4
MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2 powered by Text Generation Inference.
Send Request
You can use cURL or any REST Client to sent request. Just add your token and test.
curl https://YOUR-URL.com -X POST -d '{"inputs":"Once upon a time,"}' -H "Authorization: Bearer <TOKEN>" -H "Content-Type: application/json"
Supported Parameter
You can use different parameters to control the generation, defining them in the parameters attribute of the payload. As of today, the following parameters are supported:
- temperature: Controls randomness in the model. Lower values will make the model more deterministic and higher values will make the model more random. Default value is 1.0.
- max_new_tokens: The maximum number of tokens to generate. Default value is 20, max value is 512.
- repetition_penalty: Controls the likelihood of repetition. Default is null.
- seed: The seed to use for random generation. Default is null.
- stop: A list of tokens to stop the generation. The generation will stop when one of the tokens is generated.
- top_k: The number of highest probability vocabulary tokens to keep for top-k-filtering. Default value is null, which disables top-k-filtering.
- top_p: The cumulative probability of parameter highest probability vocabulary tokens to keep for nucleus sampling, default to null
- do_sample: Whether or not to use sampling; use greedy decoding otherwise. Default value is false.
- best_of: Generate best_of sequences and return the one if the highest token logprobs, default to null.
- details: Whether or not to return details about the generation. Default value is false.
- return_full_text: Whether or not to return the full text or only the generated part. Default value is false.
- truncate: Whether or not to truncate the input to the maximum length of the model. Default value is true.
- typical_p: The typical probability of a token. Default value is null.
- watermark: The watermark to use for the generation. Default value is false.
Example payload
{
"inputs": "Create 3 ideas on what to do in Germany, Nuremberg. I want to go there in the summer.",
"parameters": {
"do_sample": true,
"top_p": 0.95,
"temperature": 0.2,
"top_k": 50,
"max_new_tokens": 256,
"repetition_penalty": 1.03,
"stop": ["
User:", "<|endoftext|>", "</s>"]
}
}
Specifications & capabilities
- Input
- text
- Output
- text
- Published model ID
- Llama-3-70B-Instruct-DPO-v0.2
Evaluations
1–7 / 7
88.249%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 GSM8K
- dimension
- math
- metric
- Accuracy
- rank
- 1
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 0ef6aba21c4537fe693c4160b820efb28270705b
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-01T17:04:08.000Z
- source model id
- MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2
Original result ↗78.961%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 Average
- dimension
- general
- metric
- Six-task average
- rank
- 22
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Six-task average
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 0ef6aba21c4537fe693c4160b820efb28270705b
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7170
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-01T17:04:08.000Z
- source model id
- MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2
Original result ↗80.415%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 MMLU
- dimension
- knowledge
- metric
- Accuracy
- rank
- 23
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 0ef6aba21c4537fe693c4160b820efb28270705b
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-01T17:04:08.000Z
- source model id
- MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2
Original result ↗72.526%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 ARC
- dimension
- reasoning
- metric
- Accuracy
- rank
- 534
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 0ef6aba21c4537fe693c4160b820efb28270705b
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-01T17:04:08.000Z
- source model id
- MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2
Original result ↗82.794%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 Winogrande
- dimension
- reasoning
- metric
- Accuracy
- rank
- 1037
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 0ef6aba21c4537fe693c4160b820efb28270705b
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-01T17:04:08.000Z
- source model id
- MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2
Original result ↗63.567%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 TruthfulQA
- dimension
- knowledge
- metric
- Accuracy
- rank
- 1373
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 0ef6aba21c4537fe693c4160b820efb28270705b
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7170
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-01T17:04:08.000Z
- source model id
- MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2
Original result ↗86.218%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 HellaSwag
- dimension
- reasoning
- metric
- Accuracy
- rank
- 1480
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 0ef6aba21c4537fe693c4160b820efb28270705b
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-01T17:04:08.000Z
- source model id
- MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2
Original result ↗Safety assessments
1–1 / 1
31 / 100
- source id
- stanfordFMTI
- canonical model id
- azureFoundry/HuggingFace/maziyarpanahi-llama-3-70b-instruct-dpo-v0.2@4
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Meta
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 31 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Explore more models