unsloth/Phi-3-medium-4k-instruct
`unsloth/Phi-3-medium-4k-instruct` powered by Text Generation Inference. - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://hu…
azureFoundry/HuggingFace/unsloth-phi-3-medium-4k-instruct@1
`unsloth/Phi-3-medium-4k-instruct` powered by Text Generation Inference.
- [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint)
- [Original Model Card](https://huggingface.co/unsloth/Phi-3-medium-4k-instruct)
### Send Request
You can use cURL or any REST Client to sent request. Just add your token and test.
```
curl https://YOUR-URL.com -X POST -d '{"inputs":"Once upon a time,"}' -H "Authorization: Bearer <TOKEN>" -H "Content-Type: application/json"
```
### Supported Parameter
You can use different parameters to control the generation, defining them in the parameters attribute of the payload. As of today, the following parameters are supported:
- temperature: Controls randomness in the model. Lower values will make the model more deterministic and higher values will make the model more random. Default value is 1.0.
- max_new_tokens: The maximum number of tokens to generate. Default value is 20, max value is 512.
- repetition_penalty: Controls the likelihood of repetition. Default is null.
- seed: The seed to use for random generation. Default is null.
- stop: A list of tokens to stop the generation. The generation will stop when one of the tokens is generated.
- top_k: The number of highest probability vocabulary tokens to keep for top-k-filtering. Default value is null, which disables top-k-filtering.
- top_p: The cumulative probability of parameter highest probability vocabulary tokens to keep for nucleus sampling, default to null
- do_sample: Whether or not to use sampling; use greedy decoding otherwise. Default value is false.
- best_of: Generate best_of sequences and return the one if the highest token logprobs, default to null.
- details: Whether or not to return details about the generation. Default value is false.
- return_full_text: Whether or not to return the full text or only the generated part. Default value is false.
- truncate: Whether or not to truncate the input to the maximum length of the model. Default value is true.
- typical_p: The typical probability of a token. Default value is null.
- watermark: The watermark to use for the generation. Default value is false.
Example payload
```json
{
"inputs": "Create 3 ideas on what to do in Germany, Nuremberg. I want to go there in the summer.",
"parameters": {
"do_sample": true,
"top_p": 0.95,
"temperature": 0.2,
"top_k": 50,
"max_new_tokens": 256,
"repetition_penalty": 1.03,
"stop": ["
User:", "<|endoftext|>", "</s>"]
}
}
```
Specifications & capabilities
- Input
- text
- Output
- text
- Published model ID
- Phi-3-medium-4k-instruct
Evaluations
1–7 / 7
80.212%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 GSM8K
- dimension
- math
- metric
- Accuracy
- rank
- 23
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 1099cff4ded0cc74fb38a90951c4e21865cddd73
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-28T06:35:31.000Z
- source model id
- unsloth/Phi-3-medium-4k-instruct
Original result ↗77.845%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 MMLU
- dimension
- knowledge
- metric
- Accuracy
- rank
- 74
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 1099cff4ded0cc74fb38a90951c4e21865cddd73
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-28T06:35:31.000Z
- source model id
- unsloth/Phi-3-medium-4k-instruct
Original result ↗73.569%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 Average
- dimension
- general
- metric
- Six-task average
- rank
- 925
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Six-task average
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 1099cff4ded0cc74fb38a90951c4e21865cddd73
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7170
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-28T06:35:31.000Z
- source model id
- unsloth/Phi-3-medium-4k-instruct
Original result ↗85.69%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 HellaSwag
- dimension
- reasoning
- metric
- Accuracy
- rank
- 1729
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 1099cff4ded0cc74fb38a90951c4e21865cddd73
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-28T06:35:31.000Z
- source model id
- unsloth/Phi-3-medium-4k-instruct
Original result ↗67.065%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 ARC
- dimension
- reasoning
- metric
- Accuracy
- rank
- 1767
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 1099cff4ded0cc74fb38a90951c4e21865cddd73
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-28T06:35:31.000Z
- source model id
- unsloth/Phi-3-medium-4k-instruct
Original result ↗57.752%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 TruthfulQA
- dimension
- knowledge
- metric
- Accuracy
- rank
- 2095
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 1099cff4ded0cc74fb38a90951c4e21865cddd73
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7170
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-28T06:35:31.000Z
- source model id
- unsloth/Phi-3-medium-4k-instruct
Original result ↗72.849%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 Winogrande
- dimension
- reasoning
- metric
- Accuracy
- rank
- 5052
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 1099cff4ded0cc74fb38a90951c4e21865cddd73
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-05-28T06:35:31.000Z
- source model id
- unsloth/Phi-3-medium-4k-instruct
Original result ↗Provider specifications & access
1–1 / 1
- source model id
- HuggingFace/unsloth-phi-3-medium-4k-instruct@1
- hosting
- foundry-managed-compute
- license
- mit
Explore more models