01-ai/Yi-34B-Chat
`01-ai/Yi-34B-Chat` powered by Text Generation Inference. - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/01…
azureFoundry/HuggingFace/01-ai-yi-34b-chat@1
01-ai/Yi-34B-Chat powered by Text Generation Inference.
Send Request
You can use cURL or any REST Client to sent request. Just add your token and test.
curl https://YOUR-URL.com -X POST -d '{"inputs":"Once upon a time,"}' -H "Authorization: Bearer <TOKEN>" -H "Content-Type: application/json"
Supported Parameter
You can use different parameters to control the generation, defining them in the parameters attribute of the payload. As of today, the following parameters are supported:
- temperature: Controls randomness in the model. Lower values will make the model more deterministic and higher values will make the model more random. Default value is 1.0.
- max_new_tokens: The maximum number of tokens to generate. Default value is 20, max value is 512.
- repetition_penalty: Controls the likelihood of repetition.
Specifications & capabilities
- Input
- text
- Output
- text
- Published model ID
- Yi-34B-Chat
Evaluations
41–41 / 41
19.788%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 GSM8K
- dimension
- math
- metric
- Accuracy
- rank
- 4293
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- a99ec35331cbfc9da596af7d4538fe2efecff03c
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2023-11-23T10:23:14.000Z
- source model id
- 01-ai/Yi-34B-Chat
Original result ↗Provider specifications & access
1–2 / 2
- source model id
- HuggingFace/01-ai-yi-34b-chat@1
- hosting
- foundry-managed-compute
- license
- apache-2.0
- source model id
- HuggingFace/01-ai-yi-34b-chat@2
- hosting
- foundry-managed-compute
- license
- apache-2.0
Explore more models