prometheus-eval/prometheus-7b-v2.0
`prometheus-eval/prometheus-7b-v2.0` powered by Text Generation Inference. - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://…
azureFoundry/HuggingFace/prometheus-eval-prometheus-7b-v2.0@1
prometheus-eval/prometheus-7b-v2.0 powered by Text Generation Inference.
Send Request
You can use cURL or any REST Client to sent request. Just add your token and test.
curl https://YOUR-URL.com -X POST -d '{"inputs":"Once upon a time,"}' -H "Authorization: Bearer <TOKEN>" -H "Content-Type: application/json"
Supported Parameter
You can use different parameters to control the generation, defining them in the parameters attribute of the payload. As of today, the following parameters are supported:
- temperature: Controls randomness in the model. Lower values will make the model more deterministic and higher values will make the model more random. Default value is 1.0.
- max_new_tokens: The maximum number of tokens to generate. Default value is 20, max value is 512.
- repetition_penalty: Contr
Specifications & capabilities
- Input
- text
- Output
- text
- Published model ID
- prometheus-7b-v2.0
Provider specifications & access
1–2 / 2
- source model id
- HuggingFace/prometheus-eval-prometheus-7b-v2.0@1
- hosting
- foundry-managed-compute
- license
- apache-2.0
- source model id
- HuggingFace/prometheus-eval-prometheus-7b-v2.0@2
- hosting
- foundry-managed-compute
- license
- apache-2.0
Explore more models