ibm-granite/granite-3.3-8b-instruct-FP8
`ibm-granite/granite-3.3-8b-instruct-FP8` powered by vLLM - [Original Model Card](https://huggingface.co/ibm-granite/granite-3.3-8b-instruct-FP8) - [vLLM Documentation](https://docs.vllm.ai) ## Chat …
azureFoundry/HuggingFace/ibm-granite-granite-3.3-8b-instruct-fp8@1
ibm-granite/granite-3.3-8b-instruct-FP8 powered by vLLM
Chat Completions API
Send Request
You can use cURL or any REST Client to send a request to the Azure ML endpoint with your Azure ML token.
curl <AZUREML_ENDPOINT_URL> \\
-X POST \\
-H "Authorization: Bearer <AZUREML_TOKEN>" \\
-H "Content-Type: application/json" \\
-d '{"model":"ibm-granite/granite-3.3-8b-instruct-FP8","messages":[{"role":"user","content":"What is Deep Learning?"}]}'
Supported Parameters
The following are the only mandatory parameters to send in the HTTP POST request to v1/chat/completions.
- model (string): Model ID used to generate the response, in this case since only a single model is deployed within the same endpoint you can either set it to ibm-granite/granite-3.3-8b-instruct-FP8 or leave it blank instead.
- *messages
Specifications & capabilities
- Input
- text
- Output
- text
- Published model ID
- granite-3.3-8b-instruct-FP8
Provider specifications & access
1–2 / 2
- source model id
- HuggingFace/ibm-granite-granite-3.3-8b-instruct-fp8@1
- hosting
- foundry-managed-compute
- license
- apache-2.0
- source model id
- HuggingFace/ibm-granite-granite-3.3-8b-instruct-fp8@2
- hosting
- foundry-managed-compute
- license
- apache-2.0
Safety assessments
1–1 / 1
95 / 100
- source id
- stanfordFMTI
- canonical model id
- azureFoundry/HuggingFace/ibm-granite-granite-3.3-8b-instruct-fp8@1
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- IBM
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 95 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Explore more models