ibm-granite/granite-4.0-h-small-FP8
`ibm-granite/granite-4.0-h-small-FP8` powered by vLLM - [Original Model Card](https://huggingface.co/ibm-granite/granite-4.0-h-small-FP8) - [vLLM Documentation](https://docs.vllm.ai) ## Chat Completi…
azureFoundry/HuggingFace/ibm-granite-granite-4.0-h-small-fp8@1
ibm-granite/granite-4.0-h-small-FP8 powered by vLLM
Chat Completions API
Send Request
You can use cURL or any REST Client to send a request to the Azure ML endpoint with your Azure ML token.
curl <AZUREML_ENDPOINT_URL> \
-X POST \
-H "Authorization: Bearer <AZUREML_TOKEN>" \
-H "Content-Type: application/json" \
-d '{"model":"ibm-granite/granite-4.0-h-small-FP8","messages":[{"role":"user","content":"What is Deep Learning?"}]}'
Supported Parameters
The following are the only mandatory parameters to send in the HTTP POST request to v1/chat/completions.
- model (string): Model ID used to generate the response, in this case since only a single model is deployed within the same endpoint you can either set it to ibm-granite/granite-4.0-h-small-FP8 or leave it blank instead.
- messages (array): A list of
Specifications & capabilities
- Input
- text
- Output
- text
- Published model ID
- granite-4.0-h-small-FP8
Provider specifications & access
1–2 / 2
- source model id
- HuggingFace/ibm-granite-granite-4.0-h-small-fp8@1
- hosting
- foundry-managed-compute
- license
- apache-2.0
- source model id
- HuggingFace/ibm-granite-granite-4.0-h-small-fp8@2
- hosting
- foundry-managed-compute
- license
- apache-2.0
Safety assessments
1–1 / 1
95 / 100
- source id
- stanfordFMTI
- canonical model id
- azureFoundry/HuggingFace/ibm-granite-granite-4.0-h-small-fp8@1
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- IBM
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 95 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Explore more models