ibm-granite/granite-4.0-h-small-FP8

`ibm-granite/granite-4.0-h-small-FP8` powered by vLLM - [Original Model Card](https://huggingface.co/ibm-granite/granite-4.0-h-small-FP8) - [vLLM Documentation](https://docs.vllm.ai) ## Chat Completi…

azureFoundry/HuggingFace/ibm-granite-granite-4.0-h-small-fp8@1

ibm-granite/granite-4.0-h-small-FP8 powered by vLLM

Chat Completions API

Send Request

You can use cURL or any REST Client to send a request to the Azure ML endpoint with your Azure ML token.

curl <AZUREML_ENDPOINT_URL> \
    -X POST \
    -H "Authorization: Bearer <AZUREML_TOKEN>" \
    -H "Content-Type: application/json" \
    -d '{"model":"ibm-granite/granite-4.0-h-small-FP8","messages":[{"role":"user","content":"What is Deep Learning?"}]}'

Supported Parameters

The following are the only mandatory parameters to send in the HTTP POST request to v1/chat/completions.

  • model (string): Model ID used to generate the response, in this case since only a single model is deployed within the same endpoint you can either set it to ibm-granite/granite-4.0-h-small-FP8 or leave it blank instead.
  • messages (array): A list of

Specifications & capabilities

Input
text
Output
text
Published model ID
granite-4.0-h-small-FP8

Provider specifications & access

1–2 / 2

ibm-granite/granite-4.0-h-small-FP8 ↗

source model id
HuggingFace/ibm-granite-granite-4.0-h-small-fp8@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
apache-2.0
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    ibm-granite/granite-4.0-h-small-FP8 ↗

    source model id
    HuggingFace/ibm-granite-granite-4.0-h-small-fp8@2
    hosting
    foundry-managed-compute
    platforms
    • Microsoft Foundry
    license
    apache-2.0
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      Safety assessments

      1–1 / 1

      Foundation Model Transparency Index 2025 ↗

      95 / 100

      source id
      stanfordFMTI
      canonical model id
      azureFoundry/HuggingFace/ibm-granite-granite-4.0-h-small-fp8@1
      taxonomy
      transparency
      hazard category
      transparency
      hazard name
      Organization transparency
      policy area
      IBM
      assessment type
      organization-level disclosure
      metric
      disclosure_score
      result label
      95 / 100
      sample size
      100
      updated at
      2026-11-09T18:08:05.227Z

      Original sources

      1–6 / 6

      Hugging Face · ibm-granite/granite-4.0-h-small-FP8 ↗

      Microsoft Foundry · Model page ↗

      Microsoft Foundry · Model page ↗

      Microsoft Foundry · Model documentation ↗

      GitHub · Catalog ↗

      Microsoft Foundry · Catalog ↗

      Source links

      1–2 / 2

      Explore more models

      Models

      Loading
      EVIDENCE / COMPARISON

      Benchmarks

      Explore every benchmark

      Loading

      These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

      Install TensorTrace