marksverdhei/GLM-4.7-Flash-FP8

`marksverdhei/GLM-4.7-Flash-FP8` powered by vLLM - [Original Model Card](https://huggingface.co/marksverdhei/GLM-4.7-Flash-FP8) - [vLLM Documentation](https://docs.vllm.ai/) ## Chat Completions API #…

azureFoundry/HuggingFace/marksverdhei-glm-4.7-flash-fp8@1

marksverdhei/GLM-4.7-Flash-FP8 powered by vLLM

Chat Completions API

Send Request

You can use cURL or any REST Client to send a request to the Azure ML endpoint with your Azure ML token.

curl <AZUREML_ENDPOINT_URL> \
    -X POST \
    -H "Authorization: Bearer <AZUREML_TOKEN>" \
    -H "Content-Type: application/json" \
    -d '{"model":"marksverdhei/GLM-4.7-Flash-FP8","messages":[{"role":"user","content":"What is Deep Learning?"}]}'

Supported Parameters

The following are the only mandatory parameters to send in the HTTP POST request to v1/chat/completions.

  • model (string): Model ID used to generate the response, in this case since only a single model is deployed within the same endpoint you can either set it to marksverdhei/GLM-4.7-Flash-FP8 or leave it blank instead.
  • messages (array): A list of messages comprising the conversation so far. Depending on the model you use, different message types (modalities) are supported, like text, images, and audio.

The rest of the parameters are optional, and since this model is powered by vLLM with an OpenAI compatible interface on top for the Chat Completions API for text generation, then the I/O interfaces for both generation and streaming are the same as in OpenAI Chat Completions API.

You can find the whole specification of the allowed parameters in the OpenAI Chat Completion API Specification, or alternatively in the endpoint /openapi.json for the current Azure ML Endpoint.

Example payload

{
  "model": "marksverdhei/GLM-4.7-Flash-FP8",
  "messages": [
    {"role":"user","content":"What is Deep Learning?"}
  ],
  "max_completion_tokens": 256,
  "temperature": 0.6
}

Responses API

Alternatively, given that marksverdhei/GLM-4.7-Flash-FP8 is a reasoning model, note that the recommended API is the OpenAI Responses API over the default OpenAI Chat Completions API aforementioned.

Send Request

curl <AZUREML_ENDPOINT_URL>/v1/responses \
    -X POST \
    -d '{"model":"marksverdhei/GLM-4.7-Flash-FP8","input":"What is Deep Learning?","reasoning":{"effort":"medium"}}' \
    -H "Authorization: Bearer <AZUREML_TOKEN>" \
    -H "Content-Type: application/json"

Supported Parameters

This being said, the following are the only mandatory parameters to send in the HTTP POST request to /v1/responses.

  • model (string): Model ID used to generate the response, in this case since only a single model is deployed within the same endpoint you can either set it to marksverdhei/GLM-4.7-Flash-FP8 or leave it blank instead.
  • input (str or array): A text, image, or file inputs to the model, or even a list of messages comprising the conversation so far, used to generate the response. Depending on the model you use, different message types (modalities) are supported, like text, images, and audio; whilst in this case only text generation is supported so image and audio inputs are disallowed.

The rest of the parameters are optional, and since this model is powered by vLLM with an OpenAI compatible interface, you can find the whole specification of the allowed parameters in the OpenAI Responses API Specification, or alternatively in the endpoint /openapi.json for the current Azure ML Endpoint.

Example Payload

{
  "model": "marksverdhei/GLM-4.7-Flash-FP8",
  "input": "What is Deep Learning?",
  "max_output_tokens": 1024,
  "temperature": 0.6,
  "reasoning": {
    "effort": "medium"
  }
}

Specifications & capabilities

Input
text
Output
text
Published model ID
GLM-4.7-Flash-FP8

Provider specifications & access

1–3 / 3

marksverdhei/GLM-4.7-Flash-FP8 ↗

source model id
HuggingFace/marksverdhei-glm-4.7-flash-fp8@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
mit
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    marksverdhei/GLM-4.7-Flash-FP8 ↗

    source model id
    HuggingFace/marksverdhei-glm-4.7-flash-fp8@2
    hosting
    foundry-managed-compute
    platforms
    • Microsoft Foundry
    license
    mit
    architecture
    input_modalities
    • text
    output_modalities
    • text
    capabilities

      marksverdhei/GLM-4.7-Flash-FP8 ↗

      source model id
      HuggingFace/marksverdhei-glm-4.7-flash-fp8@3
      hosting
      foundry-managed-compute
      platforms
      • Microsoft Foundry
      license
      mit
      architecture
      input_modalities
      • text
      output_modalities
      • text
      capabilities

        Original sources

        1–6 / 6

        Hugging Face · marksverdhei/GLM-4.7-Flash-FP8 ↗

        Microsoft Foundry · Model page ↗

        Microsoft Foundry · Model page ↗

        Microsoft Foundry · Model page ↗

        Microsoft Foundry · Model documentation ↗

        Microsoft Foundry · Catalog ↗

        Source links

        1–1 / 1

        Explore more models

        Models

        Loading
        EVIDENCE / COMPARISON

        Benchmarks

        Explore every benchmark

        Loading

        These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

        Install TensorTrace