IFM/K2-Think ↗
- source model id
- HuggingFace/ifm-k2-think@1
- hosting
- foundry-managed-compute
- platforms
- Microsoft Foundry
- license
- apache-2.0
- architecture
- input_modalities
- text
- output_modalities
- text
- capabilities
`IFM/K2-Think` powered by vLLM - [Original Model Card](https://huggingface.co/IFM/K2-Think) - [vLLM Documentation](https://docs.vllm.ai) ## Chat Completions API ### Send Request You can use cURL or a…
azureFoundry/HuggingFace/ifm-k2-think@1
IFM/K2-Think powered by vLLM
You can use cURL or any REST Client to send a request to the Azure ML endpoint with your Azure ML token.
curl <AZUREML_ENDPOINT_URL> \\
-X POST \\
-H "Authorization: Bearer <AZUREML_TOKEN>" \\
-H "Content-Type: application/json" \\
-d '{"model":"IFM/K2-Think","messages":[{"role":"user","content":"What is Deep Learning?"}]}'
The following are the only mandatory parameters to send in the HTTP POST request to v1/chat/completions.
The rest of the parameters are optional, and since this model is powered by vLLM with an OpenAI compatible interface on top for the Chat Completions API for text generation, then the I/O interfaces for both generation and streaming are the same as in OpenAI Chat Completions API.
You can find the whole specification of the allowed parameters in the OpenAI Chat Completion API Specification, or alternatively in the endpoint /openapi.json for the current Azure ML Endpoint.
{
"model": "IFM/K2-Think",
"messages": [
{"role":"user","content":"What is Deep Learning?"}
],
"max_completion_tokens": 256,
"temperature": 0.6
}
1–1 / 1
1–4 / 4
Microsoft Foundry · Model page ↗
1–1 / 1
These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.