qwen2.5-coder-3b-instruct-cuda-gpu · azureml v2
This model is an optimized version of Qwen2.5-Coder-3B-Instruct to enable local inference on CUDA GPUs. This model uses RTN quantization. # Model Description - **Developed by:** Microsoft - **Model t…
azureFoundry/azureml/qwen2.5-coder-3b-instruct-cuda-gpu@2
This model is an optimized version of Qwen2.5-Coder-3B-Instruct to enable local inference on CUDA GPUs. This model uses RTN quantization.
Model Description
- Developed by: Microsoft
- Model type: ONNX
- License: apache-2.0
- Model Description: This is a conversion of the Qwen2.5-Coder-3B-Instruct for local inference on CUDA GPUs.
- Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.
Base Model Information
See Hugging Face model Qwen2.5-Coder-3B-Instruct for details.
Specifications & capabilities
- Input
- text
- Output
- text
- Max output · tokens
- 2048
- Capabilities
- toolCalling
Provider specifications & access
1–1 / 1
- source model id
- azureml/qwen2.5-coder-3b-instruct-cuda-gpu@2
- hosting
- foundry-local-or-optimized
- license
- apache-2.0
- max output tokens
- 2048
Safety assessments
1–1 / 1
26 / 100
- source id
- stanfordFMTI
- canonical model id
- azureFoundry/azureml/qwen2.5-coder-3b-instruct-cuda-gpu@2
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Alibaba
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 26 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–1 / 1
- field
- max_output_tokens
- value
- 2048
- normalized value
- 2048
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
Explore more models