deepseek-r1-distill-qwen-7b-qnn-npu · azureml v2

This model is an optimized version of DeepSeek-R1-Distill-Qwen-7B to enable local inference on QNN NPUs. This model uses QuaRot and GPTQ quantization. # Model Description - **Developed by:** Microsof…

azureFoundry/azureml/deepseek-r1-distill-qwen-7b-qnn-npu@2

This model is an optimized version of DeepSeek-R1-Distill-Qwen-7B to enable local inference on QNN NPUs. This model uses QuaRot and GPTQ quantization.

Model Description

  • Developed by: Microsoft
  • Model type: ONNX
  • License: MIT
  • Model Description: This is a conversion of the DeepSeek-R1-Distill-Qwen-7B for local inference on QNN NPUs.
  • Disclaimer: Model is only an optimization of the base model, any risk associated with the model is the responsibility of the user of the model. Please verify and test for your scenarios. There may be a slight difference in output from the base model with the optimizations applied. Note that optimizations applied are distinct from fine tuning and thus do not alter the intended uses or capabilities of the model.

Base Model Information

See Hugging Face model DeepSeek-R1-Distill-Qwen-7B for details.

Specifications & capabilities

Input
text
Output
text
Max output · tokens
2048

Provider specifications & access

1–1 / 1

deepseek-r1-distill-qwen-7b-qnn-npu · azureml v2 ↗

source model id
azureml/deepseek-r1-distill-qwen-7b-qnn-npu@2
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
MIT
max output tokens
2048
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    Safety assessments

    1–1 / 1

    Foundation Model Transparency Index 2025 ↗

    32 / 100

    source id
    stanfordFMTI
    canonical model id
    azureFoundry/azureml/deepseek-r1-distill-qwen-7b-qnn-npu@2
    taxonomy
    transparency
    hazard category
    transparency
    hazard name
    Organization transparency
    policy area
    DeepSeek
    assessment type
    organization-level disclosure
    metric
    disclosure_score
    result label
    32 / 100
    sample size
    100
    updated at
    2026-11-09T18:08:05.227Z

    Source specification observations

    1–1 / 1

    azureFoundry ↗

    field
    max_output_tokens
    value
    2048
    normalized value
    2048
    scope
    source-model
    source id
    azureFoundry
    confidence
    1

    Original sources

    1–4 / 4

    Microsoft Foundry · Model page ↗

    Microsoft Foundry · Model documentation ↗

    GitHub · Catalog ↗

    Microsoft Foundry · Catalog ↗

    Source links

    1–2 / 2

    Explore more models

    Models

    Loading
    EVIDENCE / COMPARISON

    Benchmarks

    Explore every benchmark

    Loading

    These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

    Install TensorTrace