Deepseek-R1-Distill-Llama-8B-NIM-microservice · azureml-nvidia v2

### [!] Attention Required : This model is being retired. Migrate your workloads to [Nemotron 3 Super](https://ai.azure.com/catalog/models/nvidia--nvidia-nemotron-3-super-120b-a12b-fp8) DeepSeek AI h…

azureFoundry/azureml-nvidia/Deepseek-R1-Distill-Llama-8B-NIM-microservice@2

[!] Attention Required : This model is being retired. Migrate your workloads to Nemotron 3 Super

DeepSeek AI has developed a range of distilled models based on Meta's Llama architectures, with sizes spanning from 1.5 to 70 billion parameters, starting from the foundation of DeepSeek-R1. This distillation process involves training smaller models to replicate the behavior and reasoning of the larger 671 billion parameter DeepSeek-R1 model, effectively transferring its knowledge into more compact forms.

The resulting models, including DeepSeek-R1-Distill-Llama-8B (derived from Llama-3.1-8B) and DeepSeek-R1-Distill-Llama-70B (from Llama-3.3-70B-Instruct), offer varying balances between performance and resource usage. While these distilled models may exhibit slightly reduced reasoning capabilities compared to the original 671B model, they significantly enhance inference speed and lower computational costs. For example, smaller models like the 8B version process requests more quickly and use fewer resources, making them more cost-effective for production use. This NIM efficiently deploys the distilled Llama 3.1 8B variant of DeepSeek R1 models on NVIDIA GPUs

DeepSeek R1 Distill Llama 3.1 8B is available as an NVIDIA NIM™ microservice, part of https://www.nvidia.com/en-us/data-center/products/ai-enterprise/. NVIDIA NIM offers prebuilt containers for large language models (LLMs) that can be used to develop chatbots, content analyzers—or any application that needs to understand and generate human language. Each NIM consists of a container and a model and uses a CUDA-accelerated runtime for all NVIDIA GPUs, with special optimizations available for many configurations.

NVIDIA AI Enterprise\nNVIDIA AI Enterprise is an end-to-end, cloud-native software platform that accelerates data science pipelines and streamlines development and deployment of production-grade co-pilots and other generative AI applications. Easy-to-use microservices provide optimized model performance with enterprise-grade security, support, and stability to ensure a smooth transition from prototype to production for enterprises that run their businesses on AI.

Specifications & capabilities

Input
text
Output
text

Provider specifications & access

1–1 / 1

Safety assessments

1–1 / 1

Foundation Model Transparency Index 2025 ↗

31 / 100

source id
stanfordFMTI
canonical model id
azureFoundry/azureml-nvidia/Deepseek-R1-Distill-Llama-8B-NIM-microservice@2
taxonomy
transparency
hazard category
transparency
hazard name
Organization transparency
policy area
Meta
assessment type
organization-level disclosure
metric
disclosure_score
result label
31 / 100
sample size
100
updated at
2026-11-09T18:08:05.227Z

Original sources

1–4 / 4

Microsoft Foundry · Model page ↗

Microsoft Foundry · Model documentation ↗

GitHub · Catalog ↗

Microsoft Foundry · Catalog ↗

Source links

1–2 / 2

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace