Deepseek-R1-Distill-Llama-8B-NIM-microservice · azureml-nvidia v1
DeepSeek AI has developed a range of distilled models based on Meta's Llama architectures, with sizes spanning from 1.5 to 70 billion parameters, starting from the foundation of DeepSeek-R1. This dis…
azureFoundry/azureml-nvidia/Deepseek-R1-Distill-Llama-8B-NIM-microservice@1
DeepSeek AI has developed a range of distilled models based on Meta's Llama architectures, with sizes spanning from 1.5 to 70 billion parameters, starting from the foundation of DeepSeek-R1. This distillation process involves training smaller models to replicate the behavior and reasoning of the larger 671 billion parameter DeepSeek-R1 model, effectively transferring its knowledge into more compact forms.
The resulting models, including DeepSeek-R1-Distill-Llama-8B (derived from Llama-3.1-8B) and DeepSeek-R1-Distill-Llama-70B (from Llama-3.3-70B-Instruct), offer varying balances between performance and resource usage. While these distilled models may exhibit slightly reduced reasoning capabilities compared to the original 671B model, they significantly enhance inference speed and lower computational costs. For example, smaller models like the 8B version process requests more quickly and use fewer resources, making them more cost-effective for production use. This NIM efficiently deploys the distilled Llama 3.1 8B variant of DeepSeek R1 models on NVIDIA GPUs.
DeepSeek R1 Distill Llama 3.1 8B is available as an NVIDIA NIM™ microservice, part of NVIDIA AI Enterprise. NVIDIA NIM offers prebuilt containers for large language models (LLMs) that can be used to develop chatbots, content analyzers—or any application that needs to understand and generate human language. Each NIM consists of a container and a model and uses a CUDA-accelerated runtime for all NVIDIA GPUs, with special optimizations available for many configurations.
NVIDIA AI Enterprise
Specifications & capabilities
- Input
- text
- Output
- text
Provider specifications & access
1–1 / 1
- source model id
- azureml-nvidia/Deepseek-R1-Distill-Llama-8B-NIM-microservice@1
- hosting
- foundry-managed-compute
- license
- custom
Safety assessments
1–1 / 1
31 / 100
- source id
- stanfordFMTI
- canonical model id
- azureFoundry/azureml-nvidia/Deepseek-R1-Distill-Llama-8B-NIM-microservice@1
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Meta
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 31 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Explore more models