Llama-3.3-70B-Instruct-NIM-microservice · azureml-nvidia v2

### [!] Attention Required : This model is being retired. Migrate your workloads to [Nemotron 3 Super](https://ai.azure.com/catalog/models/nvidia--nvidia-nemotron-3-super-120b-a12b-fp8) **Meta Llama …

azureFoundry/azureml-nvidia/Llama-3.3-70B-Instruct-NIM-microservice@2

[!] Attention Required : This model is being retired. Migrate your workloads to Nemotron 3 Super

Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction-tuned text-only model is optimized for multilingual dialogue use cases and outperforms many of the available open source and closed chat models on common industry benchmarks. It has context length of 128k and token count of 15T+. Token counts refer to pretraining data only. All model versions use Grouped-Query Attention (GQA) for improved inference scalability. This model is developed by Meta and is ready for commercial use.

Llama 3.3 70B-Instruct is available as an NVIDIA NIM™ microservice, part of NVIDIA AI Enterprise. NVIDIA NIM offers prebuilt containers for large language models (LLMs) that can be used to develop chatbots, content analyzers—or any application that needs to understand and generate human language. Each NIM consists of a container and a model and uses a CUDA-accelerated runtime for all NVIDIA GPUs, with special optimizations available for many configurations. NVIDIA NIM is the fastest way to achieve accelerated generative AI inference at scale and has been benchmarked to have up to 2.6x improved throughput latency.

NVIDIA AI Enterprise

NVIDIA AI Enterprise is an end-to-end, cloud-native software platform that accelerates data science pipelines and streamlines development and deployment of production-grade co-pilots and other generative AI applications. Easy-to-use microservices provide optimized model performance with enterprise-grade security, support, and stability to ensure a smooth transition from prototype to production for enterprises that run their businesses on AI.

Specifications & capabilities

Input
text
Output
text

Provider specifications & access

1–1 / 1

Safety assessments

1–1 / 1

Foundation Model Transparency Index 2025 ↗

31 / 100

source id
stanfordFMTI
canonical model id
azureFoundry/azureml-nvidia/Llama-3.3-70B-Instruct-NIM-microservice@2
taxonomy
transparency
hazard category
transparency
hazard name
Organization transparency
policy area
Meta
assessment type
organization-level disclosure
metric
disclosure_score
result label
31 / 100
sample size
100
updated at
2026-11-09T18:08:05.227Z

Original sources

1–4 / 4

Microsoft Foundry · Model page ↗

Microsoft Foundry · Model documentation ↗

GitHub · Catalog ↗

Microsoft Foundry · Catalog ↗

Source links

1–2 / 2

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace