mistralai-Mixtral-8x7B-Instruct-v01 · azureml v6
The Mixtral-8x7B Large Language Model (LLM) is a pretrained generative Sparse Mixture of Experts. The Mixtral-8x7B outperforms Llama 2 70B on most benchmarks with 6x faster inference. Mixtral-8x7B-v0…
azureFoundry/azureml/mistralai-Mixtral-8x7B-Instruct-v01@6
The Mixtral-8x7B Large Language Model (LLM) is a pretrained generative Sparse Mixture of Experts. The Mixtral-8x7B outperforms Llama 2 70B on most benchmarks with 6x faster inference.
Mixtral-8x7B-v0.1 is a decoder-only model with 8 distinct groups or the "experts". At every layer, for every token, a router network chooses two of these experts to process the token and combine their output additively. Mixtral has 46.7B total parameters but only uses 12.9B parameters per token using this technique. This enables the model to perform with same speed and cost as 12.9B model.
For full details of this model please read release blog post.
Limitations and Biases
The Mixtral-8x7B Instruct model is a quick demonstration that the base model can be easily fine-tuned to achieve compelling performance.
It does not have any moderation mechanisms. We're looking forward to engaging with the community on ways to
make the model finely respect guardrail
Specifications & capabilities
- Input
- text
- Output
- text
Provider specifications & access
1–1 / 1
- source model id
- azureml/mistralai-Mixtral-8x7B-Instruct-v01@6
- hosting
- foundry-managed-compute
- license
- apache-2.0
Safety assessments
1–1 / 1
18 / 100
- source id
- stanfordFMTI
- canonical model id
- azureFoundry/azureml/mistralai-Mixtral-8x7B-Instruct-v01@6
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Mistral
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 18 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Explore more models