Meta: Llama 3.1 70B Instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
meta-llama/llama-3.1-70b-instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
Specifications & capabilities
- Input
- text
- Output
- text
- Context window · tokens
- 131072
- Knowledge cutoff
- 2023-12-31
- Published model ID
- Llama-3.1-70B-Instruct
- Capabilities
- toolCalling
Evaluations
1–14 / 14
86.689%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 IFEval · Raw
- dimension
- instructionFollowing
- metric
- Raw accuracy
- rank
- 2
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗86.689%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 IFEval · Normalized
- dimension
- instructionFollowing
- metric
- Normalized score
- rank
- 2
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗43.41%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 Average
- dimension
- general
- metric
- Normalized six-task average
- rank
- 62
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized six-task average
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗55.928%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 BBH · Normalized
- dimension
- reasoning
- metric
- Normalized score
- rank
- 94
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗69.173%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 BBH · Raw
- dimension
- reasoning
- metric
- Raw accuracy
- rank
- 98
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗53.092%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MMLU-PRO · Raw
- dimension
- knowledge
- metric
- Raw accuracy
- rank
- 321
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗47.88%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MMLU-PRO · Normalized
- dimension
- knowledge
- metric
- Normalized score
- rank
- 321
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗35.654%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 GPQA · Raw
- dimension
- knowledge
- metric
- Raw accuracy
- rank
- 459
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗14.206%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 GPQA · Normalized
- dimension
- knowledge
- metric
- Normalized score
- rank
- 459
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗17.691%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MUSR · Normalized
- dimension
- reasoning
- metric
- Normalized score
- rank
- 491
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗38.066%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MATH Lvl 5 · Raw
- dimension
- math
- metric
- Raw accuracy
- rank
- 522
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗38.066%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MATH Lvl 5 · Normalized
- dimension
- math
- metric
- Normalized score
- rank
- 522
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗45.806%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MUSR · Raw
- dimension
- reasoning
- metric
- Raw accuracy
- rank
- 591
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 40.22182401425256
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- b9461463b511ed3c0762467538ea32cf7c9669f2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- meta-llama/Llama-3.1-70B-Instruct
Original result ↗6.6
- source id
- artificialAnalysis
- dimension
- intelligence
- metric
- Intelligence Index
Original result ↗Published prices
1–2 / 2
$0.72
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
$0.72
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
Provider specifications & access
1–2 / 2
- source model id
- publishers/hf-meta-llama/models/llama-3.1-70b-instruct@001
- hosting
- vertex-self-deployed
- source model id
- publishers/meta/models/llama3_1@llama-3.1-70b-instruct
- hosting
- vertex-self-deployed
Safety assessments
1–1 / 1
31 / 100
- source id
- stanfordFMTI
- canonical model id
- meta-llama/llama-3.1-70b-instruct
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Meta
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 31 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–3 / 3
- field
- context_length
- value
- 131072
- normalized value
- 131072
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2023-12-31
- normalized value
- 2023-12-31
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 8192
- normalized value
- 8192
- scope
- source-model
- source id
- openRouter
- confidence
- 1
Explore more models