VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct
Explore VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct: model specifications, capabilities, benchmark results, platform pricing and original sources.
huggingface/VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct
Specifications & capabilities
- Input
- text
- Output
- text
- Published model ID
- SauerkrautLM-Mixtral-8x7B-Instruct
Evaluations
21–27 / 27
36.503%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MMLU-PRO · Raw
- dimension
- knowledge
- metric
- Raw accuracy
- rank
- 1962
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 7.548780388067429
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 30ed549de7d84f68b4c6cb619f73275c99af23cc
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct
Original result ↗29.447%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MMLU-PRO · Normalized
- dimension
- knowledge
- metric
- Normalized score
- rank
- 1962
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 7.548780388067429
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 30ed549de7d84f68b4c6cb619f73275c99af23cc
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct
Original result ↗59.818%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 GSM8K
- dimension
- math
- metric
- Accuracy
- rank
- 2045
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 330eb185920d6a470b265a4b31217c60e810fb3e
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2023-12-20T00:18:50.000Z
- source model id
- VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct
Original result ↗29.782%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 GPQA · Raw
- dimension
- knowledge
- metric
- Raw accuracy
- rank
- 2100
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 7.548780388067429
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 30ed549de7d84f68b4c6cb619f73275c99af23cc
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct
Original result ↗6.376%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 GPQA · Normalized
- dimension
- knowledge
- metric
- Normalized score
- rank
- 2100
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 7.548780388067429
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 30ed549de7d84f68b4c6cb619f73275c99af23cc
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct
Original result ↗9.819%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MATH Lvl 5 · Normalized
- dimension
- math
- metric
- Normalized score
- rank
- 2411
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 7.548780388067429
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 30ed549de7d84f68b4c6cb619f73275c99af23cc
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct
Original result ↗9.819%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MATH Lvl 5 · Raw
- dimension
- math
- metric
- Raw accuracy
- rank
- 2411
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 7.548780388067429
- status
- archived
- precision
- bfloat16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- true
- suite_version
- 2
- model_revision
- 30ed549de7d84f68b4c6cb619f73275c99af23cc
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- VAGOsolutions/SauerkrautLM-Mixtral-8x7B-Instruct
Original result ↗Explore more models