johnsutor/mixture-of-gemmas-linear

Explore johnsutor/mixture-of-gemmas-linear: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/johnsutor/mixture-of-gemmas-linear

Specifications & capabilities

Input
text
Output
text
Published model ID
mixture-of-gemmas-linear

Evaluations

1–5 / 5

Open LLM Leaderboard v1

46.429%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 MMLU
dimension
knowledge
metric
Accuracy
rank
5449
aggregation scope
suite
Open LLM v1
status
archived
precision
bfloat16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
62863123266b718d684179939eb9864515ed1dca
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-05-28T13:33:24.000Z
source model id
johnsutor/mixture-of-gemmas-linear
Original result ↗

Open LLM Leaderboard v1

0%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 GSM8K
dimension
math
metric
Accuracy
rank
6594
aggregation scope
suite
Open LLM v1
status
archived
precision
bfloat16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
62863123266b718d684179939eb9864515ed1dca
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-05-28T13:33:24.000Z
source model id
johnsutor/mixture-of-gemmas-linear
Original result ↗

Open LLM Leaderboard v1

26.28%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 ARC
dimension
reasoning
metric
Accuracy
rank
6852
aggregation scope
suite
Open LLM v1
status
archived
precision
bfloat16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
62863123266b718d684179939eb9864515ed1dca
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-05-28T13:33:24.000Z
source model id
johnsutor/mixture-of-gemmas-linear
Original result ↗

Open LLM Leaderboard v1

50.276%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 Winogrande
dimension
reasoning
metric
Accuracy
rank
7017
aggregation scope
suite
Open LLM v1
status
archived
precision
bfloat16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
62863123266b718d684179939eb9864515ed1dca
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-05-28T13:33:24.000Z
source model id
johnsutor/mixture-of-gemmas-linear
Original result ↗

Open LLM Leaderboard v1

20.683%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 HellaSwag
dimension
reasoning
metric
Accuracy
rank
7260
aggregation scope
suite
Open LLM v1
status
archived
precision
bfloat16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
62863123266b718d684179939eb9864515ed1dca
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-05-28T13:33:24.000Z
source model id
johnsutor/mixture-of-gemmas-linear
Original result ↗

Original sources

1–2 / 2

Hugging Face · Model repository ↗

Hugging Face · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace