shitshow123/moe_scratch

Explore shitshow123/moe_scratch: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/shitshow123/moe_scratch

Specifications & capabilities

Input
text
Output
text
Published model ID
moe_scratch

Evaluations

1–5 / 5

Open LLM Leaderboard v1

0%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 GSM8K
dimension
math
metric
Accuracy
rank
6594
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
86bd0f657bfc81b8c42bcc2c958949e21258f97e
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-01-09T00:50:29.000Z
source model id
shitshow123/moe_scratch
Original result ↗

Open LLM Leaderboard v1

49.566%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 Winogrande
dimension
reasoning
metric
Accuracy
rank
7111
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
86bd0f657bfc81b8c42bcc2c958949e21258f97e
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-01-09T00:50:29.000Z
source model id
shitshow123/moe_scratch
Original result ↗

Open LLM Leaderboard v1

22.696%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 ARC
dimension
reasoning
metric
Accuracy
rank
7131
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
86bd0f657bfc81b8c42bcc2c958949e21258f97e
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-01-09T00:50:29.000Z
source model id
shitshow123/moe_scratch
Original result ↗

Open LLM Leaderboard v1

23.117%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 MMLU
dimension
knowledge
metric
Accuracy
rank
7146
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
86bd0f657bfc81b8c42bcc2c958949e21258f97e
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-01-09T00:50:29.000Z
source model id
shitshow123/moe_scratch
Original result ↗

Open LLM Leaderboard v1

25.045%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 HellaSwag
dimension
reasoning
metric
Accuracy
rank
7202
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
86bd0f657bfc81b8c42bcc2c958949e21258f97e
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-01-09T00:50:29.000Z
source model id
shitshow123/moe_scratch
Original result ↗

Original sources

1–2 / 2

Hugging Face · Model repository ↗

Hugging Face · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace