FabbriSimo01/Facebook_opt_1.3b_Quantized

Explore FabbriSimo01/Facebook_opt_1.3b_Quantized: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/FabbriSimo01/Facebook_opt_1.3b_Quantized

Specifications & capabilities

Input
text
Output
text
Published model ID
Facebook_opt_1.3b_Quantized

Evaluations

1–5 / 5

Open LLM Leaderboard v1

59.669%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 Winogrande
dimension
reasoning
metric
Accuracy
rank
6325
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
7ef72ccee9d91d06967809e4e63ffbef62a9ad4a
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2023-09-09T10:52:17.000Z
source model id
FabbriSimo01/Facebook_opt_1.3b_Quantized
Original result ↗

Open LLM Leaderboard v1

0.152%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 GSM8K
dimension
math
metric
Accuracy
rank
6501
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
7ef72ccee9d91d06967809e4e63ffbef62a9ad4a
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2023-09-09T10:52:17.000Z
source model id
FabbriSimo01/Facebook_opt_1.3b_Quantized
Original result ↗

Open LLM Leaderboard v1

22.696%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 ARC
dimension
reasoning
metric
Accuracy
rank
7131
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
7ef72ccee9d91d06967809e4e63ffbef62a9ad4a
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2023-09-09T10:52:17.000Z
source model id
FabbriSimo01/Facebook_opt_1.3b_Quantized
Original result ↗

Open LLM Leaderboard v1

23.117%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 MMLU
dimension
knowledge
metric
Accuracy
rank
7146
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
7ef72ccee9d91d06967809e4e63ffbef62a9ad4a
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2023-09-09T10:52:17.000Z
source model id
FabbriSimo01/Facebook_opt_1.3b_Quantized
Original result ↗

Open LLM Leaderboard v1

25.045%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 HellaSwag
dimension
reasoning
metric
Accuracy
rank
7202
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
7ef72ccee9d91d06967809e4e63ffbef62a9ad4a
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2023-09-09T10:52:17.000Z
source model id
FabbriSimo01/Facebook_opt_1.3b_Quantized
Original result ↗

Original sources

1–2 / 2

Hugging Face · FabbriSimo01/Facebook_opt_1.3b_Quantized ↗

Hugging Face · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace