LimYeri/CodeMind-Gemma-7B-QLoRA-4bit

Explore LimYeri/CodeMind-Gemma-7B-QLoRA-4bit: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/LimYeri/CodeMind-Gemma-7B-QLoRA-4bit

Specifications & capabilities

Input
text
Output
text
Published model ID
CodeMind-Gemma-7B-QLoRA-4bit

Evaluations

1–5 / 5

Open LLM Leaderboard v1

60.3%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 Winogrande
dimension
reasoning
metric
Accuracy
rank
6276
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
c9c724d927138d5339e0368261f42fa986c61e1d
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-18T09:12:10.000Z
source model id
LimYeri/CodeMind-Gemma-7B-QLoRA-4bit
Original result ↗

Open LLM Leaderboard v1

0%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 GSM8K
dimension
math
metric
Accuracy
rank
6594
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
c9c724d927138d5339e0368261f42fa986c61e1d
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-18T09:12:10.000Z
source model id
LimYeri/CodeMind-Gemma-7B-QLoRA-4bit
Original result ↗

Open LLM Leaderboard v1

31.169%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 HellaSwag
dimension
reasoning
metric
Accuracy
rank
6820
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
c9c724d927138d5339e0368261f42fa986c61e1d
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-18T09:12:10.000Z
source model id
LimYeri/CodeMind-Gemma-7B-QLoRA-4bit
Original result ↗

Open LLM Leaderboard v1

23.208%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 ARC
dimension
reasoning
metric
Accuracy
rank
7087
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
c9c724d927138d5339e0368261f42fa986c61e1d
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-18T09:12:10.000Z
source model id
LimYeri/CodeMind-Gemma-7B-QLoRA-4bit
Original result ↗

Open LLM Leaderboard v1

23.117%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 MMLU
dimension
knowledge
metric
Accuracy
rank
7146
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
c9c724d927138d5339e0368261f42fa986c61e1d
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-18T09:12:10.000Z
source model id
LimYeri/CodeMind-Gemma-7B-QLoRA-4bit
Original result ↗

Original sources

1–2 / 2

Hugging Face · LimYeri/CodeMind-Gemma-7B-QLoRA-4bit ↗

Hugging Face · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace