failspy/Phi-3-medium-4k-instruct-abliterated-v3

Explore failspy/Phi-3-medium-4k-instruct-abliterated-v3: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/failspy/Phi-3-medium-4k-instruct-abliterated-v3

Specifications & capabilities

Input
text
Output
text
Published model ID
Phi-3-medium-4k-instruct-abliterated-v3

Evaluations

1–20 / 48

Open Ko-LLM Leaderboard

50.839%

source id
openKoLLM
leaderboard name
kornat_social · A-SVA,none
dimension
general
metric
kornat_social · A-SVA,none
rank
103
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_social · A-SVA,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

85.38%

source id
openKoLLM
leaderboard name
ko_eqbench · percent_parseable,none
dimension
general
metric
ko_eqbench · percent_parseable,none
rank
113
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · percent_parseable,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

24.534%

source id
openKoLLM
leaderboard name
kornat_common · acc_norm,none
dimension
general
metric
kornat_common · acc_norm,none
rank
143
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
kornat_common · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

28.745%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_strict_acc,none
dimension
general
metric
ko_ifeval · prompt_level_strict_acc,none
rank
184
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

22.222%

source id
openKoLLM
leaderboard name
ko_gpqa_diamond_zeroshot · acc_norm,none
dimension
general
metric
ko_gpqa_diamond_zeroshot · acc_norm,none
rank
185
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gpqa_diamond_zeroshot · acc_norm,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

7.56

source id
openKoLLM
leaderboard name
ko_eqbench · eqbench,none
dimension
general
metric
ko_eqbench · eqbench,none
rank
186
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · eqbench,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

31.781%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_loose_acc,none
dimension
general
metric
ko_ifeval · prompt_level_loose_acc,none
rank
187
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

35.163%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_strict_acc,none
dimension
general
metric
ko_ifeval · inst_level_strict_acc,none
rank
194
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

38.131%

source id
openKoLLM
leaderboard name
ko_ifeval · inst_level_loose_acc,none
dimension
general
metric
ko_ifeval · inst_level_loose_acc,none
rank
197
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · inst_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

54.775%

source id
openKoLLM
leaderboard name
ko_winogrande · acc,none
dimension
general
metric
ko_winogrande · acc,none
rank
212
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_winogrande · acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

85.38%

source id
openKoLLM
leaderboard name
ko_eqbench · percent_parseable,none
dimension
general
metric
ko_eqbench · percent_parseable,none
rank
215
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_eqbench · percent_parseable,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-07-29 22:35:04.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

0%

source id
openKoLLM
leaderboard name
ko_gsm8k · exact_match,strict-match
dimension
general
metric
ko_gsm8k · exact_match,strict-match
rank
216
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.bfloat16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_gsm8k · exact_match,strict-match
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
238
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

30.162%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_strict_acc,none
dimension
general
metric
ko_ifeval · prompt_level_strict_acc,none
rank
224
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_strict_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-07-29 22:35:04.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open Ko-LLM Leaderboard

32.591%

source id
openKoLLM
leaderboard name
ko_ifeval · prompt_level_loose_acc,none
dimension
general
metric
ko_ifeval · prompt_level_loose_acc,none
rank
225
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Ko-LLM
language
ko
execution
model_dtype
torch.float16
num_fewshot_seeds
1
override_batch_size
1
num_few_shot_default
0
task_versions
all
2
ko_gsm8k
2
ko_ifeval
2
ko_eqbench
2
ko_winogrande
2
kornat_common
2
kornat_social
2
kornat_helpful
2
kornat_harmless
2
ko_gpqa_diamond_zeroshot
2
metric_kind
ko_ifeval · prompt_level_loose_acc,none
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-07-29 22:35:04.json
published_at
2025-01-12T22:16:32Z
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_revision
79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
metric_population
994
benchmark_evaluation
true
source model id
failspy/Phi-3-medium-4k-instruct-abliterated-v3
Original result ↗

Open LLM Leaderboard v1

75.519%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 MMLU
dimension
knowledge
metric
Accuracy
rank
226
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
959b09eacf6cae85a8eb21b25e998addc89a367b
source_flagged
true
missing_metrics
    dataset_revision
    791ca1c841030008c6c266562c2b88c9b7196550
    metric_population
    7260
    ranking_population
    7260
    source_flag_anomaly
    true
    evaluated at
    2024-05-31T06:34:58.000Z
    source model id
    failspy/Phi-3-medium-4k-instruct-abliterated-v3
    Original result ↗

    Open Ko-LLM Leaderboard

    42.475%

    source id
    openKoLLM
    leaderboard name
    kornat_helpful · acc_norm,none
    dimension
    general
    metric
    kornat_helpful · acc_norm,none
    rank
    226
    aggregation scope
    status
    published
    direction
    higherIsBetter
    conditions
    suite
    Open Ko-LLM
    language
    ko
    execution
    model_dtype
    torch.bfloat16
    num_fewshot_seeds
    1
    override_batch_size
    1
    num_few_shot_default
    0
    task_versions
    all
    2
    ko_gsm8k
    2
    ko_ifeval
    2
    ko_eqbench
    2
    ko_winogrande
    2
    kornat_common
    2
    kornat_social
    2
    kornat_helpful
    2
    kornat_harmless
    2
    ko_gpqa_diamond_zeroshot
    2
    metric_kind
    kornat_helpful · acc_norm,none
    rank_method
    competition rank among reported evaluations in identical conditions, including unlinked observations
    source_file
    open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
    published_at
    2025-01-12T22:16:32Z
    model_revision
    959b09eacf6cae85a8eb21b25e998addc89a367b
    source_revision
    79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
    metric_population
    238
    benchmark_evaluation
    true
    source model id
    failspy/Phi-3-medium-4k-instruct-abliterated-v3
    Original result ↗

    Open LLM Leaderboard v1

    71.873%

    source id
    openLLMLeaderboardV1
    leaderboard name
    Open LLM v1 GSM8K
    dimension
    math
    metric
    Accuracy
    rank
    227
    aggregation scope
    suite
    Open LLM v1
    status
    archived
    precision
    float16
    task_count
    6
    metric_kind
    Accuracy
    rank_method
    Derived competition rank over published evaluations with reported scores, including variants and source flags
    weight_type
    Original
    published_at
    2024-06-25T14:11:42Z
    chat_template
    false
    suite_version
    1
    model_revision
    959b09eacf6cae85a8eb21b25e998addc89a367b
    source_flagged
    true
    missing_metrics
      dataset_revision
      791ca1c841030008c6c266562c2b88c9b7196550
      metric_population
      7260
      ranking_population
      7260
      source_flag_anomaly
      true
      evaluated at
      2024-05-31T06:34:58.000Z
      source model id
      failspy/Phi-3-medium-4k-instruct-abliterated-v3
      Original result ↗

      Open Ko-LLM Leaderboard

      0%

      source id
      openKoLLM
      leaderboard name
      ko_gsm8k · exact_match,flexible-extract
      dimension
      general
      metric
      ko_gsm8k · exact_match,flexible-extract
      rank
      233
      aggregation scope
      status
      published
      direction
      higherIsBetter
      conditions
      suite
      Open Ko-LLM
      language
      ko
      execution
      model_dtype
      torch.bfloat16
      num_fewshot_seeds
      1
      override_batch_size
      1
      num_few_shot_default
      0
      task_versions
      all
      2
      ko_gsm8k
      2
      ko_ifeval
      2
      ko_eqbench
      2
      ko_winogrande
      2
      kornat_common
      2
      kornat_social
      2
      kornat_helpful
      2
      kornat_harmless
      2
      ko_gpqa_diamond_zeroshot
      2
      metric_kind
      ko_gsm8k · exact_match,flexible-extract
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
      published_at
      2025-01-12T22:16:32Z
      model_revision
      959b09eacf6cae85a8eb21b25e998addc89a367b
      source_revision
      79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
      metric_population
      238
      benchmark_evaluation
      true
      source model id
      failspy/Phi-3-medium-4k-instruct-abliterated-v3
      Original result ↗

      Open Ko-LLM Leaderboard

      57.61%

      source id
      openKoLLM
      leaderboard name
      kornat_harmless · acc_norm,none
      dimension
      general
      metric
      kornat_harmless · acc_norm,none
      rank
      236
      aggregation scope
      status
      published
      direction
      higherIsBetter
      conditions
      suite
      Open Ko-LLM
      language
      ko
      execution
      model_dtype
      torch.bfloat16
      num_fewshot_seeds
      1
      override_batch_size
      1
      num_few_shot_default
      0
      task_versions
      all
      2
      ko_gsm8k
      2
      ko_ifeval
      2
      ko_eqbench
      2
      ko_winogrande
      2
      kornat_common
      2
      kornat_social
      2
      kornat_helpful
      2
      kornat_harmless
      2
      ko_gpqa_diamond_zeroshot
      2
      metric_kind
      kornat_harmless · acc_norm,none
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-09-28 04:41:08.json
      published_at
      2025-01-12T22:16:32Z
      model_revision
      959b09eacf6cae85a8eb21b25e998addc89a367b
      source_revision
      79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
      metric_population
      238
      benchmark_evaluation
      true
      source model id
      failspy/Phi-3-medium-4k-instruct-abliterated-v3
      Original result ↗

      Open Ko-LLM Leaderboard

      36.795%

      source id
      openKoLLM
      leaderboard name
      ko_ifeval · inst_level_strict_acc,none
      dimension
      general
      metric
      ko_ifeval · inst_level_strict_acc,none
      rank
      275
      aggregation scope
      status
      published
      direction
      higherIsBetter
      conditions
      suite
      Open Ko-LLM
      language
      ko
      execution
      model_dtype
      torch.float16
      num_fewshot_seeds
      1
      override_batch_size
      1
      num_few_shot_default
      0
      task_versions
      all
      2
      ko_gsm8k
      2
      ko_ifeval
      2
      ko_eqbench
      2
      ko_winogrande
      2
      kornat_common
      2
      kornat_social
      2
      kornat_helpful
      2
      kornat_harmless
      2
      ko_gpqa_diamond_zeroshot
      2
      metric_kind
      ko_ifeval · inst_level_strict_acc,none
      rank_method
      competition rank among reported evaluations in identical conditions, including unlinked observations
      source_file
      open-ko-llm-leaderboard/results/failspy/Phi-3-medium-4k-instruct-abliterated-v3/result_2024-07-29 22:35:04.json
      published_at
      2025-01-12T22:16:32Z
      model_revision
      959b09eacf6cae85a8eb21b25e998addc89a367b
      source_revision
      79263b00db68621dc9765e72ec588deada54cd531a2fd26b8a849eda14e14574
      metric_population
      994
      benchmark_evaluation
      true
      source model id
      failspy/Phi-3-medium-4k-instruct-abliterated-v3
      Original result ↗

      Original sources

      1–4 / 4

      Hugging Face · Model repository ↗

      Hugging Face · Catalog ↗

      Hugging Face · Catalog ↗

      Hugging Face · Catalog ↗

      Source links

      1–3 / 3

      Explore more models

      Models

      Loading
      EVIDENCE / COMPARISON

      Benchmarks

      Explore every benchmark

      Loading

      These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

      Install TensorTrace