Qwen/Qwen3.8-27B
last-exam-pass-rate · 2.631578947368421 source-defined score; unit unspecified
Source-qualified evaluations, report statistics and safety observations.
last-exam-pass-rate · 2.631578947368421 source-defined score; unit unspecified
avg_time · 605 source-defined score; unit unspecified
mmlu_pro · 78.29 source-defined score; unit unspecified
deep_swe · 63.4 source-defined score; unit unspecified
avg_cost · 34.8 source-defined score; unit unspecified
skillsbench_v1_1 · 62.9 source-defined score; unit unspecified
SWE_Bench_Pro · 44.5 source-defined score; unit unspecified
text_content · 80.97 source-defined score; unit unspecified
scanning · 79.99 source-defined score; unit unspecified
illumination · 93.28 source-defined score; unit unspecified
hle · 11.72 source-defined score; unit unspecified
mmlu_pro · 86.8 source-defined score; unit unspecified
it · 74.7 source-defined score; unit unspecified
warping · 91.25 source-defined score; unit unspecified
mmlu_pro · 48.4 source-defined score; unit unspecified
chart · 63.41 source-defined score; unit unspecified
mmmu_pro_standard_10_options · 74 source-defined score; unit unspecified
multimodal · 14.8 source-defined score; unit unspecified
These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.