AILuminate

Source-qualified evaluations, report statistics and safety observations.

Gemma 2 9b

Overall safety grade: Very Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

Claude 3.5 Sonnet 20241022

Overall safety grade: Very Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

Phi 3.5 Mini Instruct

Overall safety grade: Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

Phi 3.5 MoE Instruct

Overall safety grade: Very Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

OLMo 7b 0724 Instruct

Overall safety grade: Poor

Official published AILuminate result · ordinal grade; no numeric score inferred.

Llama 3.1 8b Instruct FP8

Overall safety grade: Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

GPT-4o mini

Overall safety grade: Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

Gemini 1.5 Pro (API, with option)

Overall safety grade: Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

Llama 3.1 405B Instruct

Overall safety grade: Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

Mistral Large 24.11

Overall safety grade: Fair

Official published AILuminate result · ordinal grade; no numeric score inferred.

Ministral 8B 24.10 (API)

Overall safety grade: Fair

Official published AILuminate result · ordinal grade; no numeric score inferred.

Ministral 8B 24.10 with output moderation (Recipe)

Overall safety grade: Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

Olmo 2 0325 32b Instruct

Overall safety grade: Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

Llama 3.3 70B Instruct Turbo Together

Overall safety grade: Fair

Official published AILuminate result · ordinal grade; no numeric score inferred.

Google Gemma 3 27B It Hf Nebius

Overall safety grade: Fair

Official published AILuminate result · ordinal grade; no numeric score inferred.

Phi 4

Overall safety grade: Very Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

Claude 3.5 Haiku 20241022

Overall safety grade: Very Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

Llama 3 1 Tulu 3 8B Hf

Overall safety grade: Good

Official published AILuminate result · ordinal grade; no numeric score inferred.

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace