google/gemma-2-9b-it

Explore google/gemma-2-9b-it: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/google/gemma-2-9b-it

Specifications & capabilities

Published model ID
gemma2@gemma-2-9b-it

Evaluations

1–20 / 76

Open Persian LLM Leaderboard

62.33%

source id
openPersianLLM
leaderboard name
AUT Multiple Choice Persian
dimension
general
metric
AUT Multiple Choice Persian
rank
4
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Persian LLM
language
fa
precision
bfloat16
metric_kind
AUT Multiple Choice Persian
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
published_at
2025-12-06T10:13:22Z
source_revision
92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
metric_population
27
benchmark_evaluation
true
source model id
google/gemma-2-9b-it
Original result ↗

Open Persian LLM Leaderboard

93.1%

source id
openPersianLLM
leaderboard name
ARC Easy
dimension
general
metric
ARC Easy
rank
5
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Persian LLM
language
fa
precision
bfloat16
metric_kind
ARC Easy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
published_at
2025-12-06T10:13:22Z
source_revision
92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
metric_population
27
benchmark_evaluation
true
source model id
google/gemma-2-9b-it
Original result ↗

Open Persian LLM Leaderboard

84.56%

source id
openPersianLLM
leaderboard name
ARC Challenge
dimension
general
metric
ARC Challenge
rank
6
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Persian LLM
language
fa
precision
bfloat16
metric_kind
ARC Challenge
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
published_at
2025-12-06T10:13:22Z
source_revision
92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
metric_population
27
benchmark_evaluation
true
source model id
google/gemma-2-9b-it
Original result ↗

Open Persian LLM Leaderboard

31.74%

source id
openPersianLLM
leaderboard name
MMLU Pro
dimension
general
metric
MMLU Pro
rank
6
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Persian LLM
language
fa
precision
bfloat16
metric_kind
MMLU Pro
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
published_at
2025-12-06T10:13:22Z
source_revision
92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
metric_population
27
benchmark_evaluation
true
source model id
google/gemma-2-9b-it
Original result ↗

Open Persian LLM Leaderboard

42.7%

source id
openPersianLLM
leaderboard name
Part Multiple Choice
dimension
general
metric
Part Multiple Choice
rank
7
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Persian LLM
language
fa
precision
bfloat16
metric_kind
Part Multiple Choice
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
published_at
2025-12-06T10:13:22Z
source_revision
92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
metric_population
27
benchmark_evaluation
true
source model id
google/gemma-2-9b-it
Original result ↗

LLM Stats · GitHub archive

0.402

source id
llmStatsArchive
leaderboard name
HumanEval · Normalized (reported)
dimension
general
metric
HumanEval · Normalized (reported)
rank
10
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HumanEval
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • code
created_at
2025-07-19T19:56:12.595263+00:00
paper_link
https://arxiv.org/abs/2107.03374
updated_at
2025-07-19T19:56:12.595263+00:00
description
A benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics
benchmark_id
humaneval
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HumanEval · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/google/models/gemma-2-9b-it/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/blog/gemma2
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
google/gemma-2-9b-it
metric_population
10
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
gemma-2-9b-it
Original result ↗

LLM Stats · GitHub archive

0.402

source id
llmStatsArchive
leaderboard name
HumanEval · Raw
dimension
general
metric
HumanEval · Raw
rank
10
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
HumanEval
language
en
modality
text
verified
false
max_score
1
categories
  • reasoning
  • code
created_at
2025-07-19T19:56:12.595263+00:00
paper_link
https://arxiv.org/abs/2107.03374
updated_at
2025-07-19T19:56:12.595263+00:00
description
A benchmark that measures functional correctness for synthesizing programs from docstrings, consisting of 164 original programming problems assessing language comprehension, algorithms, and simple mathematics
benchmark_id
humaneval
multilingual
false
analysis_method
pass@1
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
HumanEval · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/google/models/gemma-2-9b-it/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/blog/gemma2
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
google/gemma-2-9b-it
metric_population
10
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
gemma-2-9b-it
Original result ↗

LMArena

1,195.667

source id
lmarena
leaderboard name
LMArena Text Style Control Japanese
dimension
style
metric
Arena rating
rank
239
sample size
1301
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1177.7867479616098
confidence upper
1213.5476726705683
Original result ↗

LMArena

1,144.521

source id
lmarena
leaderboard name
LMArena Text Japanese
dimension
general
metric
Arena rating
rank
240
sample size
1301
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1126.718564913192
confidence upper
1162.3233767284046
Original result ↗

LMArena

1,202.722

source id
lmarena
leaderboard name
LMArena Text Style Control Korean
dimension
style
metric
Arena rating
rank
250
sample size
1087
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1181.434046404558
confidence upper
1224.0103086640388
Original result ↗

LMArena

1,136.766

source id
lmarena
leaderboard name
LMArena Text Korean
dimension
general
metric
Arena rating
rank
253
sample size
1087
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1115.5567661448501
confidence upper
1157.9744625320807
Original result ↗

LMArena

1,259.329

source id
lmarena
leaderboard name
LMArena Text Style Control French
dimension
style
metric
Arena rating
rank
260
sample size
591
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1232.7710772905311
confidence upper
1285.8875477284612
Original result ↗

LMArena

1,189.698

source id
lmarena
leaderboard name
LMArena Text French
dimension
general
metric
Arena rating
rank
260
sample size
591
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1163.4250007153057
confidence upper
1215.971640021597
Original result ↗

LMArena

1,266.079

source id
lmarena
leaderboard name
LMArena Text Style Control Spanish
dimension
style
metric
Arena rating
rank
261
sample size
614
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1240.1550785066993
confidence upper
1292.0030492813296
Original result ↗

LMArena

1,200.113

source id
lmarena
leaderboard name
LMArena Text Spanish
dimension
general
metric
Arena rating
rank
261
sample size
614
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1174.2845982101026
confidence upper
1225.940860851475
Original result ↗

LMArena

1,245.536

source id
lmarena
leaderboard name
LMArena Text Style Control German
dimension
style
metric
Arena rating
rank
264
sample size
1580
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1229.1224132376728
confidence upper
1261.9486044446976
Original result ↗

LMArena

1,185.969

source id
lmarena
leaderboard name
LMArena Text German
dimension
general
metric
Arena rating
rank
267
sample size
1580
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1169.6075323457865
confidence upper
1202.3295903418873
Original result ↗

LMArena

1,258.741

source id
lmarena
leaderboard name
LMArena Text Style Control Creative Writing
dimension
style
metric
Arena rating
rank
294
sample size
8340
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1251.2054959519626
confidence upper
1266.276541786205
Original result ↗

LMArena

1,268.733

source id
lmarena
leaderboard name
LMArena Text Style Control Industry Writing And Literature And Language
dimension
style
metric
Arena rating
rank
303
sample size
14640
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1262.6699933476632
confidence upper
1274.7956893750916
Original result ↗

LMArena

1,248.237

source id
lmarena
leaderboard name
LMArena Text Style Control Industry Entertainment And Sports And Media
dimension
style
metric
Arena rating
rank
305
sample size
9128
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 2 9B IT
confidence lower
1241.1550631586065
confidence upper
1255.3180695460533
Original result ↗

Provider specifications & access

1–2 / 2

Gemma2-9b-it ↗

source model id
publishers/google/models/gemma2@gemma-2-9b-it
hosting
vertex-self-deployed
platforms
  • Google Cloud Vertex AI
architecture
input_modalities
  • text
output_modalities
  • text
capabilities

    gemma-2-9b-it ↗

    source model id
    publishers/hf-google/models/gemma-2-9b-it@001
    hosting
    vertex-self-deployed
    platforms
    • Google Cloud Vertex AI
    architecture
    input_modalities
      output_modalities
        capabilities

          Safety assessments

          1–1 / 1

          Foundation Model Transparency Index 2025 ↗

          41 / 100

          source id
          stanfordFMTI
          canonical model id
          huggingface/google/gemma-2-9b-it
          taxonomy
          transparency
          hazard category
          transparency
          hazard name
          Organization transparency
          policy area
          Google
          assessment type
          organization-level disclosure
          metric
          disclosure_score
          result label
          41 / 100
          sample size
          100
          updated at
          2026-11-09T18:08:05.227Z

          Original sources

          21–34 / 34

          arXiv · Paper · 2108.07732 ↗

          arXiv · Paper · 2109.07958 ↗

          arXiv · Paper · 2110.08193 ↗

          arXiv · Paper · 2110.14168 ↗

          arXiv · Paper · 2203.09509 ↗

          arXiv · Paper · 2206.04615 ↗

          arXiv · Paper · 2304.06364 ↗

          GitHub · Catalog ↗

          GitHub · Catalog ↗

          Google Cloud · Catalog ↗

          Hugging Face · Catalog ↗

          Hugging Face · Catalog ↗

          Hugging Face · Catalog ↗

          LMArena · Catalog ↗

          Source links

          1–7 / 7

          Hugging Face model card

          1–1 / 1

          Explore more models

          Models

          Loading
          EVIDENCE / COMPARISON

          Benchmarks

          Explore every benchmark

          Loading

          These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

          Install TensorTrace