Google: Gemma 3 12B

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning,…

google/gemma-3-12b-it

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling. Gemma 3 12B is the second largest in the family of Gemma 3 models after [Gemma 3 27B](google/gemma-3-27b-it)

Specifications & capabilities

Input
text, image
Output
text
Context window · tokens
131072
Knowledge cutoff
2024-08-31
Published model ID
gemma3@gemma-3-12b-it
Capabilities
multimodal, structuredOutputs, toolCalling, visionInput
Description source ↗

Evaluations

101–120 / 173

MMBench

45.3%

source id
mmBench
leaderboard name
spatial_relationship
dimension
vision
metric
spatial_relationship
rank
154
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
spatial_relationship
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

MMBench

88.8%

source id
mmBench
leaderboard name
attribute_recognition
dimension
vision
metric
attribute_recognition
rank
157
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
attribute_recognition
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

MMBench

75%

source id
mmBench
leaderboard name
CP
dimension
vision
metric
CP
rank
159
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_V11_Data
verified
Yes
metric_kind
CP
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

LMArena

1,370.278

source id
lmarena
leaderboard name
LMArena Text German
dimension
general
metric
Arena rating
rank
161
sample size
166
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 3 12B IT
confidence lower
1327.8884956775125
confidence upper
1412.6672729880415
Original result ↗

MMBench

74.9%

source id
mmBench
leaderboard name
Overall
dimension
vision
metric
Overall
rank
163
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
Overall
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

MMBench

79.8%

source id
mmBench
leaderboard name
FP-S
dimension
vision
metric
FP-S
rank
164
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
FP-S
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

MMBench

65.5%

source id
mmBench
leaderboard name
FP-C
dimension
vision
metric
FP-C
rank
164
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_V11_Data
verified
Yes
metric_kind
FP-C
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

LMArena

1,371.796

source id
lmarena
leaderboard name
LMArena Text Style Control German
dimension
style
metric
Arena rating
rank
167
sample size
166
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 3 12B IT
confidence lower
1328.982295263197
confidence upper
1414.6100325749294
Original result ↗

MMBench

48.4%

source id
mmBench
leaderboard name
image_quality
dimension
vision
metric
image_quality
rank
169
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
image_quality
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

MMBench

45.2%

source id
mmBench
leaderboard name
image_quality
dimension
vision
metric
image_quality
rank
169
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_V11_Data
verified
Yes
metric_kind
image_quality
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

MMBench

67.4%

source id
mmBench
leaderboard name
FP-C
dimension
vision
metric
FP-C
rank
171
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
FP-C
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

MMBench

61.3%

source id
mmBench
leaderboard name
attribute_comparison
dimension
vision
metric
attribute_comparison
rank
171
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_V11_Data
verified
Yes
metric_kind
attribute_comparison
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

MMBench

65.3%

source id
mmBench
leaderboard name
attribute_comparison
dimension
vision
metric
attribute_comparison
rank
172
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
attribute_comparison
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

LMArena

1,376.261

source id
lmarena
leaderboard name
LMArena Text Industry Business And Management And Financial Operations
dimension
general
metric
Arena rating
rank
177
sample size
364
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 3 12B IT
confidence lower
1346.397366454616
confidence upper
1406.1239329654534
Original result ↗

LMArena

1,380.862

source id
lmarena
leaderboard name
LMArena Text Industry Legal And Government
dimension
general
metric
Arena rating
rank
180
sample size
217
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 3 12B IT
confidence lower
1342.6894520522096
confidence upper
1419.033746267495
Original result ↗

MMBench

82.9%

source id
mmBench
leaderboard name
action_recognition
dimension
vision
metric
action_recognition
rank
182
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
action_recognition
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

MMBench

52.4%

source id
mmBench
leaderboard name
object_localization
dimension
vision
metric
object_localization
rank
182
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_V11_Data
verified
Yes
metric_kind
object_localization
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

LMArena

1,386.867

source id
lmarena
leaderboard name
LMArena Text Style Control Industry Business And Management And Financial Operations
dimension
style
metric
Arena rating
rank
183
sample size
364
evaluated at
2026-11-09T00:00:00.000Z
source model id
Gemma 3 12B IT
confidence lower
1356.8418392631847
confidence upper
1416.8930144320036
Original result ↗

MMBench

75.4%

source id
mmBench
leaderboard name
CP
dimension
vision
metric
CP
rank
184
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
CP
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

MMBench

68.6%

source id
mmBench
leaderboard name
RR
dimension
vision
metric
RR
rank
190
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
RR
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-12B
Original result ↗

Published prices

1–6 / 6

gemma-3-12b-it ↗

$0.04

Inference provider
cheaperInference
Platform
Cheaper Inference
Unit
input_tokens_per_million
Currency
USD
Billing conditions
zdr
false
protocol
chat_completions
service_tier
standard
Billing label
Input tokens (per 1M)

gemma-3-12b-it ↗

$0.13

Inference provider
cheaperInference
Platform
Cheaper Inference
Unit
output_tokens_per_million
Currency
USD
Billing conditions
zdr
false
protocol
chat_completions
service_tier
standard
Billing label
Output tokens (per 1M)

google/gemma-3-12b-it ↗

$0.05

Inference provider
deepInfra
Platform
DeepInfra
Unit
input_tokens_per_million
Currency
USD
Billing conditions

google/gemma-3-12b-it ↗

$0.15

Inference provider
deepInfra
Platform
DeepInfra
Unit
output_tokens_per_million
Currency
USD
Billing conditions

google/gemma-3-12b-it ↗

$0.05

Inference provider
openRouter
Platform
OpenRouter
Unit
input_tokens_per_million
Currency
USD
Billing conditions

google/gemma-3-12b-it ↗

$0.15

Inference provider
openRouter
Platform
OpenRouter
Unit
output_tokens_per_million
Currency
USD
Billing conditions

Provider specifications & access

1–5 / 5

gemma-3-12b-it ↗

source model id
gemma-3-12b-it
hosting
gateway
platforms
  • Cheaper Inference
context length
128000
max output tokens
8192
architecture
input_modalities
  • text
  • image
output_modalities
  • text
capabilities
  • structuredOutputs
  • toolCalling
  • visionInput

Gemma 3 12B IT ↗

source model id
google.gemma-3-12b-it
hosting
bedrock-managed
platforms
  • Amazon Bedrock
architecture
input_modalities
  • text
  • image
output_modalities
  • text
capabilities

    google/gemma-3-12b-it ↗

    source model id
    google/gemma-3-12b-it
    hosting
    nvidia-inference-listed
    platforms
    • NVIDIA inference catalog
    architecture
    input_modalities
      output_modalities
        capabilities
          availability
          Listed by inference API; runtime availability unverified

          gemma-3-12b-it ↗

          source model id
          publishers/google/models/gemma3@gemma-3-12b-it
          hosting
          vertex-self-deployed
          platforms
          • Google Cloud Vertex AI
          architecture
          input_modalities
          • image
          • text
          output_modalities
          • text
          capabilities
          • multimodal
          • visionInput

          google/gemma-3-12b-it ↗

          source model id
          publishers/hf-google/models/gemma-3-12b-it@001
          hosting
          vertex-self-deployed
          platforms
          • Google Cloud Vertex AI
          architecture
          input_modalities
          • image
          • text
          output_modalities
          • text
          capabilities
          • multimodal
          • visionInput

          Safety assessments

          1–1 / 1

          Foundation Model Transparency Index 2025 ↗

          41 / 100

          source id
          stanfordFMTI
          canonical model id
          google/gemma-3-12b-it
          taxonomy
          transparency
          hazard category
          transparency
          hazard name
          Organization transparency
          policy area
          Google
          assessment type
          organization-level disclosure
          metric
          disclosure_score
          result label
          41 / 100
          sample size
          100
          updated at
          2026-11-09T18:08:05.227Z

          Source specification observations

          1–3 / 3

          openRouter ↗

          field
          context_length
          value
          131072
          normalized value
          131072
          scope
          source-model
          source id
          openRouter
          confidence
          1

          openRouter ↗

          field
          knowledge_cutoff
          reported field
          knowledge_cutoff
          value
          2024-08-31
          normalized value
          2024-08-31
          precision
          day
          scope
          source-model
          source id
          openRouter
          confidence
          1

          openRouter ↗

          field
          max_output_tokens
          value
          16384
          normalized value
          16384
          scope
          source-model
          source id
          openRouter
          confidence
          1

          Original sources

          1–20 / 21

          storage.googleapis.com · Model reference ↗

          Hugging Face · google/gemma-3-12b-it ↗

          DeepInfra · Model page ↗

          Google Cloud · Model page ↗

          Google Cloud · Model page ↗

          OpenRouter · Model page ↗

          api.cheaperinference.com · Source snapshot ↗

          Amazon Web Services · Model page ↗

          NVIDIA · Catalog ↗

          Amazon Bedrock · Model documentation ↗

          Amazon Web Services · Catalog ↗

          DeepInfra · Catalog ↗

          Epoch AI · Catalog ↗

          GitHub · Catalog ↗

          GitHub · Catalog ↗

          Google Cloud · Catalog ↗

          Hugging Face · Catalog ↗

          Hugging Face · Catalog ↗

          LMArena · Catalog ↗

          OpenRouter · Catalog ↗

          Source links

          1–15 / 15

          Explore more models

          Models

          Loading
          EVIDENCE / COMPARISON

          Benchmarks

          Explore every benchmark

          Loading

          These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

          Install TensorTrace