Google: Gemma 3 12B
Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning,…
google/gemma-3-12b-it
Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling. Gemma 3 12B is the second largest in the family of Gemma 3 models after [Gemma 3 27B](google/gemma-3-27b-it)
Specifications & capabilities
- Input
- text, image
- Output
- text
- Context window · tokens
- 131072
- Knowledge cutoff
- 2024-08-31
- Published model ID
- gemma3@gemma-3-12b-it
- Capabilities
- multimodal, structuredOutputs, toolCalling, visionInput
Description source ↗Evaluations
101–120 / 173
45.3%
- source id
- mmBench
- leaderboard name
- spatial_relationship
- dimension
- vision
- metric
- spatial_relationship
- rank
- 154
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- spatial_relationship
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗88.8%
- source id
- mmBench
- leaderboard name
- attribute_recognition
- dimension
- vision
- metric
- attribute_recognition
- rank
- 157
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- attribute_recognition
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗75%
- source id
- mmBench
- leaderboard name
- CP
- dimension
- vision
- metric
- CP
- rank
- 159
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_CN_V11_Data
- verified
- Yes
- metric_kind
- CP
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗1,370.278
- source id
- lmarena
- leaderboard name
- LMArena Text German
- dimension
- general
- metric
- Arena rating
- rank
- 161
- sample size
- 166
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- Gemma 3 12B IT
- confidence lower
- 1327.8884956775125
- confidence upper
- 1412.6672729880415
Original result ↗74.9%
- source id
- mmBench
- leaderboard name
- Overall
- dimension
- vision
- metric
- Overall
- rank
- 163
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- Overall
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗79.8%
- source id
- mmBench
- leaderboard name
- FP-S
- dimension
- vision
- metric
- FP-S
- rank
- 164
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- FP-S
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗65.5%
- source id
- mmBench
- leaderboard name
- FP-C
- dimension
- vision
- metric
- FP-C
- rank
- 164
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_CN_V11_Data
- verified
- Yes
- metric_kind
- FP-C
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗1,371.796
- source id
- lmarena
- leaderboard name
- LMArena Text Style Control German
- dimension
- style
- metric
- Arena rating
- rank
- 167
- sample size
- 166
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- Gemma 3 12B IT
- confidence lower
- 1328.982295263197
- confidence upper
- 1414.6100325749294
Original result ↗48.4%
- source id
- mmBench
- leaderboard name
- image_quality
- dimension
- vision
- metric
- image_quality
- rank
- 169
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- image_quality
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗45.2%
- source id
- mmBench
- leaderboard name
- image_quality
- dimension
- vision
- metric
- image_quality
- rank
- 169
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_CN_V11_Data
- verified
- Yes
- metric_kind
- image_quality
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗67.4%
- source id
- mmBench
- leaderboard name
- FP-C
- dimension
- vision
- metric
- FP-C
- rank
- 171
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- FP-C
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗61.3%
- source id
- mmBench
- leaderboard name
- attribute_comparison
- dimension
- vision
- metric
- attribute_comparison
- rank
- 171
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_CN_V11_Data
- verified
- Yes
- metric_kind
- attribute_comparison
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗65.3%
- source id
- mmBench
- leaderboard name
- attribute_comparison
- dimension
- vision
- metric
- attribute_comparison
- rank
- 172
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- attribute_comparison
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗1,376.261
- source id
- lmarena
- leaderboard name
- LMArena Text Industry Business And Management And Financial Operations
- dimension
- general
- metric
- Arena rating
- rank
- 177
- sample size
- 364
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- Gemma 3 12B IT
- confidence lower
- 1346.397366454616
- confidence upper
- 1406.1239329654534
Original result ↗1,380.862
- source id
- lmarena
- leaderboard name
- LMArena Text Industry Legal And Government
- dimension
- general
- metric
- Arena rating
- rank
- 180
- sample size
- 217
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- Gemma 3 12B IT
- confidence lower
- 1342.6894520522096
- confidence upper
- 1419.033746267495
Original result ↗82.9%
- source id
- mmBench
- leaderboard name
- action_recognition
- dimension
- vision
- metric
- action_recognition
- rank
- 182
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- action_recognition
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗52.4%
- source id
- mmBench
- leaderboard name
- object_localization
- dimension
- vision
- metric
- object_localization
- rank
- 182
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_CN_V11_Data
- verified
- Yes
- metric_kind
- object_localization
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗1,386.867
- source id
- lmarena
- leaderboard name
- LMArena Text Style Control Industry Business And Management And Financial Operations
- dimension
- style
- metric
- Arena rating
- rank
- 183
- sample size
- 364
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- Gemma 3 12B IT
- confidence lower
- 1356.8418392631847
- confidence upper
- 1416.8930144320036
Original result ↗75.4%
- source id
- mmBench
- leaderboard name
- CP
- dimension
- vision
- metric
- CP
- rank
- 184
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- CP
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗68.6%
- source id
- mmBench
- leaderboard name
- RR
- dimension
- vision
- metric
- RR
- rank
- 190
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- RR
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-12B
Original result ↗Published prices
1–6 / 6
$0.04
- Inference provider
- cheaperInference
- Platform
- Cheaper Inference
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- zdr
- false
- protocol
- chat_completions
- service_tier
- standard
- Billing label
- Input tokens (per 1M)
$0.13
- Inference provider
- cheaperInference
- Platform
- Cheaper Inference
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- zdr
- false
- protocol
- chat_completions
- service_tier
- standard
- Billing label
- Output tokens (per 1M)
$0.05
- Inference provider
- deepInfra
- Platform
- DeepInfra
- Unit
- input_tokens_per_million
- Currency
- USD
$0.15
- Inference provider
- deepInfra
- Platform
- DeepInfra
- Unit
- output_tokens_per_million
- Currency
- USD
$0.05
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
$0.15
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
Provider specifications & access
1–5 / 5
- source model id
- gemma-3-12b-it
- hosting
- gateway
- context length
- 128000
- max output tokens
- 8192
- capabilities
- structuredOutputs
- toolCalling
- visionInput
- source model id
- google.gemma-3-12b-it
- hosting
- bedrock-managed
- source model id
- google/gemma-3-12b-it
- hosting
- nvidia-inference-listed
- availability
- Listed by inference API; runtime availability unverified
- source model id
- publishers/google/models/gemma3@gemma-3-12b-it
- hosting
- vertex-self-deployed
- source model id
- publishers/hf-google/models/gemma-3-12b-it@001
- hosting
- vertex-self-deployed
Safety assessments
1–1 / 1
41 / 100
- source id
- stanfordFMTI
- canonical model id
- google/gemma-3-12b-it
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Google
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 41 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–3 / 3
- field
- context_length
- value
- 131072
- normalized value
- 131072
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-08-31
- normalized value
- 2024-08-31
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 16384
- normalized value
- 16384
- scope
- source-model
- source id
- openRouter
- confidence
- 1
Explore more models