Google: Gemma 3 27B
Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning,…
google/gemma-3-27b-it
Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling. Gemma 3 27B is Google's latest open source model, successor to [Gemma 2](google/gemma-2-27b-it)
Specifications & capabilities
- Input
- text, image
- Output
- text
- Context window · tokens
- 131072
- Knowledge cutoff
- 2024-08-31
- Published model ID
- gemma3@gemma-3-27b-it
- Capabilities
- multimodal, promptCaching, structuredOutputs, toolCalling, visionInput
Description source ↗Evaluations
1–20 / 153
100%
- source id
- mmBench
- leaderboard name
- identity_reasoning
- dimension
- vision
- metric
- identity_reasoning
- rank
- 1
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_CN_V11_Data
- verified
- Yes
- metric_kind
- identity_reasoning
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-27B
Original result ↗90.6%
- source id
- openPersianLLM
- leaderboard name
- ARC Challenge
- dimension
- general
- metric
- ARC Challenge
- rank
- 1
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- ARC Challenge
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- google/gemma-3-27b-it
Original result ↗95.69%
- source id
- openPersianLLM
- leaderboard name
- ARC Easy
- dimension
- general
- metric
- ARC Easy
- rank
- 2
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- ARC Easy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- google/gemma-3-27b-it
Original result ↗64.3%
- source id
- openPersianLLM
- leaderboard name
- AUT Multiple Choice Persian
- dimension
- general
- metric
- AUT Multiple Choice Persian
- rank
- 2
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- AUT Multiple Choice Persian
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- google/gemma-3-27b-it
Original result ↗48.56%
- source id
- openPersianLLM
- leaderboard name
- Part Multiple Choice
- dimension
- general
- metric
- Part Multiple Choice
- rank
- 2
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- Part Multiple Choice
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- google/gemma-3-27b-it
Original result ↗40.1%
- source id
- openPersianLLM
- leaderboard name
- MMLU Pro
- dimension
- general
- metric
- MMLU Pro
- rank
- 2
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Open Persian LLM
- language
- fa
- precision
- bfloat16
- metric_kind
- MMLU Pro
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
- published_at
- 2025-12-06T10:13:22Z
- source_revision
- 92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
- metric_population
- 27
- benchmark_evaluation
- true
- source model id
- google/gemma-3-27b-it
Original result ↗98.7%
- source id
- mmBench
- leaderboard name
- identity_reasoning
- dimension
- vision
- metric
- identity_reasoning
- rank
- 10
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- identity_reasoning
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-27B
Original result ↗1,182.131
- source id
- lmarena
- leaderboard name
- LMArena Vision Creative Writing
- dimension
- multimodal
- metric
- Arena rating
- rank
- 25
- sample size
- 732
- evaluated at
- 2026-01-09T00:00:00.000Z
- source model id
- gemma-3-27b-it
- confidence lower
- 1160.6506866246389
- confidence upper
- 1203.6107202296018
Original result ↗1,174.605
- source id
- lmarena
- leaderboard name
- LMArena Vision Style Control Creative Writing
- dimension
- multimodal
- metric
- Arena rating
- rank
- 25
- sample size
- 732
- evaluated at
- 2026-01-09T00:00:00.000Z
- source model id
- gemma-3-27b-it
- confidence lower
- 1152.6282918089
- confidence upper
- 1196.5809008825686
Original result ↗97.8%
- source id
- mmBench
- leaderboard name
- image_topic
- dimension
- vision
- metric
- image_topic
- rank
- 28
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- image_topic
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-27B
Original result ↗1,154.421
- source id
- lmarena
- leaderboard name
- LMArena Vision Captioning
- dimension
- multimodal
- metric
- Arena rating
- rank
- 29
- sample size
- 254
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- Gemma 3 27B IT
- confidence lower
- 1115.517040274267
- confidence upper
- 1193.3240401561288
Original result ↗1,119.192
- source id
- lmarena
- leaderboard name
- LMArena Vision Style Control Captioning
- dimension
- multimodal
- metric
- Arena rating
- rank
- 31
- sample size
- 254
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- Gemma 3 27B IT
- confidence lower
- 1079.894355897593
- confidence upper
- 1158.4906407947838
Original result ↗89.8%
- source id
- mmBench
- leaderboard name
- celebrity_recognition
- dimension
- vision
- metric
- celebrity_recognition
- rank
- 33
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_CN_V11_Data
- verified
- Yes
- metric_kind
- celebrity_recognition
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-27B
Original result ↗90.5%
- source id
- mmBench
- leaderboard name
- celebrity_recognition
- dimension
- vision
- metric
- celebrity_recognition
- rank
- 34
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- celebrity_recognition
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-27B
Original result ↗83.7%
- source id
- mmBench
- leaderboard name
- image_style
- dimension
- vision
- metric
- image_style
- rank
- 36
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- image_style
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-27B
Original result ↗81.5%
- source id
- mmBench
- leaderboard name
- image_style
- dimension
- vision
- metric
- image_style
- rank
- 36
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_CN_V11_Data
- verified
- Yes
- metric_kind
- image_style
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-27B
Original result ↗1,197.161
- source id
- lmarena
- leaderboard name
- LMArena Vision Entity Recognition
- dimension
- multimodal
- metric
- Arena rating
- rank
- 39
- sample size
- 311
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- Gemma 3 27B IT
- confidence lower
- 1162.4718260223062
- confidence upper
- 1231.850570066874
Original result ↗1,170.543
- source id
- lmarena
- leaderboard name
- LMArena Vision Style Control Entity Recognition
- dimension
- multimodal
- metric
- Arena rating
- rank
- 42
- sample size
- 311
- evaluated at
- 2026-11-09T00:00:00.000Z
- source model id
- Gemma 3 27B IT
- confidence lower
- 1135.6602324058206
- confidence upper
- 1205.4264544767161
Original result ↗81%
- source id
- openCompass
- leaderboard name
- IFEval
- dimension
- general
- metric
- IFEval
- rank
- 44
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- OverallTable
- catalog
- open
- snapshot
- month
- REALTIME
- fileName
- assets/research-rank/research-data.REALTIME.20260309.json
- updateTime
- 2026-03-09
- columnFileName
- assets/research-rank/research-column.REALTIME.20260309.json
- metric_kind
- IFEval
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 0-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 48
- benchmark_evaluation
- true
- source model id
- Gemma-3-27B-it
Original result ↗90.2%
- source id
- mmBench
- leaderboard name
- nature_relation
- dimension
- vision
- metric
- nature_relation
- rank
- 46
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- nature_relation
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Gemma3-27B
Original result ↗Published prices
1–7 / 7
$0.09
- Inference provider
- cheaperInference
- Platform
- Cheaper Inference
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- zdr
- false
- protocol
- chat_completions
- service_tier
- standard
- Billing label
- Input tokens (per 1M)
$0.33
- Inference provider
- cheaperInference
- Platform
- Cheaper Inference
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- zdr
- false
- protocol
- chat_completions
- service_tier
- standard
- Billing label
- Output tokens (per 1M)
$0.08
- Inference provider
- deepInfra
- Platform
- DeepInfra
- Unit
- input_tokens_per_million
- Currency
- USD
$0.16
- Inference provider
- deepInfra
- Platform
- DeepInfra
- Unit
- output_tokens_per_million
- Currency
- USD
$0.04
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
$0.08
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
$0.35
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
Provider specifications & access
1–4 / 4
- source model id
- gemma-3-27b-it
- hosting
- gateway
- context length
- 40000
- max output tokens
- 16384
- capabilities
- structuredOutputs
- toolCalling
- source model id
- google.gemma-3-27b-it
- hosting
- bedrock-managed
- source model id
- publishers/google/models/gemma3@gemma-3-27b-it
- hosting
- vertex-self-deployed
- source model id
- publishers/hf-google/models/gemma-3-27b-it@001
- hosting
- vertex-self-deployed
Safety assessments
1–1 / 1
41 / 100
- source id
- stanfordFMTI
- canonical model id
- google/gemma-3-27b-it
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Google
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 41 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–3 / 3
- field
- context_length
- value
- 131072
- normalized value
- 131072
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2024-08-31
- normalized value
- 2024-08-31
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 117964
- normalized value
- 117964
- scope
- source-model
- source id
- openRouter
- confidence
- 1
Explore more models