Google: Gemma 3 4B

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning,…

google/gemma-3-4b-it

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling.

Specifications & capabilities

Input
text, image
Output
text
Context window · tokens
131072
Knowledge cutoff
2024-08-31
Published model ID
gemma3@gemma-3-4b-it
Capabilities
multimodal, structuredOutputs, toolCalling, visionInput
Description source ↗

Evaluations

1–20 / 170

MMBench

98.9%

source id
mmBench
leaderboard name
image_topic
dimension
vision
metric
image_topic
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_V11_Data
verified
Yes
metric_kind
image_topic
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

MMBench

96.5%

source id
mmBench
leaderboard name
image_topic
dimension
vision
metric
image_topic
rank
11
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
image_topic
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

Open Persian LLM Leaderboard

63.76%

source id
openPersianLLM
leaderboard name
ARC Challenge
dimension
general
metric
ARC Challenge
rank
11
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Persian LLM
language
fa
precision
bfloat16
metric_kind
ARC Challenge
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
published_at
2025-12-06T10:13:22Z
source_revision
92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
metric_population
27
benchmark_evaluation
true
source model id
google/gemma-3-4b-it
Original result ↗

MMBench

92.3%

source id
mmBench
leaderboard name
social_relation
dimension
vision
metric
social_relation
rank
13
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
social_relation
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

Open Persian LLM Leaderboard

77.01%

source id
openPersianLLM
leaderboard name
ARC Easy
dimension
general
metric
ARC Easy
rank
13
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Persian LLM
language
fa
precision
bfloat16
metric_kind
ARC Easy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
published_at
2025-12-06T10:13:22Z
source_revision
92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
metric_population
27
benchmark_evaluation
true
source model id
google/gemma-3-4b-it
Original result ↗

Open Persian LLM Leaderboard

34.4%

source id
openPersianLLM
leaderboard name
Part Multiple Choice
dimension
general
metric
Part Multiple Choice
rank
17
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Persian LLM
language
fa
precision
bfloat16
metric_kind
Part Multiple Choice
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
published_at
2025-12-06T10:13:22Z
source_revision
92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
metric_population
27
benchmark_evaluation
true
source model id
google/gemma-3-4b-it
Original result ↗

Open Persian LLM Leaderboard

50.3%

source id
openPersianLLM
leaderboard name
AUT Multiple Choice Persian
dimension
general
metric
AUT Multiple Choice Persian
rank
19
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Persian LLM
language
fa
precision
bfloat16
metric_kind
AUT Multiple Choice Persian
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
published_at
2025-12-06T10:13:22Z
source_revision
92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
metric_population
27
benchmark_evaluation
true
source model id
google/gemma-3-4b-it
Original result ↗

Open Persian LLM Leaderboard

19.81%

source id
openPersianLLM
leaderboard name
MMLU Pro
dimension
general
metric
MMLU Pro
rank
19
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
Open Persian LLM
language
fa
precision
bfloat16
metric_kind
MMLU Pro
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
PartAI/open-persian-llm-leaderboard/leaderboard_data.jsonl
published_at
2025-12-06T10:13:22Z
source_revision
92771e7359b0679b2f851b2a34e98c6ce2ccbf29bb5ae60b12bee0bd0319286e
metric_population
27
benchmark_evaluation
true
source model id
google/gemma-3-4b-it
Original result ↗

MMBench

94.3%

source id
mmBench
leaderboard name
action_recognition
dimension
vision
metric
action_recognition
rank
29
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
action_recognition
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

MMBench

87.9%

source id
mmBench
leaderboard name
social_relation
dimension
vision
metric
social_relation
rank
34
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_V11_Data
verified
Yes
metric_kind
social_relation
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

OpenRouter Benchmarks

27.104%

source id
openRouterBenchmarks
leaderboard name
GPQA Diamond · Accuracy · Parasail
dimension
knowledge
metric
GPQA Diamond · Accuracy
rank
36
sample size
198
aggregation scope
status
published
harness
url
https://github.com/OpenRouterTeam/benchmark-harness
name
OpenRouter benchmark harness
direction
higherIsBetter
run_count
1
conditions
window
newest 90 days; successful visible nonzero runs
dataset
benchmark-leaderboard
benchmark
id
gpqa_diamond
name
GPQA Diamond
record_kind
aggregate
provider_name
Parasail
attribution
Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
last_run_at
2026-10-15T03:00:03.049Z
license_url
https://creativecommons.org/licenses/by/4.0/
methodology
Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
metric_kind
GPQA Diamond · Accuracy
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
sample_size
198
source_file
benchmark-leaderboard.json
source_page
https://openrouter.ai/benchmarks/gpqa-diamond
measurements
accuracy
0.271044
cost_per_task_usd
0.00011306565656565657
output_tokens_per_task
1804.4646464646464
latency_seconds_per_task
10.84611616161616
published_at
2026-11-16T01:46:02.653Z
snapshot_date
2026-11-16
source_revision
7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
transformations
TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
metric_population
36
benchmark_evaluation
true
openrouter_permaslug
google/gemma-3-4b-it
source model id
google/gemma-3-4b-it
Original result ↗

MMBench

85.9%

source id
mmBench
leaderboard name
social_relation
dimension
vision
metric
social_relation
rank
40
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
social_relation
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

MMBench

94.8%

source id
mmBench
leaderboard name
ocr
dimension
vision
metric
ocr
rank
41
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
ocr
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

MMBench

93.8%

source id
mmBench
leaderboard name
image_scene
dimension
vision
metric
image_scene
rank
48
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
image_scene
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

MMBench

87.9%

source id
mmBench
leaderboard name
social_relation
dimension
vision
metric
social_relation
rank
53
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
social_relation
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

MMBench

73.6%

source id
mmBench
leaderboard name
future_prediction
dimension
vision
metric
future_prediction
rank
54
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
future_prediction
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

MMBench

83.1%

source id
mmBench
leaderboard name
celebrity_recognition
dimension
vision
metric
celebrity_recognition
rank
58
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
celebrity_recognition
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

MMBench

74.7%

source id
mmBench
leaderboard name
image_emotion
dimension
vision
metric
image_emotion
rank
61
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
image_emotion
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

MMBench

79%

source id
mmBench
leaderboard name
nature_relation
dimension
vision
metric
nature_relation
rank
65
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
nature_relation
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

MMBench

96.5%

source id
mmBench
leaderboard name
image_topic
dimension
vision
metric
image_topic
rank
67
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
image_topic
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Gemma3-4B
Original result ↗

Published prices

1–6 / 6

gemma-3-4b-it ↗

$0.03

Inference provider
cheaperInference
Platform
Cheaper Inference
Unit
input_tokens_per_million
Currency
USD
Billing conditions
zdr
false
protocol
chat_completions
service_tier
standard
Billing label
Input tokens (per 1M)

gemma-3-4b-it ↗

$0.07

Inference provider
cheaperInference
Platform
Cheaper Inference
Unit
output_tokens_per_million
Currency
USD
Billing conditions
zdr
false
protocol
chat_completions
service_tier
standard
Billing label
Output tokens (per 1M)

google/gemma-3-4b-it ↗

$0.05

Inference provider
deepInfra
Platform
DeepInfra
Unit
input_tokens_per_million
Currency
USD
Billing conditions

google/gemma-3-4b-it ↗

$0.10

Inference provider
deepInfra
Platform
DeepInfra
Unit
output_tokens_per_million
Currency
USD
Billing conditions

google/gemma-3-4b-it ↗

$0.05

Inference provider
openRouter
Platform
OpenRouter
Unit
input_tokens_per_million
Currency
USD
Billing conditions

google/gemma-3-4b-it ↗

$0.10

Inference provider
openRouter
Platform
OpenRouter
Unit
output_tokens_per_million
Currency
USD
Billing conditions

Provider specifications & access

1–5 / 5

gemma-3-4b-it ↗

source model id
gemma-3-4b-it
hosting
gateway
platforms
  • Cheaper Inference
context length
128000
max output tokens
8000
architecture
input_modalities
  • text
  • image
output_modalities
  • text
capabilities
  • structuredOutputs
  • toolCalling
  • visionInput

Gemma 3 4B IT ↗

source model id
google.gemma-3-4b-it
hosting
bedrock-managed
platforms
  • Amazon Bedrock
architecture
input_modalities
  • text
  • image
output_modalities
  • text
capabilities

    google/gemma-3-4b-it ↗

    source model id
    google/gemma-3-4b-it
    hosting
    nvidia-inference-listed
    platforms
    • NVIDIA inference catalog
    architecture
    input_modalities
      output_modalities
        capabilities
          availability
          Listed by inference API; runtime availability unverified

          gemma-3-4b-it ↗

          source model id
          publishers/google/models/gemma3@gemma-3-4b-it
          hosting
          vertex-self-deployed
          platforms
          • Google Cloud Vertex AI
          architecture
          input_modalities
          • image
          • text
          output_modalities
          • text
          capabilities
          • multimodal
          • visionInput

          google/gemma-3-4b-it ↗

          source model id
          publishers/hf-google/models/gemma-3-4b-it@001
          hosting
          vertex-self-deployed
          platforms
          • Google Cloud Vertex AI
          architecture
          input_modalities
          • image
          • text
          output_modalities
          • text
          capabilities
          • multimodal
          • visionInput

          Safety assessments

          1–1 / 1

          Foundation Model Transparency Index 2025 ↗

          41 / 100

          source id
          stanfordFMTI
          canonical model id
          google/gemma-3-4b-it
          taxonomy
          transparency
          hazard category
          transparency
          hazard name
          Organization transparency
          policy area
          Google
          assessment type
          organization-level disclosure
          metric
          disclosure_score
          result label
          41 / 100
          sample size
          100
          updated at
          2026-11-09T18:08:05.227Z

          Source specification observations

          1–3 / 3

          openRouter ↗

          field
          context_length
          value
          131072
          normalized value
          131072
          scope
          source-model
          source id
          openRouter
          confidence
          1

          openRouter ↗

          field
          knowledge_cutoff
          reported field
          knowledge_cutoff
          value
          2024-08-31
          normalized value
          2024-08-31
          precision
          day
          scope
          source-model
          source id
          openRouter
          confidence
          1

          openRouter ↗

          field
          max_output_tokens
          value
          16384
          normalized value
          16384
          scope
          source-model
          source id
          openRouter
          confidence
          1

          Original sources

          41–50 / 50

          Epoch AI · Catalog ↗

          GitHub · Catalog ↗

          GitHub · Catalog ↗

          Google Cloud · Catalog ↗

          Hugging Face · Catalog ↗

          Hugging Face · Catalog ↗

          Hugging Face · Catalog ↗

          LMArena · Catalog ↗

          OpenRouter · Catalog ↗

          OpenRouter · Catalog ↗

          Source links

          1–15 / 15

          Hugging Face model card

          1–1 / 1

          Explore more models

          Models

          Loading
          EVIDENCE / COMPARISON

          Benchmarks

          Explore every benchmark

          Loading

          These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

          Install TensorTrace