Qwen/Qwen2.5-VL-7B-Instruct

Explore Qwen/Qwen2.5-VL-7B-Instruct: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/Qwen/Qwen2.5-VL-7B-Instruct

Specifications & capabilities

Published model ID
Qwen2.5-VL-7B-Instruct
Capabilities
multimodal, visionInput

Evaluations

1–20 / 122

LLM Stats · GitHub archive

0.914

source id
llmStatsArchive
leaderboard name
Android Control Low_EM · Raw
dimension
general
metric
Android Control Low_EM · Raw
rank
3
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Android Control Low_EM
language
en
modality
multimodal
verified
false
max_score
1
categories
  • multimodal
  • reasoning
created_at
2025-07-19T19:56:14.800337+00:00
updated_at
2025-07-19T19:56:14.800337+00:00
description
Android control benchmark evaluating autonomous agents on mobile device interaction tasks with low exact match scoring criteria
benchmark_id
android-control-low-em
multilingual
false
analysis_method
EM
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Android Control Low_EM · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2.5-vl-7b/benchmarks.json
archive_kind
llmStats
evidence_url
https://github.com/QwenLM/Qwen2.5-VL
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2.5-vl-7b
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2.5-vl-7b
Original result ↗

LLM Stats · GitHub archive

0.914

source id
llmStatsArchive
leaderboard name
Android Control Low_EM · Normalized (reported)
dimension
general
metric
Android Control Low_EM · Normalized (reported)
rank
3
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Android Control Low_EM
language
en
modality
multimodal
verified
false
max_score
1
categories
  • multimodal
  • reasoning
created_at
2025-07-19T19:56:14.800337+00:00
updated_at
2025-07-19T19:56:14.800337+00:00
description
Android control benchmark evaluating autonomous agents on mobile device interaction tasks with low exact match scoring criteria
benchmark_id
android-control-low-em
multilingual
false
analysis_method
EM
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Android Control Low_EM · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2.5-vl-7b/benchmarks.json
archive_kind
llmStats
evidence_url
https://github.com/QwenLM/Qwen2.5-VL
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2.5-vl-7b
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2.5-vl-7b
Original result ↗

LLM Stats · GitHub archive

0.819

source id
llmStatsArchive
leaderboard name
AITZ_EM · Normalized (reported)
dimension
general
metric
AITZ_EM · Normalized (reported)
rank
3
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
AITZ_EM
language
en
modality
multimodal
verified
false
max_score
1
categories
  • multimodal
  • reasoning
created_at
2025-07-19T19:56:14.785085+00:00
paper_link
https://arxiv.org/abs/2403.02713
updated_at
2025-07-19T19:56:14.785085+00:00
description
Android-In-The-Zoo (AitZ) benchmark for evaluating autonomous GUI agents on smartphones. Contains 18,643 screen-action pairs with chain-of-action-thought annotations spanning over 70 Android apps. Designed to connect perception (screen layouts and UI elements) with cognition (action decision-making) for natural language-triggered smartphone task completion.
benchmark_id
aitz-em
multilingual
false
analysis_method
EM
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
AITZ_EM · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2.5-vl-7b/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2.5-vl-7b
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2.5-vl-7b
Original result ↗

LLM Stats · GitHub archive

0.819

source id
llmStatsArchive
leaderboard name
AITZ_EM · Raw
dimension
general
metric
AITZ_EM · Raw
rank
3
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
AITZ_EM
language
en
modality
multimodal
verified
false
max_score
1
categories
  • multimodal
  • reasoning
created_at
2025-07-19T19:56:14.785085+00:00
paper_link
https://arxiv.org/abs/2403.02713
updated_at
2025-07-19T19:56:14.785085+00:00
description
Android-In-The-Zoo (AitZ) benchmark for evaluating autonomous GUI agents on smartphones. Contains 18,643 screen-action pairs with chain-of-action-thought annotations spanning over 70 Android apps. Designed to connect perception (screen layouts and UI elements) with cognition (action decision-making) for natural language-triggered smartphone task completion.
benchmark_id
aitz-em
multilingual
false
analysis_method
EM
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
AITZ_EM · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2.5-vl-7b/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2.5-vl-7b
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2.5-vl-7b
Original result ↗

LLM Stats · GitHub archive

0.601

source id
llmStatsArchive
leaderboard name
Android Control High_EM · Raw
dimension
general
metric
Android Control High_EM · Raw
rank
3
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Android Control High_EM
language
en
modality
multimodal
verified
false
max_score
1
categories
  • multimodal
  • reasoning
created_at
2025-07-19T19:56:14.792498+00:00
updated_at
2025-07-19T19:56:14.792498+00:00
description
Android device control benchmark using high exact match evaluation metric for assessing agent performance on mobile interface tasks
benchmark_id
android-control-high-em
multilingual
false
analysis_method
EM
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Android Control High_EM · Raw
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2.5-vl-7b/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2.5-vl-7b
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2.5-vl-7b
Original result ↗

LLM Stats · GitHub archive

0.601

source id
llmStatsArchive
leaderboard name
Android Control High_EM · Normalized (reported)
dimension
general
metric
Android Control High_EM · Normalized (reported)
rank
3
aggregation scope
status
archived
license
CC-BY-4.0
direction
higherIsBetter
conditions
language
en
benchmark
name
Android Control High_EM
language
en
modality
multimodal
verified
false
max_score
1
categories
  • multimodal
  • reasoning
created_at
2025-07-19T19:56:14.792498+00:00
updated_at
2025-07-19T19:56:14.792498+00:00
description
Android device control benchmark using high exact match evaluation metric for assessing agent performance on mobile interface tasks
benchmark_id
android-control-high-em
multilingual
false
analysis_method
EM
is_self_reported
true
verified_by_llmstats
false
attribution
Jonathan Chavez Tamales and LLM Stats contributors (copyright 2024 jc); TensorTrace structures original results and derives scoped ranks.
license_url
https://creativecommons.org/licenses/by/4.0/
metric_kind
Android Control High_EM · Normalized (reported)
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
data/organizations/qwen/models/qwen2.5-vl-7b/benchmarks.json
archive_kind
llmStats
evidence_url
https://huggingface.co/Qwen/Qwen2.5-VL-7B-Instruct
git_revision
872b75f63b8d853c46ed17856424029a0c47b1d2
published_at
2025-10-24T17:47:59Z
snapshot_date
2025-10-24T17:47:59Z
source_revision
6e27aa41f51fa8cb327602349240077d1c7acae9fead8ba2f07db0d549927ddc
publisher_anchor
qwen/qwen2.5-vl-7b
metric_population
3
current_catalog_url
https://llm-stats.com/
benchmark_evaluation
true
source model id
qwen2.5-vl-7b
Original result ↗

MMBench

87.1%

source id
mmBench
leaderboard name
image_quality
dimension
vision
metric
image_quality
rank
4
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
image_quality
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

92.4%

source id
mmBench
leaderboard name
image_scene
dimension
vision
metric
image_scene
rank
5
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_V11_Data
verified
Yes
metric_kind
image_scene
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

92.4%

source id
mmBench
leaderboard name
celebrity_recognition
dimension
vision
metric
celebrity_recognition
rank
10
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
celebrity_recognition
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

92.4%

source id
mmBench
leaderboard name
celebrity_recognition
dimension
vision
metric
celebrity_recognition
rank
11
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
celebrity_recognition
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

91.2%

source id
mmBench
leaderboard name
social_relation
dimension
vision
metric
social_relation
rank
11
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
social_relation
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

90.1%

source id
mmBench
leaderboard name
social_relation
dimension
vision
metric
social_relation
rank
12
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_V11_Data
verified
Yes
metric_kind
social_relation
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

88.2%

source id
mmBench
leaderboard name
CP
dimension
vision
metric
CP
rank
12
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
CP
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
236
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

82.4%

source id
mmBench
leaderboard name
image_style
dimension
vision
metric
image_style
rank
14
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
image_style
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

94.3%

source id
mmBench
leaderboard name
action_recognition
dimension
vision
metric
action_recognition
rank
16
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
action_recognition
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

81.7%

source id
mmBench
leaderboard name
object_localization
dimension
vision
metric
object_localization
rank
17
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
object_localization
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

95.3%

source id
mmBench
leaderboard name
image_scene
dimension
vision
metric
image_scene
rank
18
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
image_scene
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

91.2%

source id
mmBench
leaderboard name
celebrity_recognition
dimension
vision
metric
celebrity_recognition
rank
19
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_V11_Data
verified
Yes
metric_kind
celebrity_recognition
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

64.5%

source id
mmBench
leaderboard name
image_quality
dimension
vision
metric
image_quality
rank
20
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_V11_Data
verified
Yes
metric_kind
image_quality
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

MMBench

83.1%

source id
mmBench
leaderboard name
CP
dimension
vision
metric
CP
rank
21
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_V11_Data
verified
Yes
metric_kind
CP
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Qwen2.5-VL-7B
Original result ↗

Provider specifications & access

1–3 / 3

Qwen/Qwen2.5-VL-7B-Instruct ↗

source model id
HuggingFace/qwen-qwen2.5-vl-7b-instruct@1
hosting
foundry-managed-compute
platforms
  • Microsoft Foundry
license
apache-2.0
architecture
input_modalities
  • text
  • image
output_modalities
  • text
capabilities

    Qwen/Qwen2.5-VL-7B-Instruct ↗

    source model id
    publishers/hf-qwen/models/qwen2.5-vl-7b-instruct@001
    hosting
    vertex-self-deployed
    platforms
    • Google Cloud Vertex AI
    architecture
    input_modalities
    • image
    • text
    output_modalities
    • text
    capabilities
    • multimodal
    • visionInput

    Qwen2.5-VL-7B-Instruct ↗

    source model id
    Qwen/Qwen2.5-VL-7B-Instruct
    hosting
    siliconflow-hosted
    platforms
    • SiliconFlow
    max output tokens
    4096
    architecture
    input_modalities
    • text
    • image
    output_modalities
    • text
    capabilities

      Safety assessments

      1–1 / 1

      Foundation Model Transparency Index 2025 ↗

      26 / 100

      source id
      stanfordFMTI
      canonical model id
      huggingface/Qwen/Qwen2.5-VL-7B-Instruct
      taxonomy
      transparency
      hazard category
      transparency
      hazard name
      Organization transparency
      policy area
      Alibaba
      assessment type
      organization-level disclosure
      metric
      disclosure_score
      result label
      26 / 100
      sample size
      100
      updated at
      2026-11-09T18:08:05.227Z

      Source specification observations

      1–2 / 2

      siliconFlow ↗

      field
      context_length
      value
      33K
      scope
      source-model
      source id
      siliconFlow
      confidence
      1

      siliconFlow ↗

      field
      max_output_tokens
      value
      4K
      scope
      source-model
      source id
      siliconFlow
      confidence
      1

      Original sources

      1–17 / 17

      SiliconFlow · Model page ↗

      Hugging Face · Model repository ↗

      Google Cloud · Model page ↗

      Microsoft Foundry · Model page ↗

      SiliconFlow · Playground ↗

      Microsoft Foundry · Model documentation ↗

      SiliconFlow · API documentation ↗

      arXiv · Paper · 2308.12966 ↗

      arXiv · Paper · 2309.00071 ↗

      arXiv · Paper · 2409.12191 ↗

      GitHub · Catalog ↗

      GitHub · Catalog ↗

      Google Cloud · Catalog ↗

      Hugging Face · Catalog ↗

      Hugging Face · Catalog ↗

      Microsoft Foundry · Catalog ↗

      SiliconFlow · Catalog ↗

      Source links

      1–7 / 7

      Hugging Face model card

      1–1 / 1

      Explore more models

      Models

      Loading
      EVIDENCE / COMPARISON

      Benchmarks

      Explore every benchmark

      Loading

      These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

      Install TensorTrace