microsoft/Phi-3.5-vision-instruct

Explore microsoft/Phi-3.5-vision-instruct: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/microsoft/Phi-3.5-vision-instruct

Specifications & capabilities

Published model ID
Phi-3.5-vision-instruct
Capabilities
multimodal, visionInput

Evaluations

1–20 / 120

MMBench

97.6%

source id
mmBench
leaderboard name
identity_reasoning
dimension
vision
metric
identity_reasoning
rank
24
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
identity_reasoning
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

78.3%

source id
mmBench
leaderboard name
image_emotion
dimension
vision
metric
image_emotion
rank
38
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
image_emotion
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

97.4%

source id
mmBench
leaderboard name
identity_reasoning
dimension
vision
metric
identity_reasoning
rank
49
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
identity_reasoning
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

84.6%

source id
mmBench
leaderboard name
social_relation
dimension
vision
metric
social_relation
rank
52
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
social_relation
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

74.7%

source id
mmBench
leaderboard name
image_emotion
dimension
vision
metric
image_emotion
rank
61
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
image_emotion
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

92.9%

source id
mmBench
leaderboard name
attribute_recognition
dimension
vision
metric
attribute_recognition
rank
62
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
attribute_recognition
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

25.7%

source id
mmBench
leaderboard name
historical_figure
dimension
vision
metric
historical_figure
rank
64
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
CCBench_Data
verified
Yes
metric_kind
historical_figure
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
233
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

92.2%

source id
mmBench
leaderboard name
image_scene
dimension
vision
metric
image_scene
rank
65
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
image_scene
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

88.9%

source id
mmBench
leaderboard name
image_scene
dimension
vision
metric
image_scene
rank
70
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_V11_Data
verified
Yes
metric_kind
image_scene
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
295
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

84.6%

source id
mmBench
leaderboard name
social_relation
dimension
vision
metric
social_relation
rank
70
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
social_relation
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

63%

source id
mmBench
leaderboard name
physical_property_reasoning
dimension
vision
metric
physical_property_reasoning
rank
76
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
physical_property_reasoning
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

79%

source id
mmBench
leaderboard name
nature_relation
dimension
vision
metric
nature_relation
rank
77
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
nature_relation
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

79.7%

source id
mmBench
leaderboard name
celebrity_recognition
dimension
vision
metric
celebrity_recognition
rank
78
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
celebrity_recognition
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

76.5%

source id
mmBench
leaderboard name
image_style
dimension
vision
metric
image_style
rank
84
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
image_style
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

60.4%

source id
mmBench
leaderboard name
structuralized_imagetext_understanding
dimension
vision
metric
structuralized_imagetext_understanding
rank
85
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
structuralized_imagetext_understanding
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

93.5%

source id
mmBench
leaderboard name
ocr
dimension
vision
metric
ocr
rank
86
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
ocr
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

40.7%

source id
mmBench
leaderboard name
spatial_relationship
dimension
vision
metric
spatial_relationship
rank
89
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
spatial_relationship
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

44.6%

source id
mmBench
leaderboard name
structuralized_imagetext_understanding
dimension
vision
metric
structuralized_imagetext_understanding
rank
98
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_CN_Data
verified
Yes
metric_kind
structuralized_imagetext_understanding
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
163
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

74.9%

source id
mmBench
leaderboard name
RR
dimension
vision
metric
RR
rank
100
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
RR
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
235
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

MMBench

66.7%

source id
mmBench
leaderboard name
future_prediction
dimension
vision
metric
future_prediction
rank
100
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
MMBench_TEST_EN_Data
verified
Yes
metric_kind
future_prediction
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
mmbench-data.json
source_revision
acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
metric_population
162
benchmark_evaluation
true
source model id
Phi-3.5-Vision
Original result ↗

Provider specifications & access

1–1 / 1

microsoft/Phi-3.5-vision-instruct ↗

source model id
publishers/hf-microsoft/models/phi-3.5-vision-instruct@001
hosting
vertex-self-deployed
platforms
  • Google Cloud Vertex AI
architecture
input_modalities
  • image
  • text
output_modalities
  • text
capabilities
  • multimodal
  • visionInput

Original sources

1–8 / 8

Hugging Face · microsoft/Phi-3.5-vision-instruct ↗

Google Cloud · Model page ↗

arXiv · Paper · 2404.14219 ↗

GitHub · Catalog ↗

Google Cloud · Catalog ↗

Hugging Face · Catalog ↗

Hugging Face · Catalog ↗

LMArena · Catalog ↗

Source links

1–5 / 5

Hugging Face model card

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace