microsoft/Phi-3.5-vision-instruct
Explore microsoft/Phi-3.5-vision-instruct: model specifications, capabilities, benchmark results, platform pricing and original sources.
huggingface/microsoft/Phi-3.5-vision-instruct
Specifications & capabilities
- Published model ID
- Phi-3.5-vision-instruct
- Capabilities
- multimodal, visionInput
Evaluations
1–20 / 120
97.6%
- source id
- mmBench
- leaderboard name
- identity_reasoning
- dimension
- vision
- metric
- identity_reasoning
- rank
- 24
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- identity_reasoning
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 162
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗78.3%
- source id
- mmBench
- leaderboard name
- image_emotion
- dimension
- vision
- metric
- image_emotion
- rank
- 38
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_CN_Data
- verified
- Yes
- metric_kind
- image_emotion
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 163
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗97.4%
- source id
- mmBench
- leaderboard name
- identity_reasoning
- dimension
- vision
- metric
- identity_reasoning
- rank
- 49
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- identity_reasoning
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗84.6%
- source id
- mmBench
- leaderboard name
- social_relation
- dimension
- vision
- metric
- social_relation
- rank
- 52
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_CN_Data
- verified
- Yes
- metric_kind
- social_relation
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 163
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗74.7%
- source id
- mmBench
- leaderboard name
- image_emotion
- dimension
- vision
- metric
- image_emotion
- rank
- 61
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- image_emotion
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 162
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗92.9%
- source id
- mmBench
- leaderboard name
- attribute_recognition
- dimension
- vision
- metric
- attribute_recognition
- rank
- 62
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- attribute_recognition
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 162
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗25.7%
- source id
- mmBench
- leaderboard name
- historical_figure
- dimension
- vision
- metric
- historical_figure
- rank
- 64
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- CCBench_Data
- verified
- Yes
- metric_kind
- historical_figure
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 233
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗92.2%
- source id
- mmBench
- leaderboard name
- image_scene
- dimension
- vision
- metric
- image_scene
- rank
- 65
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- image_scene
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 162
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗88.9%
- source id
- mmBench
- leaderboard name
- image_scene
- dimension
- vision
- metric
- image_scene
- rank
- 70
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_V11_Data
- verified
- Yes
- metric_kind
- image_scene
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 295
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗84.6%
- source id
- mmBench
- leaderboard name
- social_relation
- dimension
- vision
- metric
- social_relation
- rank
- 70
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- social_relation
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 162
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗63%
- source id
- mmBench
- leaderboard name
- physical_property_reasoning
- dimension
- vision
- metric
- physical_property_reasoning
- rank
- 76
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_CN_Data
- verified
- Yes
- metric_kind
- physical_property_reasoning
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 163
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗79%
- source id
- mmBench
- leaderboard name
- nature_relation
- dimension
- vision
- metric
- nature_relation
- rank
- 77
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- nature_relation
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 162
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗79.7%
- source id
- mmBench
- leaderboard name
- celebrity_recognition
- dimension
- vision
- metric
- celebrity_recognition
- rank
- 78
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- celebrity_recognition
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 162
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗76.5%
- source id
- mmBench
- leaderboard name
- image_style
- dimension
- vision
- metric
- image_style
- rank
- 84
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- image_style
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 162
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗60.4%
- source id
- mmBench
- leaderboard name
- structuralized_imagetext_understanding
- dimension
- vision
- metric
- structuralized_imagetext_understanding
- rank
- 85
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- structuralized_imagetext_understanding
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 162
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗93.5%
- source id
- mmBench
- leaderboard name
- ocr
- dimension
- vision
- metric
- ocr
- rank
- 86
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- ocr
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 162
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗40.7%
- source id
- mmBench
- leaderboard name
- spatial_relationship
- dimension
- vision
- metric
- spatial_relationship
- rank
- 89
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- spatial_relationship
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 162
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗44.6%
- source id
- mmBench
- leaderboard name
- structuralized_imagetext_understanding
- dimension
- vision
- metric
- structuralized_imagetext_understanding
- rank
- 98
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_CN_Data
- verified
- Yes
- metric_kind
- structuralized_imagetext_understanding
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 163
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗74.9%
- source id
- mmBench
- leaderboard name
- RR
- dimension
- vision
- metric
- RR
- rank
- 100
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- RR
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 235
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗66.7%
- source id
- mmBench
- leaderboard name
- future_prediction
- dimension
- vision
- metric
- future_prediction
- rank
- 100
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MMBench_TEST_EN_Data
- verified
- Yes
- metric_kind
- future_prediction
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- mmbench-data.json
- source_revision
- acb08c72ac038d24cf7785254678efe725354fe91091bfa10a667832ad964b24
- metric_population
- 162
- benchmark_evaluation
- true
- source model id
- Phi-3.5-Vision
Original result ↗Provider specifications & access
1–1 / 1
- source model id
- publishers/hf-microsoft/models/phi-3.5-vision-instruct@001
- hosting
- vertex-self-deployed
Hugging Face model card
1–1 / 1
- downloads
- 788324
- likes
- 739
- pipeline tag
- image-text-to-text
- library name
- transformers
- License
- mit
Explore more models