DeepInfra

About DeepInfra

DeepInfra offers cost-effective, scalable, easy-to-deploy, and production-ready machine-learning models and infrastructures for deep-learning models.

Website ↗Documentation ↗

Source ↗ · 2026-11-12T03:22:34.866718324Z

Service status

operational

Published API and monitored model status; excludes the website and unmonitored deployments

Official status page ↗

105 indexed models

105 matching models

nvidia/Nemotron-3-Embed-1B-NVFP4

azureFoundry/azure-huggingface/nvidia--nemotron-3-embed-1b-nvfp4@1

NVFP4-quantized multilingual 1B embedding model for retrieval, semantic search, and RAG.

Context window
32,768
Input modalities
text
Output modalities
embeddings
Capabilities
embeddings

Inference prices

  • Published price : $0.01 / input_tokens_per_million · deepInfra ↗

Nvidia Nemotron Nano 12B V2 VL

vercelAIGatewayCatalog/nvidia/nemotron-nano-12b-v2-vl

The model is an auto-regressive vision language model that uses an optimized transformer architecture. The model enables multi-image reasoning and video understanding, along with strong document intelligence, visual Q&A and summarization capabilities.

Context window
131,072
Maximum output
131,072
Input modalities
text, image
Output modalities
text

Inference prices

  • Published price : $0.20 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.60 / output_tokens_per_million · deepInfra ↗

OpenAI: Whisper Large V3

openai/whisper-large-v3

Whisper Large V3 is OpenAI's open-source automatic speech recognition model offering both audio transcription and translation. It supports 99+ languages and accepts common audio formats including mp3, mp4, wav, webm, flac, and ogg. With 1,550M parameters, it achieves a 10.3% word

Context window
0
Input modalities
audio
Output modalities
transcription
Capabilities
audioInput, transcription

Benchmarks

  • MTEB: 45.341%
  • Open ASR Leaderboard: 2.31%

OpenAI: Whisper Large V3 Turbo

openai/whisper-large-v3-turbo

Whisper Large V3 Turbo is an optimized version of OpenAI's Whisper Large V3 speech recognition model, designed for speed and cost efficiency. It supports transcription across 99+ languages with a 12% word error rate, and accepts common audio formats including mp3, mp4, wav, webm,

Context window
0
Input modalities
audio
Output modalities
transcription
Capabilities
audioInput

Benchmarks

  • Open ASR Leaderboard: 251.74

openchat/openchat_3.5

vertexAI/publishers/hf-openchat/models/openchat_3.5@001

Input modalities
text
Output modalities
text

Benchmarks

  • Open Ko-LLM Leaderboard: 88.889%
  • Open LLM Leaderboard v1: 61.241%
  • Open LLM Leaderboard v2: 21.636%

Inference prices

  • Published price : $0.05 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.05 / output_tokens_per_million · deepInfra ↗

Phind/Phind-CodeLlama-34B-v2

vertexAI/publishers/hf-phind/models/phind-codellama-34b-v2@001

Input modalities
text
Output modalities
text

Benchmarks

  • BigCode Models Leaderboard: 57.67%
  • Open LLM Leaderboard v1: 36.889%

Inference prices

  • Published price : $0.60 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.60 / output_tokens_per_million · deepInfra ↗

Qwen3 Reranker 0.6B

qwen/qwen3-reranker-0.6b

Qwen3 Reranker 0.6B is the smallest text reranking model from Alibaba Cloud in the Qwen3 Reranker series. Built on the Qwen3 architecture, it evaluates query-document pairs to produce relevance scores for retrieval and RAG pipelines. Supports 100+ languages with instruction-aware

Context window
32,768
Input modalities
text
Output modalities
rerank
Capabilities
rerank

Inference prices

  • Published price : $0.01 / input_tokens_per_million · deepInfra ↗

Qwen3 Reranker 8B

qwen/qwen3-reranker-8b

Qwen3 Reranker 8B is a text reranking model from Alibaba Cloud built on the Qwen3 architecture. It evaluates query-document pairs to produce relevance scores for use in retrieval and RAG pipelines. Supports 100+ languages and programming languages, with instruction-aware rerankin

Context window
40,960
Input modalities
text
Output modalities
rerank
Capabilities
rerank

Inference prices

  • Published price : $0.05 / input_tokens_per_million · deepInfra ↗

Qwen: Qwen2.5 7B Instruct

qwen/qwen-2.5-7b-instruct

Qwen2.5 7B is the latest series of Qwen large language models. Qwen2.5 brings the following improvements upon Qwen2: - Significantly more knowledge and has greatly improved capabilities in coding and...

Context window
32,768
Input modalities
text
Output modalities
text
Capabilities
structuredOutputs, toolCalling

Benchmarks

  • Open Ko-LLM Leaderboard: 70.178%
  • Open LLM Leaderboard v2: 35.2%
  • Open Persian LLM Leaderboard: 69.13%

Inference prices

  • Published price : $0.04 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.10 / output_tokens_per_million · deepInfra ↗

Qwen: Qwen3 Coder 30B A3B Instruct

qwen/qwen3-coder-30b-a3b-instruct

Qwen3-Coder-30B-A3B-Instruct is a 30.5B parameter Mixture-of-Experts (MoE) model with 128 experts (8 active per forward pass), designed for advanced code generation, repository-scale understanding, and agentic tool use. Built on the Qwen3 architecture, it supports a native contex

Context window
262,144
Input modalities
text
Output modalities
text
Capabilities
structuredOutputs, toolCalling

Benchmarks

  • Artificial Analysis: 9.6

Inference prices

  • Published price : $0.07 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.26 / output_tokens_per_million · deepInfra ↗

Qwen: Qwen3 Embedding 4B

qwen/qwen3-embedding-4b

The Qwen3 Embedding model series is the latest proprietary model of the Qwen family, specifically designed for text embedding and ranking tasks. This series inherits the exceptional multilingual capabilities, long-text understanding, and reasoning skills of its foundational model

Context window
32,768
Input modalities
text
Output modalities
embeddings
Capabilities
embeddings

Benchmarks

  • MTEB: 65.289%

Inference prices

  • Published price : $0.02 / input_tokens_per_million · deepInfra ↗

Qwen: Qwen3 Embedding 8B

qwen/qwen3-embedding-8b

The Qwen3 Embedding model series is the latest proprietary model of the Qwen family, specifically designed for text embedding and ranking tasks. This series inherits the exceptional multilingual capabilities, long-text understanding, and reasoning skills of its foundational model

Context window
40,960
Input modalities
text
Output modalities
embeddings
Capabilities
embeddings

Benchmarks

  • MTEB: 66.195%

Inference prices

  • Published price : $0.01 / input_tokens_per_million · deepInfra ↗

Qwen: Qwen3 VL 235B A22B Instruct

qwen/qwen3-vl-235b-a22b-instruct

Qwen3-VL-235B-A22B Instruct is an open-weight multimodal model that unifies strong text generation with visual understanding across images and video. The Instruct model targets general vision-language use (VQA, document parsing, chart/table extraction, multilingual OCR). The seri

Context window
262,144
Input modalities
text, image
Output modalities
text
Capabilities
multimodal, promptCaching, structuredOutputs, toolCalling, visionInput

Benchmarks

  • Artificial Analysis: 9.9
  • OpenRouter Benchmarks: 48%

Inference prices

  • Published price : $0.20 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.88 / output_tokens_per_million · deepInfra ↗

Qwen: Qwen3 VL 30B A3B Instruct

qwen/qwen3-vl-30b-a3b-instruct

Qwen3-VL-30B-A3B-Instruct is a multimodal model that unifies strong text generation with visual understanding for images and videos. Its Instruct variant optimizes instruction-following for general multimodal tasks. It excels in perception of real-world/synthetic categories, 2D/3

Context window
262,144
Input modalities
text, image
Output modalities
text
Capabilities
multimodal, structuredOutputs, toolCalling, visionInput

Benchmarks

  • Artificial Analysis: 7.9
  • OpenRouter Benchmarks: 38.667%

Inference prices

  • Published price : $0.15 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.60 / output_tokens_per_million · deepInfra ↗

Qwen: Qwen3 VL 30B A3B Thinking

qwen/qwen3-vl-30b-a3b-thinking

Qwen3-VL-30B-A3B-Thinking is a multimodal model that unifies strong text generation with visual understanding for images and videos. Its Thinking variant enhances reasoning in STEM, math, and complex tasks. It excels...

Context window
262,144
Input modalities
text, image
Output modalities
text
Capabilities
multimodal, structuredOutputs, toolCalling, visionInput

Benchmarks

  • Artificial Analysis: 9.5

Inference prices

  • Published price : $0.29 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.99 / output_tokens_per_million · deepInfra ↗

Qwen: Qwen3 VL 8B Instruct

qwen/qwen3-vl-8b-instruct

Qwen3-VL-8B-Instruct is a multimodal vision-language model from the Qwen3-VL series, built for high-fidelity understanding and reasoning across text, images, and video. It features improved multimodal fusion with Interleaved-MRoPE for long-horizon temporal reasoning, DeepStack fo

Context window
262,144
Input modalities
image, text
Output modalities
text
Capabilities
multimodal, promptCaching, structuredOutputs, toolCalling, visionInput

Benchmarks

  • Artificial Analysis: 7.3
  • OpenRouter Benchmarks: 32.667%

Inference prices

  • Published price : $0.18 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.69 / output_tokens_per_million · deepInfra ↗

Qwen: Wan2.1-T2V-14B

siliconFlow/Wan-AI/Wan2.1-T2V-14B

Wan2.1-T2V-14B is an open-source advanced text-to-video generation model. This 14B model has established state-of-the-art performance benchmarks among both open-source and closed-source models, capable of generating high-quality visual content with significant dynamic effects. It

Input modalities
text
Output modalities
video
Capabilities
videoOutput

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace