DeepInfra

About DeepInfra

DeepInfra offers cost-effective, scalable, easy-to-deploy, and production-ready machine-learning models and infrastructures for deep-learning models.

Website ↗Documentation ↗

Source ↗ · 2026-11-12T03:22:34.866718324Z

Service status

unknown

Published API and monitored model status; excludes the website and unmonitored deployments

Official status page ↗

105 indexed models

105 matching models

Qwen: Qwen3 Max

qwen/qwen3-max

Qwen3-Max is an updated release built on the Qwen3 series, offering major improvements in reasoning, instruction following, multilingual support, and long-tail knowledge coverage compared to the January 2025 version. It...

Context window
262,144
Input modalities
text
Output modalities
text

Benchmarks

  • Artificial Analysis: 15.6

Inference prices

  • Published price : $1.20 / input_tokens_per_million · deepInfra ↗
  • Published price : $6.00 / output_tokens_per_million · deepInfra ↗

Qwen: Qwen3 VL 235B A22B Thinking

qwen/qwen3-vl-235b-a22b-thinking

Qwen3-VL-235B-A22B Thinking is a multimodal model that unifies strong text generation with visual understanding across images and video. The Thinking model is optimized for multimodal reasoning in STEM and math....

Context window
131,072
Input modalities
text, image
Output modalities
text
Capabilities
multimodal, structuredOutputs, toolCalling, visionInput

Benchmarks

  • Artificial Analysis: 13.4

Inference prices

  • Published price : $0.45 / input_tokens_per_million · deepInfra ↗
  • Published price : $3.49 / output_tokens_per_million · deepInfra ↗

DeepSeek: R1

deepseek/deepseek-r1

DeepSeek R1 is here: Performance on par with [OpenAI o1](/openai/o1), but open-sourced and with fully open reasoning tokens. It's 671B parameters in size, with 37B active in an inference pass....

Context window
64,000
Input modalities
text
Output modalities
text
Capabilities
reasoning, structuredOutputs, toolCalling

Benchmarks

  • Artificial Analysis: 11.4
  • LLM Stats · GitHub archive: 0.959

Inference prices

  • Published price : $0.70 / input_tokens_per_million · deepInfra ↗
  • Published price : $2.40 / output_tokens_per_million · deepInfra ↗

Qwen: Qwen3 VL 8B Thinking

qwen/qwen3-vl-8b-thinking

Qwen3-VL-8B-Thinking is the reasoning-optimized variant of the Qwen3-VL-8B multimodal model, designed for advanced visual and textual reasoning across complex scenes, documents, and temporal sequences. It integrates enhanced multimodal alignment and...

Context window
131,072
Input modalities
image, text
Output modalities
text
Capabilities
multimodal, structuredOutputs, toolCalling, visionInput

Benchmarks

  • Artificial Analysis: 8.2

Inference prices

  • Published price : $0.18 / input_tokens_per_million · deepInfra ↗
  • Published price : $2.09 / output_tokens_per_million · deepInfra ↗

OpenAI: gpt-oss-120b

openai/gpt-oss-120b

gpt-oss-120b is an open-weight, 117B-parameter Mixture-of-Experts (MoE) language model from OpenAI designed for high-reasoning, agentic, and general-purpose production use cases. It activates 5.1B parameters per forward pass and is optimized to run on a single H100 GPU with nativ

Context window
131,072
Input modalities
text
Output modalities
text
Capabilities
promptCaching, reasoning, structuredOutputs, toolCalling

Benchmarks

  • Artificial Analysis: 3.8
  • HELM Capabilities: 68.833%
  • Kaggle Benchmarks: 100%
  • LLM Stats · GitHub archive: 0.19
  • OpenCompass LLM: 93.4%
  • OpenRouter Benchmarks: 76.305%

Inference prices

  • Published price : $0.04 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.17 / output_tokens_per_million · deepInfra ↗

Z.ai: GLM 4.6

z-ai/glm-4.6

Compared with GLM-4.5, this generation brings several key improvements: Longer context window: The context window has been expanded from 128K to 200K tokens, enabling the model to handle more complex...

Context window
204,800
Input modalities
text
Output modalities
text
Capabilities
promptCaching, reasoning, structuredOutputs, toolCalling

Benchmarks

  • Artificial Analysis: 18.5
  • BFCL: 72.38%
  • OpenCompass LLM: 78.2%
  • OpenRouter Benchmarks: 85.607%
  • SWE-bench: 55.4%

Inference prices

  • Published price : $0.50 / input_tokens_per_million · deepInfra ↗
  • Published price : $2.00 / output_tokens_per_million · deepInfra ↗

DeepSeek: DeepSeek V3.1 Terminus

deepseek/deepseek-v3.1-terminus

DeepSeek-V3.1 Terminus is an update to [DeepSeek V3.1](/deepseek/deepseek-chat-v3.1) that maintains the model's original capabilities while addressing issues reported by users, including language consistency and agent capabilities, further optimizing the model's performance in co

Context window
163,840
Input modalities
text
Output modalities
text
Capabilities
reasoning, structuredOutputs, toolCalling

Benchmarks

  • Artificial Analysis: 14.8
  • LMArena: 1,417.22
  • OpenRouter Benchmarks: 73.333%

Inference prices

  • Published price : $0.27 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.95 / output_tokens_per_million · deepInfra ↗

Google: Gemini 2.5 Pro

google/gemini-2.5-pro

Gemini 2.5 Pro is Google’s state-of-the-art AI model designed for advanced reasoning, coding, mathematics, and scientific tasks. It employs “thinking” capabilities, enabling it to reason through responses with enhanced accuracy and nuanced context handling. Gemini 2.5 Pro achieve

Context window
1,048,576
Input modalities
text, image, file, audio, video
Output modalities
text
Capabilities
audioInput, batch, fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch

Benchmarks

  • Artificial Analysis: 16.1
  • Kaggle Benchmarks: 81.081
  • LLM Stats · GitHub archive: 0.92
  • LMArena: 1,457.88
  • OpenRouter Benchmarks: 82.239%
  • SWE-bench: 53.6%

Inference prices

  • Published price : $1.25 / input_tokens_per_million · deepInfra ↗
  • Published price : $10.00 / output_tokens_per_million · deepInfra ↗

Meta: Llama 3.3 70B Instruct

meta-llama/llama-3.3-70b-instruct

The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model is optimized for multilingual dialogue use cases and outperforms many of the available open

Context window
131,072
Input modalities
text
Output modalities
text
Capabilities
promptCaching, structuredOutputs, toolCalling

Benchmarks

  • Artificial Analysis: 7.7
  • Open LLM Leaderboard v2: 44.847%
  • Open Persian LLM Leaderboard: 71.4%
  • OpenRouter Benchmarks: 49.952%

Inference prices

  • Published price : $0.23 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.40 / output_tokens_per_million · deepInfra ↗

Qwen: Qwen3 235B A22B Thinking 2507

qwen/qwen3-235b-a22b-thinking-2507

Qwen3-235B-A22B-Thinking-2507 is a high-performance, open-weight Mixture-of-Experts (MoE) language model optimized for complex reasoning tasks. It activates 22B of its 235B parameters per forward pass and natively supports up to 262,144 tokens of context. This "thinking-only" var

Context window
128,000
Input modalities
text
Output modalities
text
Capabilities
reasoning, structuredOutputs, toolCalling

Benchmarks

  • Artificial Analysis: 12.7
  • LMArena: 1,415.543
  • OpenCompass LLM: 83.5%
  • OpenRouter Benchmarks: 80.303%

Inference prices

  • Published price : $0.23 / input_tokens_per_million · deepInfra ↗
  • Published price : $2.30 / output_tokens_per_million · deepInfra ↗

OpenAI: gpt-oss-20b

openai/gpt-oss-20b

gpt-oss-20b is an open-weight 21B parameter model released by OpenAI under the Apache 2.0 license. It uses a Mixture-of-Experts (MoE) architecture with 3.6B active parameters per forward pass, optimized for lower-latency inference and deployability on consumer or single-GPU hardw

Context window
131,072
Input modalities
text
Output modalities
text
Capabilities
promptCaching, reasoning, structuredOutputs, toolCalling

Benchmarks

  • Artificial Analysis: 10
  • HELM Capabilities: 56.467%
  • Kaggle Benchmarks: 100%
  • LLM Stats · GitHub archive: 0.173
  • OpenCompass LLM: 87.9%
  • OpenRouter Benchmarks: 44.877%

Inference prices

  • Published price : $0.03 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.14 / output_tokens_per_million · deepInfra ↗

NVIDIA: Nemotron 3 Nano 30B A3B

nvidia/nemotron-3-nano-30b-a3b

NVIDIA Nemotron 3 Nano 30B A3B is a small language MoE model with highest compute efficiency and accuracy for developers to build specialized agentic AI systems. The model is fully...

Context window
262,144
Input modalities
text
Output modalities
text
Capabilities
promptCaching, reasoning, structuredOutputs, toolCalling

Benchmarks

  • Artificial Analysis: 8.9
  • LMArena: 1,348.09
  • OpenRouter Benchmarks: 47.5%

Inference prices

  • Published price : $0.05 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.20 / output_tokens_per_million · deepInfra ↗

Google: Gemma 3 27B

google/gemma-3-27b-it

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling. Gemma

Context window
131,072
Input modalities
text, image
Output modalities
text
Capabilities
multimodal, promptCaching, structuredOutputs, toolCalling, visionInput

Benchmarks

  • Artificial Analysis: 4.9
  • LMArena: 1,357.784
  • MMBench: 100%
  • OpenCompass LLM: 81%
  • Open Persian LLM Leaderboard: 90.6%

Inference prices

  • Published price : $0.08 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.16 / output_tokens_per_million · deepInfra ↗

Meta: Llama 4 Scout

meta-llama/llama-4-scout-17b-16e-instruct

Llama 4 Scout 17B Instruct (16E) is a mixture-of-experts (MoE) language model developed by Meta, activating 17 billion parameters out of a total of 109B. It supports native multimodal input (text and image) and multilingual output (text and code) across 12 supported languages. De

Context window
1,310,720
Input modalities
text, image
Output modalities
text
Capabilities
multimodal, structuredOutputs, toolCalling, visionInput

Benchmarks

  • Artificial Analysis: 6.5
  • BFCL: 28.13%
  • LLM Stats · GitHub archive: 0.678
  • LMArena: 1,279.207

Inference prices

  • Published price : $0.10 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.30 / output_tokens_per_million · deepInfra ↗

Google: Gemma 3 12B

google/gemma-3-12b-it

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling. Gemma

Context window
131,072
Input modalities
text, image
Output modalities
text
Capabilities
multimodal, structuredOutputs, toolCalling, visionInput

Benchmarks

  • Artificial Analysis: 3.8
  • LMArena: 1,334.209
  • MMBench: 97.6%
  • Open Persian LLM Leaderboard: 93.39%
  • OpenRouter Benchmarks: 38.047%

Inference prices

  • Published price : $0.05 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.15 / output_tokens_per_million · deepInfra ↗

Google: Gemma 3 4B

google/gemma-3-4b-it

Gemma 3 introduces multimodality, supporting vision-language input and text outputs. It handles context windows up to 128k tokens, understands over 140 languages, and offers improved math, reasoning, and chat capabilities, including structured outputs and function calling.

Context window
131,072
Input modalities
text, image
Output modalities
text
Capabilities
multimodal, structuredOutputs, toolCalling, visionInput

Benchmarks

  • Artificial Analysis: 4.8
  • LMArena: 1,290.792
  • MMBench: 98.9%
  • Open Persian LLM Leaderboard: 63.76%
  • OpenRouter Benchmarks: 27.104%

Inference prices

  • Published price : $0.05 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.10 / output_tokens_per_million · deepInfra ↗

DeepSeek: DeepSeek V3.2 Exp

deepseek/deepseek-v3.2-exp

DeepSeek-V3.2-Exp is an experimental large language model released by DeepSeek as an intermediate step between V3.1 and future architectures. It introduces DeepSeek Sparse Attention (DSA), a fine-grained sparse attention mechanism designed to improve training and inference effici

Context window
163,840
Input modalities
text
Output modalities
text
Capabilities
reasoning, structuredOutputs, toolCalling

Benchmarks

  • Artificial Analysis: 16.6
  • BFCL: 56.73%
  • LMArena: 1,422.402

Inference prices

  • Published price : $0.21 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.32 / output_tokens_per_million · deepInfra ↗

Google: Gemini 2.5 Flash

google/gemini-2.5-flash

Gemini 2.5 Flash is Google's state-of-the-art workhorse model, specifically designed for advanced reasoning, coding, mathematics, and scientific tasks. It includes built-in "thinking" capabilities, enabling it to provide responses with greater accuracy and nuanced context handlin

Context window
1,048,576
Input modalities
file, image, text, audio, video
Output modalities
text
Capabilities
audioInput, batch, fileInput, multimodal, promptCaching, reasoning, structuredOutputs, toolCalling, visionInput, webSearch

Benchmarks

  • Artificial Analysis: 15.5
  • BFCL: 56.24%
  • Kaggle Benchmarks: 50%
  • LLM Stats · GitHub archive: 0.797
  • LMArena: 1,416.988
  • OpenRouter Benchmarks: 54.667%
  • SWE-bench: 28.73%

Inference prices

  • Published price : $0.30 / input_tokens_per_million · deepInfra ↗
  • Published price : $2.50 / output_tokens_per_million · deepInfra ↗

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace