DeepInfra

About DeepInfra

DeepInfra offers cost-effective, scalable, easy-to-deploy, and production-ready machine-learning models and infrastructures for deep-learning models.

Website ↗Documentation ↗

Source ↗ · 2026-11-12T03:22:34.866718324Z

Service status

operational

Published API and monitored model status; excludes the website and unmonitored deployments

Official status page ↗

105 indexed models

105 matching models

KoboldAI/LLaMA2-13B-Tiefighter

vertexAI/publishers/hf-koboldai/models/llama2-13b-tiefighter@001

Input modalities
text
Output modalities
text

Benchmarks

  • Open LLM Leaderboard v1: 54.513%

Inference prices

  • Published price : $0.10 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.10 / output_tokens_per_million · deepInfra ↗

lightricks: LTX-2.5 Fast

cloudflareWorkersAI/lightricks/ltx-2-5-fast

Lightricks LTX-2.5 Fast is a fast video generation model for text-to-video and image-to-video workflows, with synchronized audio, configurable duration, resolution, and frame rate.

Input modalities
text
Output modalities
video
Capabilities
videoOutput

lizpreciatior/lzlv_70b_fp16_hf

vertexAI/publishers/hf-lizpreciatior/models/lzlv_70b_fp16_hf@001

Input modalities
text
Output modalities
text

Benchmarks

  • Open LLM Leaderboard v1: 67.126%

Inference prices

  • Published price : $0.35 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.40 / output_tokens_per_million · deepInfra ↗

mattshumer/Reflection-Llama-3.1-70B

vertexAI/publishers/hf-mattshumer/models/reflection-llama-3.1-70b@001

Input modalities
text
Output modalities
text

Benchmarks

  • Open LLM Leaderboard v2: 24.393%

Inference prices

  • Published price : $0.35 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.40 / output_tokens_per_million · deepInfra ↗

Meta: Llama Guard 4 12B

meta-llama/llama-guard-4-12b

Llama Guard 4 is a Llama 4 Scout-derived multimodal pretrained model, fine-tuned for content safety classification. Similar to previous versions, it can be used to classify content in both LLM inputs (prompt classification) and in LLM responses (response classification). It acts

Context window
163,840
Input modalities
image, text
Output modalities
text
Capabilities
multimodal, visionInput

Inference prices

  • Published price : $0.18 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.18 / output_tokens_per_million · deepInfra ↗

Mistral: Mistral Small 3

mistralai/mistral-small-24b-instruct-2501

Mistral Small 3 is a 24B-parameter language model optimized for low-latency performance across common AI tasks. Released under the Apache 2.0 license, it features both pre-trained and instruction-tuned versions designed for efficient local deployment. The model achieves 81% accu

Context window
32,768
Input modalities
text
Output modalities
text
Capabilities
structuredOutputs

Benchmarks

  • Artificial Analysis: 6.7

Inference prices

  • Published price : $0.05 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.08 / output_tokens_per_million · deepInfra ↗

Mistral: Mistral Small 3.1 24B

mistralai/mistral-small-3.1-24b-instruct-2503

Mistral Small 3.1 24B Instruct is an upgraded variant of Mistral Small 3 (2501), featuring 24 billion parameters with advanced multimodal capabilities. It provides state-of-the-art performance in text-based reasoning and vision tasks, including image analysis, programming, mathem

Context window
128,000
Input modalities
text, image
Output modalities
text
Capabilities
multimodal, structuredOutputs, toolCalling, visionInput

Benchmarks

  • LLM Stats · GitHub archive: 0.593

Inference prices

  • Published price : $0.05 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.10 / output_tokens_per_million · deepInfra ↗

Mistral: Mistral Small 3.2 24B

mistralai/mistral-small-3.2-24b-instruct-2506

Mistral-Small-3.2-24B-Instruct-2506 is an updated 24B parameter model from Mistral optimized for instruction following, repetition reduction, and improved function calling. Compared to the 3.1 release, version 3.2 significantly improves accuracy on WildBench and Arena Hard, reduc

Context window
256,000
Input modalities
image, text
Output modalities
text
Capabilities
multimodal, promptCaching, structuredOutputs, toolCalling, visionInput

Inference prices

  • Published price : $0.08 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.20 / output_tokens_per_million · deepInfra ↗

MythoMax 13B

gryphe/mythomax-l2-13b

One of the highest performing and most popular fine-tunes of Llama 2 13B, with rich descriptions and roleplay. #merge

Context window
8,192
Input modalities
text
Output modalities
text
Capabilities
structuredOutputs

Benchmarks

  • Open LLM Leaderboard v1: 56.004%

Inference prices

  • Published price : $0.40 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.40 / output_tokens_per_million · deepInfra ↗

Nous: Hermes 3 405B Instruct

nousresearch/hermes-3-llama-3.1-405b

Hermes 3 is a generalist language model with many improvements over Hermes 2, including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across the...

Context window
131,072
Input modalities
text
Output modalities
text

Benchmarks

  • Artificial Analysis: 7.4

Inference prices

  • Published price : $1.00 / input_tokens_per_million · deepInfra ↗
  • Published price : $1.00 / output_tokens_per_million · deepInfra ↗

Nous: Hermes 3 70B Instruct

nousresearch/hermes-3-llama-3.1-70b

Hermes 3 is a generalist language model with many improvements over [Hermes 2](/models/nousresearch/nous-hermes-2-mistral-7b-dpo), including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across

Context window
131,072
Input modalities
text
Output modalities
text

Benchmarks

  • Artificial Analysis: 6.7
  • LiveBench: 39.181%
  • Open LLM Leaderboard v2: 38.515%

Inference prices

  • Published price : $0.70 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.70 / output_tokens_per_million · deepInfra ↗

NovaSky-AI/Sky-T1-32B-Preview

azureFoundry/HuggingFace/novasky-ai-sky-t1-32b-preview@1

`NovaSky-AI/Sky-T1-32B-Preview` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/NovaSky-AI/Sky-T1-32B-Preview) - [Text Generation Inference Docum

Input modalities
text
Output modalities
text

Benchmarks

  • LiveBench: 39.289%

Inference prices

  • Published price : $0.12 / input_tokens_per_million · deepInfra ↗
  • Published price : $0.18 / output_tokens_per_million · deepInfra ↗

nvidia/Cosmos3-Nano

huggingface/nvidia/Cosmos3-Nano

Capabilities
audioInput, imageOutput, multimodal, videoOutput, visionInput

NVIDIA: Llama Nemotron Rerank VL 1B V2 (free)

nvidia/llama-nemotron-rerank-vl-1b-v2

Llama Nemotron Rerank VL 1B V2 is a 1.7B multimodal reranking model from NVIDIA. It evaluates the relevance of document images and text against user queries, designed for vision RAG pipelines handling charts, tables, infographics, and mixed-media documents. Functions as a cross-e

Context window
10,240
Input modalities
text, image
Output modalities
rerank
Capabilities
multimodal, rerank, visionInput

Benchmarks

  • MTEB: 53.41%

Inference prices

  • Published price : $0.01 / input_tokens_per_million · deepInfra ↗

nvidia/Nemotron-3.5-Embed-1B-BF16

azureFoundry/azure-huggingface/nvidia--nemotron-3.5-embed-1b-bf16@1

Multilingual 1B embeddings for semantic search and document retrieval.

Context window
32,768
Input modalities
text
Output modalities
embeddings
Capabilities
embeddings

Benchmarks

  • MTEB: 58.418%

Inference prices

  • Published price : $0.02 / input_tokens_per_million · deepInfra ↗

nvidia/Nemotron-3.5-Embed-8B-BF16

azureFoundry/azure-huggingface/nvidia--nemotron-3.5-embed-8b-bf16@1

Multilingual 8B embeddings for semantic search and document retrieval.

Context window
32,768
Input modalities
text
Output modalities
embeddings
Capabilities
embeddings

Benchmarks

  • MTEB: 60.931%

Inference prices

  • Published price : $0.04 / input_tokens_per_million · deepInfra ↗

nvidia/Nemotron-3.5-Rerank-8B-BF16

azureFoundry/azure-huggingface/nvidia--nemotron-3.5-rerank-8b-bf16@1

Multilingual query/document relevance scoring with an 8B multimodal reranker.

Context window
32,768
Input modalities
text
Output modalities
text

Benchmarks

  • MTEB: 60.301%

Inference prices

  • Published price : $0.05 / input_tokens_per_million · deepInfra ↗

nvidia/Nemotron-3-Embed-1B-BF16

azureFoundry/azure-huggingface/nvidia--nemotron-3-embed-1b-bf16@1

Multilingual 1B embedding model for retrieval, semantic search, and RAG with flexible 2048-dim vectors.

Context window
32,768
Input modalities
text
Output modalities
embeddings
Capabilities
embeddings

Benchmarks

  • MTEB: 50.777%

Inference prices

  • Published price : $0.02 / input_tokens_per_million · deepInfra ↗

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace