vertexAI/publishers/hf-koboldai/models/llama2-13b-tiefighter@001
- Input modalities
- text
- Output modalities
- text
Benchmarks
- Open LLM Leaderboard v1: 54.513%
Inference prices
- Published price : $0.10 / input_tokens_per_million · deepInfra ↗
- Published price : $0.10 / output_tokens_per_million · deepInfra ↗
cloudflareWorkersAI/lightricks/ltx-2-5-fast
Lightricks LTX-2.5 Fast is a fast video generation model for text-to-video and image-to-video workflows, with synchronized audio, configurable duration, resolution, and frame rate.
- Input modalities
- text
- Output modalities
- video
- Capabilities
- videoOutput
vertexAI/publishers/hf-lizpreciatior/models/lzlv_70b_fp16_hf@001
- Input modalities
- text
- Output modalities
- text
Benchmarks
- Open LLM Leaderboard v1: 67.126%
Inference prices
- Published price : $0.35 / input_tokens_per_million · deepInfra ↗
- Published price : $0.40 / output_tokens_per_million · deepInfra ↗
vertexAI/publishers/hf-mattshumer/models/reflection-llama-3.1-70b@001
- Input modalities
- text
- Output modalities
- text
Benchmarks
- Open LLM Leaderboard v2: 24.393%
Inference prices
- Published price : $0.35 / input_tokens_per_million · deepInfra ↗
- Published price : $0.40 / output_tokens_per_million · deepInfra ↗
meta-llama/llama-guard-4-12b
Llama Guard 4 is a Llama 4 Scout-derived multimodal pretrained model, fine-tuned for content safety classification. Similar to previous versions, it can be used to classify content in both LLM inputs (prompt classification) and in LLM responses (response classification). It acts
- Context window
- 163,840
- Input modalities
- image, text
- Output modalities
- text
- Capabilities
- multimodal, visionInput
Inference prices
- Published price : $0.18 / input_tokens_per_million · deepInfra ↗
- Published price : $0.18 / output_tokens_per_million · deepInfra ↗
mistralai/mistral-small-24b-instruct-2501
Mistral Small 3 is a 24B-parameter language model optimized for low-latency performance across common AI tasks. Released under the Apache 2.0 license, it features both pre-trained and instruction-tuned versions designed for efficient local deployment. The model achieves 81% accu
- Context window
- 32,768
- Input modalities
- text
- Output modalities
- text
- Capabilities
- structuredOutputs
Benchmarks
Inference prices
- Published price : $0.05 / input_tokens_per_million · deepInfra ↗
- Published price : $0.08 / output_tokens_per_million · deepInfra ↗
mistralai/mistral-small-3.1-24b-instruct-2503
Mistral Small 3.1 24B Instruct is an upgraded variant of Mistral Small 3 (2501), featuring 24 billion parameters with advanced multimodal capabilities. It provides state-of-the-art performance in text-based reasoning and vision tasks, including image analysis, programming, mathem
- Context window
- 128,000
- Input modalities
- text, image
- Output modalities
- text
- Capabilities
- multimodal, structuredOutputs, toolCalling, visionInput
Benchmarks
- LLM Stats · GitHub archive: 0.593
Inference prices
- Published price : $0.05 / input_tokens_per_million · deepInfra ↗
- Published price : $0.10 / output_tokens_per_million · deepInfra ↗
mistralai/mistral-small-3.2-24b-instruct-2506
Mistral-Small-3.2-24B-Instruct-2506 is an updated 24B parameter model from Mistral optimized for instruction following, repetition reduction, and improved function calling. Compared to the 3.1 release, version 3.2 significantly improves accuracy on WildBench and Arena Hard, reduc
- Context window
- 256,000
- Input modalities
- image, text
- Output modalities
- text
- Capabilities
- multimodal, promptCaching, structuredOutputs, toolCalling, visionInput
Inference prices
- Published price : $0.08 / input_tokens_per_million · deepInfra ↗
- Published price : $0.20 / output_tokens_per_million · deepInfra ↗
gryphe/mythomax-l2-13b
One of the highest performing and most popular fine-tunes of Llama 2 13B, with rich descriptions and roleplay. #merge
- Context window
- 8,192
- Input modalities
- text
- Output modalities
- text
- Capabilities
- structuredOutputs
Benchmarks
- Open LLM Leaderboard v1: 56.004%
Inference prices
- Published price : $0.40 / input_tokens_per_million · deepInfra ↗
- Published price : $0.40 / output_tokens_per_million · deepInfra ↗
nousresearch/hermes-3-llama-3.1-405b
Hermes 3 is a generalist language model with many improvements over Hermes 2, including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across the...
- Context window
- 131,072
- Input modalities
- text
- Output modalities
- text
Benchmarks
Inference prices
- Published price : $1.00 / input_tokens_per_million · deepInfra ↗
- Published price : $1.00 / output_tokens_per_million · deepInfra ↗
nousresearch/hermes-3-llama-3.1-70b
Hermes 3 is a generalist language model with many improvements over [Hermes 2](/models/nousresearch/nous-hermes-2-mistral-7b-dpo), including advanced agentic capabilities, much better roleplaying, reasoning, multi-turn conversation, long context coherence, and improvements across
- Context window
- 131,072
- Input modalities
- text
- Output modalities
- text
Benchmarks
- Artificial Analysis: 6.7
- LiveBench: 39.181%
- Open LLM Leaderboard v2: 38.515%
Inference prices
- Published price : $0.70 / input_tokens_per_million · deepInfra ↗
- Published price : $0.70 / output_tokens_per_million · deepInfra ↗
azureFoundry/HuggingFace/novasky-ai-sky-t1-32b-preview@1
`NovaSky-AI/Sky-T1-32B-Preview` powered by Text Generation Inference (TGI) - [Example Notebook](https://aka.ms/hugging-face-text-generation-streaming-online-endpoint) - [Original Model Card](https://huggingface.co/NovaSky-AI/Sky-T1-32B-Preview) - [Text Generation Inference Docum
- Input modalities
- text
- Output modalities
- text
Benchmarks
Inference prices
- Published price : $0.12 / input_tokens_per_million · deepInfra ↗
- Published price : $0.18 / output_tokens_per_million · deepInfra ↗
huggingface/nvidia/Cosmos3-Nano
- Capabilities
- audioInput, imageOutput, multimodal, videoOutput, visionInput
nvidia/llama-nemotron-rerank-vl-1b-v2
Llama Nemotron Rerank VL 1B V2 is a 1.7B multimodal reranking model from NVIDIA. It evaluates the relevance of document images and text against user queries, designed for vision RAG pipelines handling charts, tables, infographics, and mixed-media documents. Functions as a cross-e
- Context window
- 10,240
- Input modalities
- text, image
- Output modalities
- rerank
- Capabilities
- multimodal, rerank, visionInput
Benchmarks
Inference prices
- Published price : $0.01 / input_tokens_per_million · deepInfra ↗
azureFoundry/azure-huggingface/nvidia--nemotron-3.5-embed-1b-bf16@1
Multilingual 1B embeddings for semantic search and document retrieval.
- Context window
- 32,768
- Input modalities
- text
- Output modalities
- embeddings
- Capabilities
- embeddings
Benchmarks
Inference prices
- Published price : $0.02 / input_tokens_per_million · deepInfra ↗
azureFoundry/azure-huggingface/nvidia--nemotron-3.5-embed-8b-bf16@1
Multilingual 8B embeddings for semantic search and document retrieval.
- Context window
- 32,768
- Input modalities
- text
- Output modalities
- embeddings
- Capabilities
- embeddings
Benchmarks
Inference prices
- Published price : $0.04 / input_tokens_per_million · deepInfra ↗
azureFoundry/azure-huggingface/nvidia--nemotron-3.5-rerank-8b-bf16@1
Multilingual query/document relevance scoring with an 8B multimodal reranker.
- Context window
- 32,768
- Input modalities
- text
- Output modalities
- text
Benchmarks
Inference prices
- Published price : $0.05 / input_tokens_per_million · deepInfra ↗
azureFoundry/azure-huggingface/nvidia--nemotron-3-embed-1b-bf16@1
Multilingual 1B embedding model for retrieval, semantic search, and RAG with flexible 2048-dim vectors.
- Context window
- 32,768
- Input modalities
- text
- Output modalities
- embeddings
- Capabilities
- embeddings
Benchmarks
Inference prices
- Published price : $0.02 / input_tokens_per_million · deepInfra ↗