BFCL

Indexed results from BFCL. Each ranking retains its own metric and evaluation conditions.

BFCL Irrelevance Detection

bfcl · BFCL · Irrelevance detection · percent

  1. nvidia/llama-3.1-nemotron-ultra-253b-v1nvidia100%
  2. mistralai/Ministral-8B-Instruct-2410mistralai100%
  3. claude-haiku-4-5@20251001anthropic95.29%
  4. Anthropic: Claude Sonnet 4.5anthropic95.03%
  5. Google: Gemini 2.5 Flashgoogle93.67%
  6. Google: Gemini 2.5 Flash Litegoogle93.33%
  7. DeepSeek: DeepSeek V3.2 Expdeepseek93.18%
  8. Google: Gemini 2.5 Flash Litegoogle92.5%
  9. Google: Gemini 2.5 Flashgoogle91.09%
  10. OpenAI: GPT-5 Miniopenai91.01%
  11. claude-opus-4-5@20251101anthropic90.75%
  12. OpenAI: GPT-5 Nanoopenai89.1%

BFCL Live

bfcl · BFCL · Live accuracy · percent

  1. gemini-3-pro-previewgoogle83.12%
  2. Qwen: Qwen3 32Bqwen82.01%
  3. Qwen: Qwen3 32Bqwen82.01%
  4. gemini-3-pro-previewgoogle81.72%
  5. Anthropic: Claude Sonnet 4.5anthropic81.13%
  6. Z.ai: GLM 4.6z-ai80.9%
  7. Qwen: Qwen3 14Bqwen80.01%
  8. claude-opus-4-5@20251101anthropic79.79%
  9. Nanbeige/Nanbeige4-3B-Thinking-2511nanbeige79.42%
  10. Qwen: Qwen3 14Bqwen79.35%
  11. OpenAI: GPT-4.1openai78.9%
  12. claude-haiku-4-5@20251001anthropic78.68%

BFCL Memory

bfcl · BFCL · Memory accuracy · percent

  1. claude-opus-4-5@20251101anthropic73.76%
  2. Anthropic: Claude Sonnet 4.5anthropic64.95%
  3. gemini-3-pro-previewgoogle61.72%
  4. Z.ai: GLM 4.6z-ai55.7%
  5. gemini-3-pro-previewgoogle54.84%
  6. claude-haiku-4-5@20251001anthropic54.41%
  7. DeepSeek: DeepSeek V3.2 Expdeepseek54.19%
  8. Grok 4.1 Fast Reasoningspacexai53.98%
  9. OpenAI: o3openai51.83%
  10. OpenAI: o3openai47.31%
  11. OpenAI gpt-5.2 · azure-openai v2025-12-11openai45.81%
  12. OpenAI: GPT-5 Miniopenai44.3%

BFCL Multi Turn

bfcl · BFCL · Multi-turn accuracy · percent

  1. Salesforce/xLAM-2-32b-fc-rsalesforce69.5%
  2. claude-opus-4-5@20251101anthropic68.38%
  3. Z.ai: GLM 4.6z-ai68%
  4. gemini-3-pro-previewgoogle63.12%
  5. OpenAI: o3openai62.25%
  6. Anthropic: Claude Sonnet 4.5anthropic61.37%
  7. gemini-3-pro-previewgoogle60.75%
  8. Grok 4.1 Fast Reasoningspacexai58.87%
  9. Salesforce/xLAM-2-3b-fc-rsalesforce58.38%
  10. claude-haiku-4-5@20251001anthropic53.62%
  11. Nanbeige/Nanbeige4-3B-Thinking-2511nanbeige51.12%
  12. Qwen: Qwen3 32Bqwen47.87%

BFCL Non-Live AST

bfcl · BFCL · Non-live AST accuracy · percent

  1. gemini-3-pro-previewgoogle90.65%
  2. Qwen: Qwen3 32Bqwen90.27%
  3. claude-opus-4-5@20251101anthropic89.65%
  4. Salesforce/xLAM-2-32b-fc-rsalesforce89.6%
  5. Qwen: Qwen3 14Bqwen89.46%
  6. Meta: Llama 4 Scoutmeta-llama89.38%
  7. Qwen: Qwen3 30B A3B Instruct 2507qwen88.92%
  8. Qwen: Qwen3 32Bqwen88.77%
  9. OpenAI: GPT-4.1openai88.69%
  10. Anthropic: Claude Sonnet 4.5anthropic88.65%
  11. claude-opus-4-5@20251101anthropic88.58%
  12. Grok 4.1 Fast Reasoningspacexai88.27%

BFCL Overall

bfcl · BFCL · Overall accuracy · percent

  1. claude-opus-4-5@20251101anthropic77.47%
  2. Anthropic: Claude Sonnet 4.5anthropic73.24%
  3. gemini-3-pro-previewgoogle72.51%
  4. Z.ai: GLM 4.6z-ai72.38%
  5. Grok 4.1 Fast Reasoningspacexai69.57%
  6. claude-haiku-4-5@20251001anthropic68.7%
  7. gemini-3-pro-previewgoogle68.14%
  8. OpenAI: o3openai63.05%
  9. Grok 4.1 Fast Non-Reasoningspacexai58.29%
  10. DeepSeek: DeepSeek V3.2 Expdeepseek56.73%
  11. Google: Gemini 2.5 Flashgoogle56.24%
  12. OpenAI gpt-5.2 · azure-openai v2025-12-11openai55.87%

BFCL Relevance Detection

bfcl · BFCL · Relevance detection · percent

  1. tiiuae/Falcon3-7B-Instructtiiuae100%
  2. OpenAI: GPT-4.1openai100%
  3. Meta: Llama 4 Scoutmeta-llama100%
  4. speakleash/Bielik-11B-v2.3-Instructspeakleash93.75%
  5. DeepSeek: DeepSeek V3.2 Expdeepseek93.75%
  6. tiiuae/Falcon3-10B-Instructtiiuae93.75%
  7. OpenAI: GPT-4.1 Nanoopenai93.75%
  8. OpenAI: GPT-5 Miniopenai93.75%
  9. OpenAI: GPT-5 Nanoopenai93.75%
  10. OpenAI: o3openai93.75%
  11. Qwen: Qwen3 30B A3B Instruct 2507qwen93.75%
  12. Qwen: Qwen3 32Bqwen93.75%

BFCL Web Search

bfcl · BFCL · Web-search accuracy · percent

  1. claude-opus-4-5@20251101anthropic84.5%
  2. claude-haiku-4-5@20251001anthropic83.5%
  3. Grok 4.1 Fast Reasoningspacexai82.5%
  4. OpenAI: GPT-5 Miniopenai82%
  5. Anthropic: Claude Sonnet 4.5anthropic81%
  6. gemini-3-pro-previewgoogle80%
  7. Z.ai: GLM 4.6z-ai77.5%
  8. OpenAI: o3openai77%
  9. OpenAI gpt-5.2 · azure-openai v2025-12-11openai75.5%
  10. OpenAI: o4 Mini (batch)openai75.5%
  11. Grok 4.1 Fast Non-Reasoningspacexai75%
  12. OpenAI: GPT-5 Nanoopenai72.5%

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace