DeepSeek: DeepSeek V4 Flash 0423
DeepSeek V4 Flash is an efficiency-optimized Mixture-of-Experts model from DeepSeek with 284B total parameters and 13B activated parameters, supporting a 1M-token context window. It is designed for f…
deepseek/deepseek-v4-flash-20260423
DeepSeek V4 Flash is an efficiency-optimized Mixture-of-Experts model from DeepSeek with 284B total parameters and 13B activated parameters, supporting a 1M-token context window. It is designed for fast inference and high-throughput workloads, while maintaining strong reasoning and coding performance.
The model includes hybrid attention for efficient long-context processing. Reasoning efforts `high` and `xhigh` are supported; `xhigh` maps to max reasoning. It is well suited for applications such as coding assistants, chat systems, and agent workflows where responsiveness and cost efficiency are important.
Specifications & capabilities
- Input
- text
- Output
- text
- Context window · tokens
- 1048576
- Knowledge cutoff
- 2025-05
- Published model ID
- DeepSeek-V4-Flash
- Capabilities
- promptCaching, reasoning, structuredOutputs, toolCalling
Description source ↗Evaluations
41–60 / 71
79%
- source id
- openCompass
- leaderboard name
- Average
- dimension
- general
- metric
- Average
- rank
- 11
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- CodeTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Average
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗79%
- source id
- openCompass
- leaderboard name
- Code
- dimension
- general
- metric
- Code
- rank
- 11
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- OverallTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Code
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗75%
- source id
- openCompass
- leaderboard name
- Math_College
- dimension
- general
- metric
- Math_College
- rank
- 11
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MathTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Math_College
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗61%
- source id
- openCompass
- leaderboard name
- Reasoning
- dimension
- general
- metric
- Reasoning
- rank
- 11
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- OverallTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Reasoning
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗61%
- source id
- openCompass
- leaderboard name
- Average
- dimension
- general
- metric
- Average
- rank
- 11
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- ReasonTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Average
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗88.215%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · Novita
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 12
- sample size
- 594
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 3
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- Novita
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-03T16:57:09.267Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 594
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.8821546666666666
- accuracy_std_dev
- 0.015120291935747206
- cost_per_task_usd
- 0.007597324915824916
- output_tokens_per_task
- 26812.25925925926
- latency_seconds_per_task
- 210.52051515151513
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 59
- benchmark_evaluation
- true
- openrouter_permaslug
- deepseek/deepseek-v4-flash-20260423
- source model id
- deepseek/deepseek-v4-flash-20260423
Original result ↗86.229%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · DigitalOcean
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 12
- sample size
- 990
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 5
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- DigitalOcean
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T16:46:54.774Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 990
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.8622894
- accuracy_std_dev
- 0.02509268697130698
- cost_per_task_usd
- 0.0055417101010101
- output_tokens_per_task
- 29101.413131313133
- latency_seconds_per_task
- 936.3557888888889
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 23
- benchmark_evaluation
- true
- openrouter_permaslug
- deepseek/deepseek-v4-flash-20260423
- source model id
- deepseek/deepseek-v4-flash-20260423
Original result ↗73%
- source id
- openCompass
- leaderboard name
- Common_Reasoning
- dimension
- general
- metric
- Common_Reasoning
- rank
- 12
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- ReasonTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Common_Reasoning
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗84.752%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · AtlasCloud
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 13
- sample size
- 1386
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 7
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- AtlasCloud
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T16:04:29.124Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 1386
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.8475227142857141
- accuracy_std_dev
- 0.03525429692033209
- cost_per_task_usd
- 0.01139066955266955
- output_tokens_per_task
- 40336.09018759019
- latency_seconds_per_task
- 480.83486796536795
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 30
- benchmark_evaluation
- true
- openrouter_permaslug
- deepseek/deepseek-v4-flash-20260423
- source model id
- deepseek/deepseek-v4-flash-20260423
Original result ↗73.7%
- source id
- openCompass
- leaderboard name
- Average
- dimension
- general
- metric
- Average
- rank
- 13
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- OverallTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Average
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗70.4%
- source id
- openCompass
- leaderboard name
- Math
- dimension
- general
- metric
- Math
- rank
- 13
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- OverallTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Math
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗70.4%
- source id
- openCompass
- leaderboard name
- Average
- dimension
- general
- metric
- Average
- rank
- 13
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- MathTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Average
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗34.68%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · Reka
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 13
- sample size
- 198
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 1
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- Reka
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-03T00:19:24.096Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 198
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.346801
- cost_per_task_usd
- 0.008616373737373737
- output_tokens_per_task
- 32995.232323232325
- latency_seconds_per_task
- 1179.1815303030303
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 13
- benchmark_evaluation
- true
- openrouter_permaslug
- deepseek/deepseek-v4-flash-20260423
- source model id
- deepseek/deepseek-v4-flash-20260423
Original result ↗83.3%
- source id
- openCompass
- leaderboard name
- Knowledge_Engineering
- dimension
- general
- metric
- Knowledge_Engineering
- rank
- 14
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- KnowledgeTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Knowledge_Engineering
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗84.5%
- source id
- openCompass
- leaderboard name
- Knowledge
- dimension
- general
- metric
- Knowledge
- rank
- 15
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- OverallTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Knowledge
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗84.5%
- source id
- openCompass
- leaderboard name
- Average
- dimension
- general
- metric
- Average
- rank
- 15
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- KnowledgeTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Average
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗84.2%
- source id
- openCompass
- leaderboard name
- Knowledge_Science
- dimension
- general
- metric
- Knowledge_Science
- rank
- 15
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- KnowledgeTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Knowledge_Science
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗84.091%
- source id
- openRouterBenchmarks
- leaderboard name
- GPQA Diamond · Accuracy · StreamLake
- dimension
- knowledge
- metric
- GPQA Diamond · Accuracy
- rank
- 15
- sample size
- 1584
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 8
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- gpqa_diamond
- name
- GPQA Diamond
- record_kind
- aggregate
- provider_name
- StreamLake
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T16:18:02.140Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- GPQA Diamond · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 1584
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/gpqa-diamond
- measurements
- accuracy
- 0.8409089999999999
- accuracy_std_dev
- 0.045212357351171156
- cost_per_task_usd
- 0.0038926938131313127
- output_tokens_per_task
- 43083.319444444445
- latency_seconds_per_task
- 564.2816047979799
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 30
- benchmark_evaluation
- true
- openrouter_permaslug
- deepseek/deepseek-v4-flash-20260423
- source model id
- deepseek/deepseek-v4-flash-20260423
Original result ↗77.9%
- source id
- openCompass
- leaderboard name
- Knowledge_CommonSense
- dimension
- general
- metric
- Knowledge_CommonSense
- rank
- 15
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- KnowledgeTable
- catalog
- closed
- snapshot
- month
- 26-07
- fileName
- assets/llm-rank/llm-data-v2.26-07.20260824.json
- updateTime
- 2026-08-24
- columnFileName
- assets/llm-rank/llm-column-v2.26-07.20260824.json
- metric_kind
- Knowledge_CommonSense
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 1-data.json
- source_revision
- 117c5effa3066abf39f3e8f61109707b09f0cd95223246c07acd6289f4f7fcd2
- metric_population
- 15
- benchmark_evaluation
- true
- source model id
- DeepSeek-V4-Flash
Original result ↗76%
- source id
- openRouterBenchmarks
- leaderboard name
- tau2-bench Verified Airline · Accuracy · DeepInfra
- dimension
- agentic
- metric
- tau2-bench Verified Airline · Accuracy
- rank
- 15
- sample size
- 250
- aggregation scope
- status
- published
- harness
- url
- https://github.com/OpenRouterTeam/benchmark-harness
- name
- OpenRouter benchmark harness
- direction
- higherIsBetter
- run_count
- 5
- conditions
- window
- newest 90 days; successful visible nonzero runs
- dataset
- benchmark-leaderboard
- benchmark
- id
- tau_bench_verified_airline
- name
- tau2-bench Verified Airline
- record_kind
- aggregate
- provider_name
- DeepInfra
- attribution
- Source: OpenRouter (openrouter.ai), licensed under CC BY 4.0: reuse and republish with attribution to OpenRouter.
- last_run_at
- 2026-10-31T20:10:56.893Z
- license_url
- https://creativecommons.org/licenses/by/4.0/
- methodology
- Rows aggregate the benchmark-runs dataset exactly as the leaderboard pages do, over each benchmark's non-zero-score runs from the newest 90 days: accuracy is the task-weighted mean of per-run accuracy, accuracy_std_dev is the population standard deviation of per-run accuracy (null with a single run), and the per-task averages divide summed cost, generation time, and output tokens by summed tasks. Rows are ordered by accuracy descending, then model name.
- metric_kind
- tau2-bench Verified Airline · Accuracy
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- sample_size
- 250
- source_file
- benchmark-leaderboard.json
- source_page
- https://openrouter.ai/benchmarks/tau2-bench-airline
- measurements
- accuracy
- 0.7599998
- accuracy_std_dev
- 0.007302967435227963
- cost_per_task_usd
- 0.007451167999999999
- output_tokens_per_task
- 12454.056
- latency_seconds_per_task
- 324.20324
- published_at
- 2026-11-16T01:46:02.653Z
- snapshot_date
- 2026-11-16
- source_revision
- 7ccaf17664252a3053dcb7df8ad0a46e72954a3b4524ddc1c8a7ef8a41b15568
- transformations
- TensorTrace preserves source results, converts latency to seconds and derives ranks within matching conditions. Individual runs have no derived rank.
- metric_population
- 63
- benchmark_evaluation
- true
- openrouter_permaslug
- deepseek/deepseek-v4-flash-20260423
- source model id
- deepseek/deepseek-v4-flash-20260423
Original result ↗Published prices
1–20 / 39
$0.02
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
$0.09
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
$0.18
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
$0.03
- Inference provider
- siliconFlow
- Platform
- SiliconFlow
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing label
- Cached input tokens (per 1M)
$0.13
- Inference provider
- siliconFlow
- Platform
- SiliconFlow
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing label
- Input tokens (per 1M)
$0.28
- Inference provider
- siliconFlow
- Platform
- SiliconFlow
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing label
- Output tokens (per 1M)
$0.02
- Inference provider
- vercelAIGatewayCatalog
- Platform
- alibaba
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- alibaba | deepseek/deepseek-v4-flash
- model_type
- language
- peak_pricing
- windows
- end_minute_utc
- 840
- start_minute_utc
- 0
- multiplier
- 2
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.22
- Inference provider
- vercelAIGatewayCatalog
- Platform
- alibaba
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- alibaba | deepseek/deepseek-v4-flash
- model_type
- language
- peak_pricing
- windows
- end_minute_utc
- 840
- start_minute_utc
- 0
- multiplier
- 2
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.66
- Inference provider
- vercelAIGatewayCatalog
- Platform
- alibaba
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- alibaba | deepseek/deepseek-v4-flash
- model_type
- language
- peak_pricing
- windows
- end_minute_utc
- 840
- start_minute_utc
- 0
- multiplier
- 2
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.03
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | deepseek/deepseek-v4-flash
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.19
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | deepseek/deepseek-v4-flash
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.51
- Inference provider
- vercelAIGatewayCatalog
- Platform
- azure
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- azure | deepseek/deepseek-v4-flash
- model_type
- language
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.03
- Inference provider
- vercelAIGatewayCatalog
- Platform
- baseten
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- baseten | deepseek/deepseek-v4-flash
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.03
- Inference provider
- vercelAIGatewayCatalog
- Platform
- baseten
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- zone
- geo_region
- us
- endpoint
- baseten | deepseek/deepseek-v4-flash
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.13
- Inference provider
- vercelAIGatewayCatalog
- Platform
- baseten
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- baseten | deepseek/deepseek-v4-flash
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.13
- Inference provider
- vercelAIGatewayCatalog
- Platform
- baseten
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- zone
- geo_region
- us
- endpoint
- baseten | deepseek/deepseek-v4-flash
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.26
- Inference provider
- vercelAIGatewayCatalog
- Platform
- baseten
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- baseten | deepseek/deepseek-v4-flash
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.26
- Inference provider
- vercelAIGatewayCatalog
- Platform
- baseten
- Unit
- output_tokens_per_million
- Currency
- USD
- Billing conditions
- region
- scope
- zone
- geo_region
- us
- endpoint
- baseten | deepseek/deepseek-v4-flash
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- Billing label
- Output tokens / 1M
- Pricing via
- Vercel AI Gateway
$0.02
- Inference provider
- vercelAIGatewayCatalog
- Platform
- deepinfra
- Unit
- cache_read_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- deepinfra | deepseek/deepseek-v4-flash
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- Billing label
- Cached input / 1M
- Pricing via
- Vercel AI Gateway
$0.06
- Inference provider
- vercelAIGatewayCatalog
- Platform
- deepinfra
- Unit
- input_tokens_per_million
- Currency
- USD
- Billing conditions
- endpoint
- deepinfra | deepseek/deepseek-v4-flash
- model_type
- language
- quantization
- fp8
- billing_scope
- via Vercel AI Gateway
- Billing label
- Input tokens / 1M
- Pricing via
- Vercel AI Gateway
Provider specifications & access
1–4 / 4
- source model id
- deepseek-ai/DeepSeek-V4-Flash
- hosting
- siliconflow-hosted
- max output tokens
- 393216
- capabilities
- promptCaching
- reasoning
- structuredOutputs
- toolCalling
- source model id
- deepseek/deepseek-v4-flash
- hosting
- vercel-gateway
- context length
- 1000000
- max output tokens
- 384000
- capabilities
- promptCaching
- reasoning
- structuredOutputs
- toolCalling
- source model id
- HuggingFace/deepseek-ai-deepseek-v4-flash@1
- hosting
- foundry-managed-compute
- license
- mit
- source model id
- publishers/deepseek-ai/models/deepseek-v4@deepseek-v4-flash
- hosting
- vertex-self-deployed
Safety assessments
1–1 / 1
32 / 100
- source id
- stanfordFMTI
- canonical model id
- deepseek/deepseek-v4-flash-20260423
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- DeepSeek
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 32 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–7 / 7
- field
- context_length
- value
- 1048576
- normalized value
- 1048576
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- context_length
- value
- 1049K
- scope
- source-model
- source id
- siliconFlow
- confidence
- 1
- field
- context_length
- value
- 1000000
- normalized value
- 1000000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2025-05
- normalized value
- 2025-05
- precision
- month
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
- field
- max_output_tokens
- value
- 393216
- normalized value
- 393216
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_output_tokens
- value
- 393K
- scope
- source-model
- source id
- siliconFlow
- confidence
- 1
- field
- max_output_tokens
- value
- 384000
- normalized value
- 384000
- scope
- source-model
- source id
- vercelAIGatewayCatalog
- confidence
- 1
Hugging Face model card
1–1 / 1
- downloads
- 1179500
- likes
- 2389
- pipeline tag
- text-generation
- library name
- transformers
- License
- mit
Explore more models