OpenAI: GPT-4o-mini (2024-07-18)
GPT-4o mini is OpenAI's newest model after [GPT-4 Omni](/models/openai/gpt-4o), supporting both text and image inputs with text outputs. As their most advanced small model, it is many multiples more …
openai/gpt-4o-mini-2024-07-18
GPT-4o mini is OpenAI's newest model after [GPT-4 Omni](/models/openai/gpt-4o), supporting both text and image inputs with text outputs. As their most advanced small model, it is many multiples more affordable...
Specifications & capabilities
- Input
- text, image, file
- Output
- text
- Context window · tokens
- 128000
- Capabilities
- audioInput, fileInput, multimodal, promptCaching, structuredOutputs, toolCalling, visionInput
Evaluations
21–40 / 186
0.632%
- source id
- kaggleBenchmarks
- leaderboard name
- BrowseComp · Score
- dimension
- knowledge
- metric
- BrowseComp · Score
- rank
- 25
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 26
- name
- Score
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 49
- name
- BrowseComp
- type
- INDIVIDUAL
- owner
- openai
- version
- 1
- categories
- general knowledge and reasoning
- factuality and grounding
- version_id
- 35
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · openai · BrowseComp
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- BrowseComp · Score
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 35/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/openai/browsecomp/versions/1
- measurements
- name
- Score
- unit
- percent
- scale
- 1
- metric
- BrowseComp · Score
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.0063191153238546
- standardDeviation
- 0
- confidenceInterval
- 0.0043649859139208
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0043649859139208
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-13T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.0063191153238546
- standardDeviation
- 0
- confidenceInterval
- 0.0043649859139208
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0043649859139208
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 26
- sort_order
- DESCENDING
- source_name
- Score
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T14:25:30.827974100Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 42
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-13T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.0019541294099338
- confidence upper
- 0.010684101237775401
Original result ↗20%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Swedish · EM Swedish
- dimension
- reasoning
- metric
- MultiLoKo Swedish · EM Swedish
- rank
- 26
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 53
- name
- EM Swedish
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 76
- name
- MultiLoKo Swedish
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 62
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Swedish
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Swedish · EM Swedish
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 62/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-swedish/versions/1
- measurements
- name
- EM Swedish
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Swedish · EM Swedish
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.2
- standardDeviation
- 0
- confidenceInterval
- 0.0495836025843649
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0495836025843649
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.2
- standardDeviation
- 0
- confidenceInterval
- 0.0495836025843649
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0495836025843649
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 53
- sort_order
- DESCENDING
- source_name
- EM Swedish
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.15041639741563512
- confidence upper
- 0.2495836025843649
Original result ↗30%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Portuguese · EM Portuguese
- dimension
- reasoning
- metric
- MultiLoKo Portuguese · EM Portuguese
- rank
- 27
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 48
- name
- EM Portuguese
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 71
- name
- MultiLoKo Portuguese
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 57
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Portuguese
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Portuguese · EM Portuguese
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 57/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-portuguese/versions/1
- measurements
- name
- EM Portuguese
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Portuguese · EM Portuguese
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.3
- standardDeviation
- 0
- confidenceInterval
- 0.056805153017865
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.056805153017865
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.3
- standardDeviation
- 0
- confidenceInterval
- 0.056805153017865
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.056805153017865
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 48
- sort_order
- DESCENDING
- source_name
- EM Portuguese
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.243194846982135
- confidence upper
- 0.356805153017865
Original result ↗26.4%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo French · EM French
- dimension
- reasoning
- metric
- MultiLoKo French · EM French
- rank
- 30
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 36
- name
- EM French
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 59
- name
- MultiLoKo French
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 45
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo French
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo French · EM French
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 45/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-french/versions/1
- measurements
- name
- EM French
- unit
- percent
- scale
- 1
- metric
- MultiLoKo French · EM French
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.264
- standardDeviation
- 0
- confidenceInterval
- 0.0546410400595066
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0546410400595066
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.264
- standardDeviation
- 0
- confidenceInterval
- 0.0546410400595066
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0546410400595066
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 36
- sort_order
- DESCENDING
- source_name
- EM French
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.20935895994049342
- confidence upper
- 0.3186410400595066
Original result ↗16.8%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Czech · EM Czech
- dimension
- reasoning
- metric
- MultiLoKo Czech · EM Czech
- rank
- 31
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 33
- name
- EM Czech
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 56
- name
- MultiLoKo Czech
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 42
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Czech
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Czech · EM Czech
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 42/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-czech/versions/1
- measurements
- name
- EM Czech
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Czech · EM Czech
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.168
- standardDeviation
- 0
- confidenceInterval
- 0.0463440933937148
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0463440933937148
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.168
- standardDeviation
- 0
- confidenceInterval
- 0.0463440933937148
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0463440933937148
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 33
- sort_order
- DESCENDING
- source_name
- EM Czech
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.12165590660628521
- confidence upper
- 0.2143440933937148
Original result ↗12.8%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Arabic · EM Arabic
- dimension
- reasoning
- metric
- MultiLoKo Arabic · EM Arabic
- rank
- 31
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 30
- name
- EM Arabic
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 53
- name
- MultiLoKo Arabic
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 39
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Arabic
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Arabic · EM Arabic
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 39/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-arabic/versions/1
- measurements
- name
- EM Arabic
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Arabic · EM Arabic
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.128
- standardDeviation
- 0
- confidenceInterval
- 0.0414134407037423
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0414134407037423
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.128
- standardDeviation
- 0
- confidenceInterval
- 0.0414134407037423
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0414134407037423
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 30
- sort_order
- DESCENDING
- source_name
- EM Arabic
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.08658655929625769
- confidence upper
- 0.1694134407037423
Original result ↗12%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Japanese · EM Japanese
- dimension
- reasoning
- metric
- MultiLoKo Japanese · EM Japanese
- rank
- 31
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 42
- name
- EM Japanese
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 65
- name
- MultiLoKo Japanese
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 51
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Japanese
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Japanese · EM Japanese
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 51/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-japanese/versions/1
- measurements
- name
- EM Japanese
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Japanese · EM Japanese
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.12
- standardDeviation
- 0
- confidenceInterval
- 0.0402819091635587
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0402819091635587
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.12
- standardDeviation
- 0
- confidenceInterval
- 0.0402819091635587
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0402819091635587
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 42
- sort_order
- DESCENDING
- source_name
- EM Japanese
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.0797180908364413
- confidence upper
- 0.1602819091635587
Original result ↗21.2%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Russian · EM Russian
- dimension
- reasoning
- metric
- MultiLoKo Russian · EM Russian
- rank
- 33
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 50
- name
- EM Russian
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 73
- name
- MultiLoKo Russian
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 59
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Russian
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Russian · EM Russian
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 59/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-russian/versions/1
- measurements
- name
- EM Russian
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Russian · EM Russian
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.212
- standardDeviation
- 0
- confidenceInterval
- 0.0506651258658212
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0506651258658212
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.212
- standardDeviation
- 0
- confidenceInterval
- 0.0506651258658212
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0506651258658212
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 50
- sort_order
- DESCENDING
- source_name
- EM Russian
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.1613348741341788
- confidence upper
- 0.2626651258658212
Original result ↗15.2%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Bengali · EM Bengali
- dimension
- reasoning
- metric
- MultiLoKo Bengali · EM Bengali
- rank
- 33
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 31
- name
- EM Bengali
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 54
- name
- MultiLoKo Bengali
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 40
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Bengali
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Bengali · EM Bengali
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 40/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-bengali/versions/1
- measurements
- name
- EM Bengali
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Bengali · EM Bengali
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.152
- standardDeviation
- 0
- confidenceInterval
- 0.0445038729169581
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0445038729169581
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.152
- standardDeviation
- 0
- confidenceInterval
- 0.0445038729169581
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0445038729169581
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 31
- sort_order
- DESCENDING
- source_name
- EM Bengali
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.1074961270830419
- confidence upper
- 0.1965038729169581
Original result ↗14.8%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Marathi · EM Marathi
- dimension
- reasoning
- metric
- MultiLoKo Marathi · EM Marathi
- rank
- 33
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 46
- name
- EM Marathi
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 69
- name
- MultiLoKo Marathi
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 55
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Marathi
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Marathi · EM Marathi
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 55/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-marathi/versions/1
- measurements
- name
- EM Marathi
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Marathi · EM Marathi
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.148
- standardDeviation
- 0
- confidenceInterval
- 0.0440178414488601
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0440178414488601
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.148
- standardDeviation
- 0
- confidenceInterval
- 0.0440178414488601
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0440178414488601
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 46
- sort_order
- DESCENDING
- source_name
- EM Marathi
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.1039821585511399
- confidence upper
- 0.19201784144886008
Original result ↗10.8%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Hebrew · EM Hebrew
- dimension
- reasoning
- metric
- MultiLoKo Hebrew · EM Hebrew
- rank
- 33
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 38
- name
- EM Hebrew
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 61
- name
- MultiLoKo Hebrew
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 47
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Hebrew
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Hebrew · EM Hebrew
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 47/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-hebrew/versions/1
- measurements
- name
- EM Hebrew
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Hebrew · EM Hebrew
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.108
- standardDeviation
- 0
- confidenceInterval
- 0.0384744474658383
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0384744474658383
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.108
- standardDeviation
- 0
- confidenceInterval
- 0.0384744474658383
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0384744474658383
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 38
- sort_order
- DESCENDING
- source_name
- EM Hebrew
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.0695255525341617
- confidence upper
- 0.1464744474658383
Original result ↗18.8%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Romanian · EM Romanian
- dimension
- reasoning
- metric
- MultiLoKo Romanian · EM Romanian
- rank
- 34
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 49
- name
- EM Romanian
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 72
- name
- MultiLoKo Romanian
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 58
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Romanian
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Romanian · EM Romanian
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 58/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-romanian/versions/1
- measurements
- name
- EM Romanian
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Romanian · EM Romanian
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.188
- standardDeviation
- 0
- confidenceInterval
- 0.048432292439317
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.048432292439317
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.188
- standardDeviation
- 0
- confidenceInterval
- 0.048432292439317
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.048432292439317
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 49
- sort_order
- DESCENDING
- source_name
- EM Romanian
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.13956770756068299
- confidence upper
- 0.23643229243931702
Original result ↗15.6%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Turkish · EM Turkish
- dimension
- reasoning
- metric
- MultiLoKo Turkish · EM Turkish
- rank
- 34
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 57
- name
- EM Turkish
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 80
- name
- MultiLoKo Turkish
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 66
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Turkish
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Turkish · EM Turkish
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 66/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-turkish/versions/1
- measurements
- name
- EM Turkish
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Turkish · EM Turkish
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.156
- standardDeviation
- 0
- confidenceInterval
- 0.0449791878169391
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0449791878169391
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.156
- standardDeviation
- 0
- confidenceInterval
- 0.0449791878169391
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0449791878169391
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 57
- sort_order
- DESCENDING
- source_name
- EM Turkish
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.1110208121830609
- confidence upper
- 0.2009791878169391
Original result ↗15.2%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Indonesian · EM Indonesian
- dimension
- reasoning
- metric
- MultiLoKo Indonesian · EM Indonesian
- rank
- 34
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 40
- name
- EM Indonesian
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 63
- name
- MultiLoKo Indonesian
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 49
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Indonesian
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Indonesian · EM Indonesian
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 49/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-indonesian/versions/1
- measurements
- name
- EM Indonesian
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Indonesian · EM Indonesian
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.152
- standardDeviation
- 0
- confidenceInterval
- 0.0445038729169581
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0445038729169581
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.152
- standardDeviation
- 0
- confidenceInterval
- 0.0445038729169581
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0445038729169581
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 40
- sort_order
- DESCENDING
- source_name
- EM Indonesian
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.1074961270830419
- confidence upper
- 0.1965038729169581
Original result ↗25.6%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Spanish · EM Spanish
- dimension
- reasoning
- metric
- MultiLoKo Spanish · EM Spanish
- rank
- 35
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 52
- name
- EM Spanish
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 75
- name
- MultiLoKo Spanish
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 61
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Spanish
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Spanish · EM Spanish
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 61/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-spanish/versions/1
- measurements
- name
- EM Spanish
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Spanish · EM Spanish
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.256
- standardDeviation
- 0
- confidenceInterval
- 0.0540984144989365
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0540984144989365
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.256
- standardDeviation
- 0
- confidenceInterval
- 0.0540984144989365
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0540984144989365
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 52
- sort_order
- DESCENDING
- source_name
- EM Spanish
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.20190158550106352
- confidence upper
- 0.3100984144989365
Original result ↗19.2%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Dutch · EM Dutch
- dimension
- reasoning
- metric
- MultiLoKo Dutch · EM Dutch
- rank
- 35
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 34
- name
- EM Dutch
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 57
- name
- MultiLoKo Dutch
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 43
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Dutch
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Dutch · EM Dutch
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 43/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-dutch/versions/1
- measurements
- name
- EM Dutch
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Dutch · EM Dutch
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.192
- standardDeviation
- 0
- confidenceInterval
- 0.048824115173025
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.048824115173025
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.192
- standardDeviation
- 0
- confidenceInterval
- 0.048824115173025
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.048824115173025
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 34
- sort_order
- DESCENDING
- source_name
- EM Dutch
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.14317588482697502
- confidence upper
- 0.240824115173025
Original result ↗16%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Simplified Mandarin · EM Simplified Mandarin
- dimension
- reasoning
- metric
- MultiLoKo Simplified Mandarin · EM Simplified Mandarin
- rank
- 35
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 51
- name
- EM Simplified Mandarin
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 74
- name
- MultiLoKo Simplified Mandarin
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 60
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Simplified Mandarin
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Simplified Mandarin · EM Simplified Mandarin
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 60/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-simplified-mandarin/versions/1
- measurements
- name
- EM Simplified Mandarin
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Simplified Mandarin · EM Simplified Mandarin
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.16
- standardDeviation
- 0
- confidenceInterval
- 0.045444122414292
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.045444122414292
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.16
- standardDeviation
- 0
- confidenceInterval
- 0.045444122414292
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.045444122414292
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 51
- sort_order
- DESCENDING
- source_name
- EM Simplified Mandarin
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.11455587758570801
- confidence upper
- 0.205444122414292
Original result ↗12.8%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Thai · EM Thai
- dimension
- reasoning
- metric
- MultiLoKo Thai · EM Thai
- rank
- 35
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 55
- name
- EM Thai
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 78
- name
- MultiLoKo Thai
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 64
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Thai
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Thai · EM Thai
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 64/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-thai/versions/1
- measurements
- name
- EM Thai
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Thai · EM Thai
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.128
- standardDeviation
- 0
- confidenceInterval
- 0.0414134407037423
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0414134407037423
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.128
- standardDeviation
- 0
- confidenceInterval
- 0.0414134407037423
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0414134407037423
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 55
- sort_order
- DESCENDING
- source_name
- EM Thai
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.08658655929625769
- confidence upper
- 0.1694134407037423
Original result ↗12%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo Polish · EM Polish
- dimension
- reasoning
- metric
- MultiLoKo Polish · EM Polish
- rank
- 35
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 47
- name
- EM Polish
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 70
- name
- MultiLoKo Polish
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 56
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo Polish
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo Polish · EM Polish
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 56/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-polish/versions/1
- measurements
- name
- EM Polish
- unit
- percent
- scale
- 1
- metric
- MultiLoKo Polish · EM Polish
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.12
- standardDeviation
- 0
- confidenceInterval
- 0.0402819091635587
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0402819091635587
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.12
- standardDeviation
- 0
- confidenceInterval
- 0.0402819091635587
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0402819091635587
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 47
- sort_order
- DESCENDING
- source_name
- EM Polish
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.0797180908364413
- confidence upper
- 0.1602819091635587
Original result ↗34.8%
- source id
- kaggleBenchmarks
- leaderboard name
- MultiLoKo English · EM English
- dimension
- reasoning
- metric
- MultiLoKo English · EM English
- rank
- 36
- aggregation scope
- kaggle
- true
- status
- published
- license
- Apache-2.0
- direction
- higherIsBetter
- conditions
- task
- id
- 27
- name
- EM English
- version
- 1
- sort_order
- DESCENDING
- display_type
- percentages
- benchmark
- id
- 52
- name
- MultiLoKo English
- type
- INDIVIDUAL
- owner
- metaresearch
- version
- 1
- categories
- multilingual and cross-lingual capabilities
- general knowledge and reasoning
- version_id
- 38
- maintainer_tier
- Kaggle-maintained
- maintenance_level
- KAGGLE_MAINTAINED
- candidate
- candidate_class
- modelVersion
- record_kind
- aggregate
- attribution
- Kaggle · metaresearch · MultiLoKo English
- license_url
- https://www.apache.org/licenses/LICENSE-2.0
- metric_kind
- MultiLoKo English · EM English
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- 38/leaderboard.json
- source_page
- https://www.kaggle.com/benchmarks/metaresearch/multiloko-english/versions/1
- measurements
- name
- EM English
- unit
- percent
- scale
- 1
- metric
- MultiLoKo English · EM English
- result
- resultCase
- numericResult
- booleanResult
- false
- numericResult
- value
- 0.348
- standardDeviation
- 0
- confidenceInterval
- 0.0590461392668551
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0590461392668551
- hasUnevenConfidenceInterval
- false
- taskVersionId
- 0
- evaluationDate
- 2025-06-16T00:00:00Z
- hasBooleanResult
- false
- hasNumericResult
- true
- hasTaskVersionId
- false
- hasEvaluationDate
- true
- numericResultNullable
- value
- 0.348
- standardDeviation
- 0
- confidenceInterval
- 0.0590461392668551
- hasStandardDeviation
- false
- hasConfidenceInterval
- true
- confidenceIntervalNullable
- 0.0590461392668551
- hasUnevenConfidenceInterval
- false
- hasNumericResultPublic
- false
- hasNumericResultPrivate
- false
- task_id
- 27
- sort_order
- DESCENDING
- source_name
- EM English
- display_type
- percentages
- task_version
- 1
- task_display_type
- PERCENTAGES
- normalization_status
- normalized
- published_at
- 2025-07-15T11:49:31.790Z
- candidate_class
- modelVersion
- source_revision
- b32d007df5acbddafca23c7dd2beba8221c519cf7dd3445a1d7bc28740ffd0d8
- publisher_anchor
- openai/gpt-4o-mini-2024-07-18
- metric_population
- 51
- benchmark_evaluation
- true
- task_metadata_source
- benchmarkVersion
- candidate_metadata_source
- benchmarkVersionMappings
- evaluated at
- 2025-06-16T00:00:00.000Z
- source model id
- GPT-4o mini
- confidence lower
- 0.2889538607331449
- confidence upper
- 0.40704613926685507
Original result ↗Published prices
1–3 / 3
$0.08
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- cache_read_tokens_per_million
- Currency
- USD
$0.15
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- input_tokens_per_million
- Currency
- USD
$0.60
- Inference provider
- openRouter
- Platform
- OpenRouter
- Unit
- output_tokens_per_million
- Currency
- USD
Provider specifications & access
1–1 / 1
- source model id
- azure-openai/gpt-4o-mini@2024-07-18
- hosting
- foundry-managed-compute
- license
- custom
- context length
- 128000
- max input tokens
- 128000
- max output tokens
- 16384
Safety assessments
1–1 / 1
35 / 100
- source id
- stanfordFMTI
- canonical model id
- openai/gpt-4o-mini-2024-07-18
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- OpenAI
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 35 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Source specification observations
1–7 / 7
- field
- context_length
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- context_length
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- knowledge_cutoff
- value
- 2023-10-31
- normalized value
- 2023-10-31
- precision
- day
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- max_input_tokens
- value
- 128000
- normalized value
- 128000
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 16384
- normalized value
- 16384
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
- field
- max_output_tokens
- value
- 16384
- normalized value
- 16384
- scope
- source-model
- source id
- openRouter
- confidence
- 1
- field
- knowledge_cutoff
- reported field
- training_data_cutoff
- value
- September 2023
- normalized value
- 2023-09
- precision
- month
- scope
- source-model
- source id
- azureFoundry
- confidence
- 1
Explore more models