google/flan-t5-base
Explore google/flan-t5-base: model specifications, capabilities, benchmark results, platform pricing and original sources.
huggingface/google/flan-t5-base
Specifications & capabilities
- Published model ID
- flan-t5-base
Evaluations
1–15 / 15
0.639%
- source id
- mteb
- leaderboard name
- MTEB Retrieval
- dimension
- embedding
- metric
- Average task score
- rank
- 885
- sample size
- 3
- aggregation scope
- task_count
- 3
- task_names
- Core17InstructionRetrieval
- News21InstructionRetrieval
- Robust04InstructionRetrieval
- sample_size
- 3
- subset_count
- 1
- aggregation_method
- mean-of-task-means
- model_revision_count
- 1
- source model id
- google/flan-t5-base
Original result ↗0.639%
- source id
- mteb
- leaderboard name
- MTEB Overall
- dimension
- embedding
- metric
- Average task score
- rank
- 978
- sample size
- 3
- aggregation scope
- task_count
- 3
- task_names
- Core17InstructionRetrieval
- News21InstructionRetrieval
- Robust04InstructionRetrieval
- sample_size
- 3
- subset_count
- 1
- aggregation_method
- mean-of-task-means
- model_revision_count
- 1
- source model id
- google/flan-t5-base
Original result ↗36.711%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MUSR · Raw
- dimension
- reasoning
- metric
- Raw accuracy
- rank
- 3561
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗11.338%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 BBH · Normalized
- dimension
- reasoning
- metric
- Normalized score
- rank
- 3622
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗35.26%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 BBH · Raw
- dimension
- reasoning
- metric
- Raw accuracy
- rank
- 3676
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗3.223%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MUSR · Normalized
- dimension
- reasoning
- metric
- Normalized score
- rank
- 3864
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗13.572%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MMLU-PRO · Raw
- dimension
- knowledge
- metric
- Raw accuracy
- rank
- 4046
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗3.969%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MMLU-PRO · Normalized
- dimension
- knowledge
- metric
- Normalized score
- rank
- 4046
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗18.907%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 IFEval · Raw
- dimension
- instructionFollowing
- metric
- Raw accuracy
- rank
- 4086
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗18.907%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 IFEval · Normalized
- dimension
- instructionFollowing
- metric
- Normalized score
- rank
- 4086
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗6.416%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 Average
- dimension
- general
- metric
- Normalized six-task average
- rank
- 4122
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Normalized six-task average
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗1.057%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MATH Lvl 5 · Raw
- dimension
- math
- metric
- Raw accuracy
- rank
- 4192
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗1.057%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 MATH Lvl 5 · Normalized
- dimension
- math
- metric
- Normalized score
- rank
- 4192
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗0%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 GPQA · Normalized
- dimension
- knowledge
- metric
- Normalized score
- rank
- 4336
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Normalized score
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗23.826%
- source id
- openLLMLeaderboardV2
- leaderboard name
- Open LLM v2 GPQA · Raw
- dimension
- knowledge
- metric
- Raw accuracy
- rank
- 4521
- aggregation scope
- suite
- Open LLM v2
- co2_kg
- 0.3132428808489122
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Raw accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2025-03-20T12:17:27Z
- chat_template
- false
- suite_version
- 2
- model_revision
- 7bcac572ce56db69c1ea7c8af255c5d7c9672fc2
- source_flagged
- false
- dataset_revision
- 9c09a7cae43334062a82cb164f2ef255013dafa2
- metric_population
- 4576
- ranking_population
- 4576
- source_flag_anomaly
- false
- source model id
- google/flan-t5-base
Original result ↗Provider specifications & access
1–7 / 7
- source model id
- HuggingFace/google-flan-t5-base@11
- hosting
- foundry-managed-compute
- license
- apache-2.0
- source model id
- HuggingFace/google-flan-t5-base@12
- hosting
- foundry-managed-compute
- license
- apache-2.0
- source model id
- HuggingFace/google-flan-t5-base@13
- hosting
- foundry-managed-compute
- license
- apache-2.0
- source model id
- HuggingFace/google-flan-t5-base@14
- hosting
- foundry-managed-compute
- license
- apache-2.0
- source model id
- HuggingFace/google-flan-t5-base@15
- hosting
- foundry-managed-compute
- license
- apache-2.0
- source model id
- HuggingFace/google-flan-t5-base@16
- hosting
- foundry-managed-compute
- license
- apache-2.0
- source model id
- HuggingFace/google-flan-t5-base@17
- hosting
- foundry-managed-compute
- license
- apache-2.0
Safety assessments
1–1 / 1
41 / 100
- source id
- stanfordFMTI
- canonical model id
- huggingface/google/flan-t5-base
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Google
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 41 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Hugging Face model card
1–1 / 1
- downloads
- 822038
- likes
- 1110
- library name
- transformers
- License
- apache-2.0
Explore more models