devingulliver/llama-pile-350b
Explore devingulliver/llama-pile-350b: model specifications, capabilities, benchmark results, platform pricing and original sources.
huggingface/devingulliver/llama-pile-350b
Specifications & capabilities
- Input
- text
- Output
- text
- Published model ID
- llama-pile-350b
Evaluations
1–14 / 14
36.28%
- source id
- subquadraticLLM
- leaderboard name
- TruthfulQA
- dimension
- general
- metric
- TruthfulQA
- rank
- 23
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Subquadratic LLM
- generation
- Open LLM v1-derived
- metric_kind
- TruthfulQA
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- devingulliver/subquadratic-llm-leaderboard/data.csv
- published_at
- 2024-08-07T16:00:34Z
- source_revision
- 9ed8f639710d211d9c38d571e88d816dadfc9532cf85a3f7b170041ea405c5ba
- metric_population
- 39
- benchmark_evaluation
- true
- source model id
- devingulliver/llama-pile-350b
Original result ↗0.76%
- source id
- subquadraticLLM
- leaderboard name
- GSM8K
- dimension
- general
- metric
- GSM8K
- rank
- 28
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Subquadratic LLM
- generation
- Open LLM v1-derived
- metric_kind
- GSM8K
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- devingulliver/subquadratic-llm-leaderboard/data.csv
- published_at
- 2024-08-07T16:00:34Z
- source_revision
- 9ed8f639710d211d9c38d571e88d816dadfc9532cf85a3f7b170041ea405c5ba
- metric_population
- 39
- benchmark_evaluation
- true
- source model id
- devingulliver/llama-pile-350b
Original result ↗58.48%
- source id
- subquadraticLLM
- leaderboard name
- Winogrande
- dimension
- general
- metric
- Winogrande
- rank
- 35
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Subquadratic LLM
- generation
- Open LLM v1-derived
- metric_kind
- Winogrande
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- devingulliver/subquadratic-llm-leaderboard/data.csv
- published_at
- 2024-08-07T16:00:34Z
- source_revision
- 9ed8f639710d211d9c38d571e88d816dadfc9532cf85a3f7b170041ea405c5ba
- metric_population
- 39
- benchmark_evaluation
- true
- source model id
- devingulliver/llama-pile-350b
Original result ↗56.6%
- source id
- subquadraticLLM
- leaderboard name
- HellaSwag
- dimension
- general
- metric
- HellaSwag
- rank
- 35
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Subquadratic LLM
- generation
- Open LLM v1-derived
- metric_kind
- HellaSwag
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- devingulliver/subquadratic-llm-leaderboard/data.csv
- published_at
- 2024-08-07T16:00:34Z
- source_revision
- 9ed8f639710d211d9c38d571e88d816dadfc9532cf85a3f7b170041ea405c5ba
- metric_population
- 39
- benchmark_evaluation
- true
- source model id
- devingulliver/llama-pile-350b
Original result ↗33.19%
- source id
- subquadraticLLM
- leaderboard name
- ARC
- dimension
- general
- metric
- ARC
- rank
- 35
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Subquadratic LLM
- generation
- Open LLM v1-derived
- metric_kind
- ARC
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- devingulliver/subquadratic-llm-leaderboard/data.csv
- published_at
- 2024-08-07T16:00:34Z
- source_revision
- 9ed8f639710d211d9c38d571e88d816dadfc9532cf85a3f7b170041ea405c5ba
- metric_population
- 39
- benchmark_evaluation
- true
- source model id
- devingulliver/llama-pile-350b
Original result ↗24.66%
- source id
- subquadraticLLM
- leaderboard name
- MMLU
- dimension
- general
- metric
- MMLU
- rank
- 35
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Subquadratic LLM
- generation
- Open LLM v1-derived
- metric_kind
- MMLU
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- devingulliver/subquadratic-llm-leaderboard/data.csv
- published_at
- 2024-08-07T16:00:34Z
- source_revision
- 9ed8f639710d211d9c38d571e88d816dadfc9532cf85a3f7b170041ea405c5ba
- metric_population
- 39
- benchmark_evaluation
- true
- source model id
- devingulliver/llama-pile-350b
Original result ↗35%
- source id
- subquadraticLLM
- leaderboard name
- Average
- dimension
- general
- metric
- Average
- rank
- 37
- aggregation scope
- status
- published
- direction
- higherIsBetter
- conditions
- suite
- Subquadratic LLM
- generation
- Open LLM v1-derived
- metric_kind
- Average
- rank_method
- competition rank among reported evaluations in identical conditions, including unlinked observations
- source_file
- devingulliver/subquadratic-llm-leaderboard/data.csv
- published_at
- 2024-08-07T16:00:34Z
- source_revision
- 9ed8f639710d211d9c38d571e88d816dadfc9532cf85a3f7b170041ea405c5ba
- metric_population
- 39
- benchmark_evaluation
- true
- source model id
- devingulliver/llama-pile-350b
Original result ↗0.758%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 GSM8K
- dimension
- math
- metric
- Accuracy
- rank
- 6227
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 9e5e050d5157e73ffc38afd878159d3440ea56f1
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-04-22T18:57:02.000Z
- source model id
- devingulliver/llama-pile-350b
Original result ↗56.602%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 HellaSwag
- dimension
- reasoning
- metric
- Accuracy
- rank
- 6337
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 9e5e050d5157e73ffc38afd878159d3440ea56f1
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-04-22T18:57:02.000Z
- source model id
- devingulliver/llama-pile-350b
Original result ↗58.485%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 Winogrande
- dimension
- reasoning
- metric
- Accuracy
- rank
- 6414
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 9e5e050d5157e73ffc38afd878159d3440ea56f1
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-04-22T18:57:02.000Z
- source model id
- devingulliver/llama-pile-350b
Original result ↗33.191%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 ARC
- dimension
- reasoning
- metric
- Accuracy
- rank
- 6428
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 9e5e050d5157e73ffc38afd878159d3440ea56f1
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-04-22T18:57:02.000Z
- source model id
- devingulliver/llama-pile-350b
Original result ↗34.995%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 Average
- dimension
- general
- metric
- Six-task average
- rank
- 6510
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Six-task average
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 9e5e050d5157e73ffc38afd878159d3440ea56f1
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7170
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-04-22T18:57:02.000Z
- source model id
- devingulliver/llama-pile-350b
Original result ↗36.28%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 TruthfulQA
- dimension
- knowledge
- metric
- Accuracy
- rank
- 6921
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 9e5e050d5157e73ffc38afd878159d3440ea56f1
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7170
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-04-22T18:57:02.000Z
- source model id
- devingulliver/llama-pile-350b
Original result ↗24.656%
- source id
- openLLMLeaderboardV1
- leaderboard name
- Open LLM v1 MMLU
- dimension
- knowledge
- metric
- Accuracy
- rank
- 6923
- aggregation scope
- suite
- Open LLM v1
- status
- archived
- precision
- float16
- task_count
- 6
- metric_kind
- Accuracy
- rank_method
- Derived competition rank over published evaluations with reported scores, including variants and source flags
- weight_type
- Original
- published_at
- 2024-06-25T14:11:42Z
- chat_template
- false
- suite_version
- 1
- model_revision
- 9e5e050d5157e73ffc38afd878159d3440ea56f1
- source_flagged
- true
- dataset_revision
- 791ca1c841030008c6c266562c2b88c9b7196550
- metric_population
- 7260
- ranking_population
- 7260
- source_flag_anomaly
- true
- evaluated at
- 2024-04-22T18:57:02.000Z
- source model id
- devingulliver/llama-pile-350b
Original result ↗Safety assessments
1–1 / 1
31 / 100
- source id
- stanfordFMTI
- canonical model id
- huggingface/devingulliver/llama-pile-350b
- taxonomy
- transparency
- hazard category
- transparency
- hazard name
- Organization transparency
- policy area
- Meta
- assessment type
- organization-level disclosure
- metric
- disclosure_score
- result label
- 31 / 100
- sample size
- 100
- updated at
- 2026-11-09T18:08:05.227Z
Explore more models