nickmalhotra/Indus_1.175B

Explore nickmalhotra/Indus_1.175B: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/nickmalhotra/Indus_1.175B

Specifications & capabilities

Input
text
Output
text
Published model ID
Indus_1.175B

Evaluations

1–10 / 10

Open LLM Leaderboard v1

0%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 GSM8K
dimension
math
metric
Accuracy
rank
6594
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
ba68b88d6926e7143735aa079097398d37bd01fd
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-29T11:08:24.000Z
source model id
nickmalhotra/Indus_1.175B
Original result ↗

Open LLM Leaderboard v1

0%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 GSM8K
dimension
math
metric
Accuracy
rank
6594
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
61331dce5bf32e0d8cf8f9164a31c052bcaa6c69
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-29T17:37:32.000Z
source model id
nickmalhotra/indus_1.175B
Original result ↗

Open LLM Leaderboard v1

49.566%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 Winogrande
dimension
reasoning
metric
Accuracy
rank
7111
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
61331dce5bf32e0d8cf8f9164a31c052bcaa6c69
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-29T17:37:32.000Z
source model id
nickmalhotra/indus_1.175B
Original result ↗

Open LLM Leaderboard v1

49.566%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 Winogrande
dimension
reasoning
metric
Accuracy
rank
7111
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
ba68b88d6926e7143735aa079097398d37bd01fd
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-29T11:08:24.000Z
source model id
nickmalhotra/Indus_1.175B
Original result ↗

Open LLM Leaderboard v1

22.696%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 ARC
dimension
reasoning
metric
Accuracy
rank
7131
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
ba68b88d6926e7143735aa079097398d37bd01fd
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-29T11:08:24.000Z
source model id
nickmalhotra/Indus_1.175B
Original result ↗

Open LLM Leaderboard v1

22.696%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 ARC
dimension
reasoning
metric
Accuracy
rank
7131
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
61331dce5bf32e0d8cf8f9164a31c052bcaa6c69
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-29T17:37:32.000Z
source model id
nickmalhotra/indus_1.175B
Original result ↗

Open LLM Leaderboard v1

23.117%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 MMLU
dimension
knowledge
metric
Accuracy
rank
7146
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
61331dce5bf32e0d8cf8f9164a31c052bcaa6c69
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-29T17:37:32.000Z
source model id
nickmalhotra/indus_1.175B
Original result ↗

Open LLM Leaderboard v1

23.117%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 MMLU
dimension
knowledge
metric
Accuracy
rank
7146
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
ba68b88d6926e7143735aa079097398d37bd01fd
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-29T11:08:24.000Z
source model id
nickmalhotra/Indus_1.175B
Original result ↗

Open LLM Leaderboard v1

25.045%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 HellaSwag
dimension
reasoning
metric
Accuracy
rank
7202
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
61331dce5bf32e0d8cf8f9164a31c052bcaa6c69
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-29T17:37:32.000Z
source model id
nickmalhotra/indus_1.175B
Original result ↗

Open LLM Leaderboard v1

25.045%

source id
openLLMLeaderboardV1
leaderboard name
Open LLM v1 HellaSwag
dimension
reasoning
metric
Accuracy
rank
7202
aggregation scope
suite
Open LLM v1
status
archived
precision
float16
task_count
6
metric_kind
Accuracy
rank_method
Derived competition rank over published evaluations with reported scores, including variants and source flags
weight_type
Original
published_at
2024-06-25T14:11:42Z
chat_template
false
suite_version
1
model_revision
ba68b88d6926e7143735aa079097398d37bd01fd
source_flagged
true
missing_metrics
  • Average ⬆️
  • TruthfulQA
dataset_revision
791ca1c841030008c6c266562c2b88c9b7196550
metric_population
7260
ranking_population
7260
source_flag_anomaly
true
evaluated at
2024-04-29T11:08:24.000Z
source model id
nickmalhotra/Indus_1.175B
Original result ↗

Original sources

1–3 / 3

Hugging Face · Model repository ↗

Hugging Face · Model repository ↗

Hugging Face · Catalog ↗

Source links

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace