trl-internal-testing/tiny-random-LlamaForCausalLM

Explore trl-internal-testing/tiny-random-LlamaForCausalLM: model specifications, capabilities, benchmark results, platform pricing and original sources.

huggingface/trl-internal-testing/tiny-random-LlamaForCausalLM

Specifications & capabilities

Published model ID
tiny-random-LlamaForCausalLM

Evaluations

101–120 / 600

LLM-Perf

450.646

source id
llmPerf
leaderboard name
prefill memory max_ram
dimension
runtime
metric
prefill memory max_ram
rank
1
aggregation scope
status
published
direction
lowerIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float32
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
prefill memory max_ram
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
cccf976bf7031ea648a8bd66cb9efb6f44f51eb19ff4d985102eb37451f09930
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

450.646

source id
llmPerf
leaderboard name
decode memory max_ram
dimension
runtime
metric
decode memory max_ram
rank
1
aggregation scope
status
published
direction
lowerIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float32
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
decode memory max_ram
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
cccf976bf7031ea648a8bd66cb9efb6f44f51eb19ff4d985102eb37451f09930
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

445.075

source id
llmPerf
leaderboard name
load memory max_ram
dimension
runtime
metric
load memory max_ram
rank
1
aggregation scope
status
published
direction
lowerIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float32
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
eager
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
load memory max_ram
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
aac891d9cebf017cc105cb4dbe487af45f5bb7ef2ea228d2f28e79b27faf2fa0
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

440.029

source id
llmPerf
leaderboard name
load memory max_ram
dimension
runtime
metric
load memory max_ram
rank
1
aggregation scope
status
published
direction
lowerIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
bfloat16
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
eager
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
load memory max_ram
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
4cc6dcb0909dc19d69386ab3b821fc1207b614185bc7650eaf4684471857c958
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

440.013

source id
llmPerf
leaderboard name
load memory max_ram
dimension
runtime
metric
load memory max_ram
rank
1
aggregation scope
status
published
direction
lowerIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float16
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
eager
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
load memory max_ram
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
d9333c1fba1e7cbfd9179af30f5fe3d103a0c08d81b2d09725eb77c0f538c630
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

439.812

source id
llmPerf
leaderboard name
load memory max_ram
dimension
runtime
metric
load memory max_ram
rank
1
aggregation scope
status
published
direction
lowerIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float16
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
load memory max_ram
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
a537eba364c262fea986452a88164d1174a4545d0a9ee33a3804953bc841eb83
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

439.472

source id
llmPerf
leaderboard name
load memory max_ram
dimension
runtime
metric
load memory max_ram
rank
1
aggregation scope
status
published
direction
lowerIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float32
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
load memory max_ram
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
cccf976bf7031ea648a8bd66cb9efb6f44f51eb19ff4d985102eb37451f09930
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

437.527

source id
llmPerf
leaderboard name
load memory max_ram
dimension
runtime
metric
load memory max_ram
rank
1
aggregation scope
status
published
direction
lowerIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
bfloat16
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
load memory max_ram
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
eca75fbd52f1a291c5d4a1327758021e40b219ea3d86303255dccd18067f0cad
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

384.16

source id
llmPerf
leaderboard name
per_token throughput value
dimension
runtime
metric
per_token throughput value
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cuda-unquantized-1xA10.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cuda
config.backend.library
transformers
config.backend.version
2.5.0+cu124
config.environment.cpu
AMD EPYC 7R32
config.environment.gpu
['NVIDIA A10G']
config.backend.eval_mode
True
config.backend.device_ids
0
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float32
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
16
config.environment.gpu_count
1
config.environment.processor
x86_64
config.environment.cpu_ram_mb
66697.261056
config.environment.gpu_vram_mb
24146608128
config.backend.autocast_enabled
False
config.environment.peft_version
0.13.2
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
per_token throughput value
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cuda-unquantized-1xA10.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
5f7a035c2ce09b8560bf73131dfd3087f830f3a79c0f808b69a1c819e040f266
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

383.258

source id
llmPerf
leaderboard name
decode throughput value
dimension
runtime
metric
decode throughput value
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cuda-unquantized-1xA10.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cuda
config.backend.library
transformers
config.backend.version
2.5.0+cu124
config.environment.cpu
AMD EPYC 7R32
config.environment.gpu
['NVIDIA A10G']
config.backend.eval_mode
True
config.backend.device_ids
0
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float32
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
16
config.environment.gpu_count
1
config.environment.processor
x86_64
config.environment.cpu_ram_mb
66697.261056
config.environment.gpu_vram_mb
24146608128
config.backend.autocast_enabled
False
config.environment.peft_version
0.13.2
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
decode throughput value
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cuda-unquantized-1xA10.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
5f7a035c2ce09b8560bf73131dfd3087f830f3a79c0f808b69a1c819e040f266
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

367.575

source id
llmPerf
leaderboard name
per_token throughput value
dimension
runtime
metric
per_token throughput value
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float32
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
per_token throughput value
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
cccf976bf7031ea648a8bd66cb9efb6f44f51eb19ff4d985102eb37451f09930
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

367.201

source id
llmPerf
leaderboard name
decode throughput value
dimension
runtime
metric
decode throughput value
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float32
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
decode throughput value
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
cccf976bf7031ea648a8bd66cb9efb6f44f51eb19ff4d985102eb37451f09930
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

352.44

source id
llmPerf
leaderboard name
per_token throughput value
dimension
runtime
metric
per_token throughput value
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
bfloat16
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
per_token throughput value
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
eca75fbd52f1a291c5d4a1327758021e40b219ea3d86303255dccd18067f0cad
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

352.077

source id
llmPerf
leaderboard name
decode throughput value
dimension
runtime
metric
decode throughput value
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
bfloat16
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
decode throughput value
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
eca75fbd52f1a291c5d4a1327758021e40b219ea3d86303255dccd18067f0cad
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

348.907

source id
llmPerf
leaderboard name
per_token throughput value
dimension
runtime
metric
per_token throughput value
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cuda-unquantized-1xA10.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cuda
config.backend.library
transformers
config.backend.version
2.5.0+cu124
config.environment.cpu
AMD EPYC 7R32
config.environment.gpu
['NVIDIA A10G']
config.backend.eval_mode
True
config.backend.device_ids
0
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
bfloat16
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
16
config.environment.gpu_count
1
config.environment.processor
x86_64
config.environment.cpu_ram_mb
66697.261056
config.environment.gpu_vram_mb
24146608128
config.backend.autocast_enabled
False
config.environment.peft_version
0.13.2
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
per_token throughput value
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cuda-unquantized-1xA10.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
7a1b3f9f76f63aa28c0d0622d25a20b6ed9a52750c588cc7b44ac2f368f2137d
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

348.183

source id
llmPerf
leaderboard name
decode throughput value
dimension
runtime
metric
decode throughput value
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cuda-unquantized-1xA10.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cuda
config.backend.library
transformers
config.backend.version
2.5.0+cu124
config.environment.cpu
AMD EPYC 7R32
config.environment.gpu
['NVIDIA A10G']
config.backend.eval_mode
True
config.backend.device_ids
0
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
bfloat16
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
16
config.environment.gpu_count
1
config.environment.processor
x86_64
config.environment.cpu_ram_mb
66697.261056
config.environment.gpu_vram_mb
24146608128
config.backend.autocast_enabled
False
config.environment.peft_version
0.13.2
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
decode throughput value
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cuda-unquantized-1xA10.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
7a1b3f9f76f63aa28c0d0622d25a20b6ed9a52750c588cc7b44ac2f368f2137d
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

345.065

source id
llmPerf
leaderboard name
per_token throughput value
dimension
runtime
metric
per_token throughput value
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float16
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
per_token throughput value
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
a537eba364c262fea986452a88164d1174a4545d0a9ee33a3804953bc841eb83
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

344.715

source id
llmPerf
leaderboard name
decode throughput value
dimension
runtime
metric
decode throughput value
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float16
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
sdpa
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
decode throughput value
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
a537eba364c262fea986452a88164d1174a4545d0a9ee33a3804953bc841eb83
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

342.753

source id
llmPerf
leaderboard name
per_token throughput value
dimension
runtime
metric
per_token throughput value
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float32
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
eager
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
per_token throughput value
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
aac891d9cebf017cc105cb4dbe487af45f5bb7ef2ea228d2f28e79b27faf2fa0
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

LLM-Perf

342.418

source id
llmPerf
leaderboard name
decode throughput value
dimension
runtime
metric
decode throughput value
rank
1
aggregation scope
status
published
direction
higherIsBetter
conditions
suite
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
execution
config.backend.name
pytorch
config.backend.seed
42
config.backend.task
text-generation
config.backend.device
cpu
config.backend.library
transformers
config.backend.version
2.5.0+cpu
config.environment.cpu
Intel(R) Xeon(R) Platinum 8488C
config.backend.eval_mode
True
config.backend.model_type
llama
config.backend.no_weights
True
config.environment.system
Linux
config.backend.torch_dtype
float32
config.environment.machine
x86_64
config.backend.torch_compile
False
config.environment.cpu_count
96
config.environment.processor
x86_64
config.environment.cpu_ram_mb
199386.689536
config.backend.autocast_enabled
False
config.environment.python_version
3.10.12
config.backend.attn_implementation
eager
config.backend.deepspeed_inference
False
config.environment.optimum_version
1.23.2
config.backend.to_bettertransformer
False
config.backend.torch_compile_target
forward
config.environment.accelerate_version
1.0.1
config.environment.transformers_version
4.45.2
config.scenario.input_shapes.batch_size
1
config.scenario.input_shapes.num_choices
2
config.environment.optimum_benchmark_version
0.5.0.dev0
config.scenario.input_shapes.sequence_length
256
config.backend.model_kwargs.trust_remote_code
True
config.scenario.generate_kwargs.max_new_tokens
64
config.scenario.generate_kwargs.min_new_tokens
64
metric_kind
decode throughput value
rank_method
competition rank among reported evaluations in identical conditions, including unlinked observations
source_file
optimum-benchmark/llm-perf-leaderboard/perf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv
published_at
2024-12-13T10:07:03Z
source_revision
2fa8d8c300c4eb6e744d5e35999db926c0c26e90e767e4c38da326eebe21a92b
metric_population
1
benchmark_evaluation
true
comparison_configuration_sha256
aac891d9cebf017cc105cb4dbe487af45f5bb7ef2ea228d2f28e79b27faf2fa0
complete_configuration_location
source record config and original CSV artifact
source model id
trl-internal-testing/tiny-random-LlamaForCausalLM
Original result ↗

Safety assessments

1–1 / 1

Foundation Model Transparency Index 2025 ↗

31 / 100

source id
stanfordFMTI
canonical model id
huggingface/trl-internal-testing/tiny-random-LlamaForCausalLM
taxonomy
transparency
hazard category
transparency
hazard name
Organization transparency
policy area
Meta
assessment type
organization-level disclosure
metric
disclosure_score
result label
31 / 100
sample size
100
updated at
2026-11-09T18:08:05.227Z

Original sources

1–5 / 5

Hugging Face · trl-internal-testing/tiny-random-LlamaForCausalLM ↗

arXiv · Paper · 1910.09700 ↗

GitHub · Catalog ↗

Hugging Face · Catalog ↗

Hugging Face · Catalog ↗

Source links

1–3 / 3

Hugging Face model card

1–1 / 1

Explore more models

Models

Loading
EVIDENCE / COMPARISON

Benchmarks

Explore every benchmark

Loading

These charts contain model-linked results. The charts above also include unlinked source profiles. Compare scores within each evaluation. Model quality, usage, transparency and system performance measure different things.

Install TensorTrace