datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
pile-diff_samp-qwen_1.8B-qwen_104M-r0.5This repository contains the refined pre-training corpus from the paper MiniPLM: Knowledge Distillation for Pre-Training Language Models.
Code: https://github.com/thu-coai/MiniPLM
deepseek-ai-deepseek-coder-v2-lite-instruct__llm-quality-persona-consistency-mini__019e3b6fdda4
deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct on llm.quality.persona-consistency-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
5
N Ok
5
Ok Rate
1
Persona Consistency Mean
0.88
Accuracy
0.88
Persona Consistency P50
0.8
Persona Consistency P95
1
Accuracy P05
0.8
Accuracy P50
0.8
Accuracy P95
1
Drift Rate
0.6
Mean Drift Turn
2.6667
TTFT P50
57.5324
ms
Total P50 Ms
2672.8064… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/deepseek-ai-deepseek-coder-v2-lite-instruct__llm-quality-persona-consistency-mini__019e3b6fdda4.microsoft-phi-3-5-mini-instruct__llm-quality-persona-consistency-mini__019e3b5d67aa
microsoft/Phi-3.5-mini-instruct on llm.quality.persona-consistency-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
5
N Ok
5
Ok Rate
1
Persona Consistency Mean
0.96
Accuracy
0.96
Persona Consistency P50
1
Persona Consistency P95
1
Accuracy P05
0.84
Accuracy P50
1
Accuracy P95
1
Drift Rate
0.2
Mean Drift Turn
4
TTFT P50
11.6051
ms
Total P50 Ms
1595.7139
Tokens Out Total
1620… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/microsoft-phi-3-5-mini-instruct__llm-quality-persona-consistency-mini__019e3b5d67aa.google-gemma-2-9b-it__llm-quality-factual-mini__019e3b975288
google/gemma-2-9b-it on llm.quality.factual-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
10
N Ok
10
Ok Rate
1
Accuracy
1
Accuracy P05
1
Accuracy P50
1
Accuracy P95
1
TTFT P50
16.8943
ms
Total P50 Ms
142.032
Tokens Out Total
205
Run configuration
Model: google/gemma-2-9b-it @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA H100 80GB HBM3
Driver:… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/google-gemma-2-9b-it__llm-quality-factual-mini__019e3b975288.microsoft-phi-3-5-mini-instruct__llm-inference-chatbot-short__019e3b5cf170
microsoft/Phi-3.5-mini-instruct on llm.inference.chatbot-short (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
TTFT P50
18.4079
ms
TTFT P99
265.3733
ms
TPOT P50
4.6615
ms
TPOT P99
6.5718
ms
Total P50 Ms
531.3797
Total P99 Ms
786.9971
Req Per S Passing
6.5257
Req Per S All
6.6729
Compliance Rate
0.9779
Ok Rate
1
Throughput Tok Per S
716.0655
Power Avg W
861.866
Power Peak W
897.907
Energy Joules… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/microsoft-phi-3-5-mini-instruct__llm-inference-chatbot-short__019e3b5cf170.microsoft-phi-3-5-mini-instruct__llm-quality-arithmetic-mini__019e3b5d2482
microsoft/Phi-3.5-mini-instruct on llm.quality.arithmetic-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
8
N Ok
8
Ok Rate
1
Accuracy
0.75
Accuracy P05
0
Accuracy P50
1
Accuracy P95
1
TTFT P50
11.2417
ms
Total P50 Ms
31.7159
Tokens Out Total
208
Run configuration
Model: microsoft/Phi-3.5-mini-instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware:… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/microsoft-phi-3-5-mini-instruct__llm-quality-arithmetic-mini__019e3b5d2482.qwen-qwen2-vl-7b-instruct__llm-quality-factual-mini__019e3b85fc73
Qwen/Qwen2-VL-7B-Instruct on llm.quality.factual-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
10
N Ok
10
Ok Rate
1
Accuracy
1
Accuracy P05
1
Accuracy P50
1
Accuracy P95
1
TTFT P50
29.4403
ms
Total P50 Ms
176.794
Tokens Out Total
150
Run configuration
Model: Qwen/Qwen2-VL-7B-Instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA H100 80GB HBM3… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/qwen-qwen2-vl-7b-instruct__llm-quality-factual-mini__019e3b85fc73.microsoft-phi-3-5-mini-instruct__llm-quality-reasoning-mini__019e3b5d39b2
microsoft/Phi-3.5-mini-instruct on llm.quality.reasoning-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
10
N Ok
10
Ok Rate
1
Accuracy
0.2
Accuracy P05
0
Accuracy P50
0
Accuracy P95
1
TTFT P50
11.2253
ms
Total P50 Ms
192.4104
Tokens Out Total
286
Run configuration
Model: microsoft/Phi-3.5-mini-instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware:… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/microsoft-phi-3-5-mini-instruct__llm-quality-reasoning-mini__019e3b5d39b2.qwen-qwen2-5-coder-7b-instruct__llm-quality-factual-mini__019e3b3fbe50
Qwen/Qwen2.5-Coder-7B-Instruct on llm.quality.factual-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
10
N Ok
10
Ok Rate
1
Accuracy
1
Accuracy P05
1
Accuracy P50
1
Accuracy P95
1
TTFT P50
13.9553
ms
Total P50 Ms
90.957
Tokens Out Total
217
Run configuration
Model: Qwen/Qwen2.5-Coder-7B-Instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA H100… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/qwen-qwen2-5-coder-7b-instruct__llm-quality-factual-mini__019e3b3fbe50.qwen-qwen2-5-7b-instruct__llm-quality-arithmetic-mini__019e3b398700
Qwen/Qwen2.5-7B-Instruct on llm.quality.arithmetic-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
8
N Ok
8
Ok Rate
1
Accuracy
0.875
Accuracy P05
0.35
Accuracy P50
1
Accuracy P95
1
TTFT P50
13.404
ms
Total P50 Ms
32.814
Tokens Out Total
10
Run configuration
Model: Qwen/Qwen2.5-7B-Instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA H100 80GB… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/qwen-qwen2-5-7b-instruct__llm-quality-arithmetic-mini__019e3b398700.deepseek-ai-deepseek-coder-v2-lite-instruct__llm-quality-factual-mini__019e3b6f9bdd
deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct on llm.quality.factual-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
10
N Ok
10
Ok Rate
1
Accuracy
1
Accuracy P05
1
Accuracy P50
1
Accuracy P95
1
TTFT P50
45.0118
ms
Total P50 Ms
359.225
Tokens Out Total
373
Run configuration
Model: deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct @ unknown00
Engine: vllm vunknownQuantization:… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/deepseek-ai-deepseek-coder-v2-lite-instruct__llm-quality-factual-mini__019e3b6f9bdd.qwen-qwen2-5-7b-instruct__llm-quality-persona-consistency-mini__019e3b39b322
Qwen/Qwen2.5-7B-Instruct on llm.quality.persona-consistency-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
5
N Ok
5
Ok Rate
1
Persona Consistency Mean
0.92
Accuracy
0.92
Persona Consistency P50
1
Persona Consistency P95
1
Accuracy P05
0.68
Accuracy P50
1
Accuracy P95
1
Drift Rate
0.2
Mean Drift Turn
2
TTFT P50
14.2566
ms
Total P50 Ms
1731.7325
Tokens Out Total
1124… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/qwen-qwen2-5-7b-instruct__llm-quality-persona-consistency-mini__019e3b39b322.meta-llama-llama-3-1-70b-instruct__llm-mt-flores-200-mini-en-fr__019e3b92df93
meta-llama/Llama-3.1-70B-Instruct on llm.mt.flores-200-mini-en-fr (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
8
N Ok
8
Ok Rate
1
Chrf Mean
0.8819
Chrf P50
0.9033
Chrf P95
1
TTFT P50
32.0341
ms
Total P50 Ms
296.1723
Tokens Out Total
115
Run configuration
Model: meta-llama/Llama-3.1-70B-Instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA H100 80GB… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/meta-llama-llama-3-1-70b-instruct__llm-mt-flores-200-mini-en-fr__019e3b92df93.meta-llama-llama-3-1-70b-instruct__llm-quality-arithmetic-mini__019e3b923a2c
meta-llama/Llama-3.1-70B-Instruct on llm.quality.arithmetic-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
8
N Ok
8
Ok Rate
1
Accuracy
1
Accuracy P05
1
Accuracy P50
1
Accuracy P95
1
TTFT P50
32.532
ms
Total P50 Ms
49.1552
Tokens Out Total
10
Run configuration
Model: meta-llama/Llama-3.1-70B-Instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/meta-llama-llama-3-1-70b-instruct__llm-quality-arithmetic-mini__019e3b923a2c.qwen-qwen2-5-7b-instruct__llm-quality-factual-mini__019e3b397723
Qwen/Qwen2.5-7B-Instruct on llm.quality.factual-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
10
N Ok
10
Ok Rate
1
Accuracy
1
Accuracy P05
1
Accuracy P50
1
Accuracy P95
1
TTFT P50
14.1209
ms
Total P50 Ms
328.7876
Tokens Out Total
421
Run configuration
Model: Qwen/Qwen2.5-7B-Instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA H100 80GB HBM3… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/qwen-qwen2-5-7b-instruct__llm-quality-factual-mini__019e3b397723.qwen-qwen2-5-coder-7b-instruct__llm-quality-persona-consistency-mini__019e3b3fe948
Qwen/Qwen2.5-Coder-7B-Instruct on llm.quality.persona-consistency-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
5
N Ok
5
Ok Rate
1
Persona Consistency Mean
0.76
Accuracy
0.76
Persona Consistency P50
0.8
Persona Consistency P95
1
Accuracy P05
0.32
Accuracy P50
0.8
Accuracy P95
1
Drift Rate
0.6
Mean Drift Turn
2.6667
TTFT P50
14.4754
ms
Total P50 Ms
1210.5122
Tokens Out Total… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/qwen-qwen2-5-coder-7b-instruct__llm-quality-persona-consistency-mini__019e3b3fe948.mistralai-mistral-7b-instruct-v0-3__llm-mt-flores-200-mini-en-fr__019e3b460885
mistralai/Mistral-7B-Instruct-v0.3 on llm.mt.flores-200-mini-en-fr (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
8
N Ok
8
Ok Rate
1
Chrf Mean
0.767
Chrf P50
0.7445
Chrf P95
1
TTFT P50
11.9969
ms
Total P50 Ms
154.8732
Tokens Out Total
181
Run configuration
Model: mistralai/Mistral-7B-Instruct-v0.3 @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA H100 80GB… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/mistralai-mistral-7b-instruct-v0-3__llm-mt-flores-200-mini-en-fr__019e3b460885.meta-llama-llama-3-1-8b-instruct__llm-quality-persona-consistency-mini__019e3b3065a9
meta-llama/Llama-3.1-8B-Instruct on llm.quality.persona-consistency-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
5
N Ok
5
Ok Rate
1
Persona Consistency Mean
0.96
Accuracy
0.96
Persona Consistency P50
1
Persona Consistency P95
1
Accuracy P05
0.84
Accuracy P50
1
Accuracy P95
1
Drift Rate
0.2
Mean Drift Turn
4
TTFT P50
14.7726
ms
Total P50 Ms
2869.6124
Tokens Out Total
1842… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/meta-llama-llama-3-1-8b-instruct__llm-quality-persona-consistency-mini__019e3b3065a9.qwen-qwen2-5-7b-instruct__llm-mt-flores-200-mini-en-fr__019e3b39c5bb
Qwen/Qwen2.5-7B-Instruct on llm.mt.flores-200-mini-en-fr (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
8
N Ok
8
Ok Rate
1
Chrf Mean
0.8912
Chrf P50
0.9439
Chrf P95
1
TTFT P50
14.1119
ms
Total P50 Ms
115.5118
Tokens Out Total
114
Run configuration
Model: Qwen/Qwen2.5-7B-Instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA H100 80GB HBM3
Driver:… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/qwen-qwen2-5-7b-instruct__llm-mt-flores-200-mini-en-fr__019e3b39c5bb.meta-llama-llama-3-1-8b-instruct__llm-quality-factual-mini__019e3b300ded
meta-llama/Llama-3.1-8B-Instruct on llm.quality.factual-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
10
N Ok
10
Ok Rate
1
Accuracy
1
Accuracy P05
1
Accuracy P50
1
Accuracy P95
1
TTFT P50
14.0798
ms
Total P50 Ms
101.8105
Tokens Out Total
219
Run configuration
Model: meta-llama/Llama-3.1-8B-Instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/meta-llama-llama-3-1-8b-instruct__llm-quality-factual-mini__019e3b300ded.meta-llama-llama-3-1-70b-instruct__llm-quality-factual-mini__019e3b922429
meta-llama/Llama-3.1-70B-Instruct on llm.quality.factual-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
10
N Ok
10
Ok Rate
1
Accuracy
1
Accuracy P05
1
Accuracy P50
1
Accuracy P95
1
TTFT P50
32.6144
ms
Total P50 Ms
435.9529
Tokens Out Total
267
Run configuration
Model: meta-llama/Llama-3.1-70B-Instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware:… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/meta-llama-llama-3-1-70b-instruct__llm-quality-factual-mini__019e3b922429.meta-llama-llama-3-1-70b-instruct__llm-quality-persona-consistency-mini__019e3b92bf6e
meta-llama/Llama-3.1-70B-Instruct on llm.quality.persona-consistency-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
5
N Ok
5
Ok Rate
1
Persona Consistency Mean
1
Accuracy
1
Persona Consistency P50
1
Persona Consistency P95
1
Accuracy P05
1
Accuracy P50
1
Accuracy P95
1
Drift Rate
0
TTFT P50
33.4535
ms
Total P50 Ms
8591.7979
Tokens Out Total
1861
Run configuration… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/meta-llama-llama-3-1-70b-instruct__llm-quality-persona-consistency-mini__019e3b92bf6e.meta-llama-llama-3-1-8b-instruct__llm-quality-arithmetic-mini__019e3b3022d4
meta-llama/Llama-3.1-8B-Instruct on llm.quality.arithmetic-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
8
N Ok
8
Ok Rate
1
Accuracy
0.75
Accuracy P05
0
Accuracy P50
1
Accuracy P95
1
TTFT P50
14.1181
ms
Total P50 Ms
23.7398
Tokens Out Total
10
Run configuration
Model: meta-llama/Llama-3.1-8B-Instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware:… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/meta-llama-llama-3-1-8b-instruct__llm-quality-arithmetic-mini__019e3b3022d4.mistralai-mistral-7b-instruct-v0-3__llm-quality-arithmetic-mini__019e3b45b5dc
mistralai/Mistral-7B-Instruct-v0.3 on llm.quality.arithmetic-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
8
N Ok
8
Ok Rate
1
Accuracy
0.5
Accuracy P05
0
Accuracy P50
0.5
Accuracy P95
1
TTFT P50
12.4066
ms
Total P50 Ms
37.8039
Tokens Out Total
18
Run configuration
Model: mistralai/Mistral-7B-Instruct-v0.3 @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware:… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/mistralai-mistral-7b-instruct-v0-3__llm-quality-arithmetic-mini__019e3b45b5dc.mistralai-mistral-7b-instruct-v0-3__llm-quality-factual-mini__019e3b45a60d
mistralai/Mistral-7B-Instruct-v0.3 on llm.quality.factual-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
10
N Ok
10
Ok Rate
1
Accuracy
1
Accuracy P05
1
Accuracy P50
1
Accuracy P95
1
TTFT P50
11.7003
ms
Total P50 Ms
473.4047
Tokens Out Total
627
Run configuration
Model: mistralai/Mistral-7B-Instruct-v0.3 @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware:… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/mistralai-mistral-7b-instruct-v0-3__llm-quality-factual-mini__019e3b45a60d.microsoft-phi-3-5-mini-instruct__llm-quality-factual-mini__019e3b5d1176
microsoft/Phi-3.5-mini-instruct on llm.quality.factual-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
10
N Ok
10
Ok Rate
1
Accuracy
1
Accuracy P05
1
Accuracy P50
1
Accuracy P95
1
TTFT P50
11.2101
ms
Total P50 Ms
499.6194
Tokens Out Total
943
Run configuration
Model: microsoft/Phi-3.5-mini-instruct @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/microsoft-phi-3-5-mini-instruct__llm-quality-factual-mini__019e3b5d1176.google-gemma-2-9b-it__llm-quality-arithmetic-mini__019e3b97635f
google/gemma-2-9b-it on llm.quality.arithmetic-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
8
N Ok
8
Ok Rate
1
Accuracy
1
Accuracy P05
1
Accuracy P50
1
Accuracy P95
1
TTFT P50
17.0788
ms
Total P50 Ms
50.9178
Tokens Out Total
10
Run configuration
Model: google/gemma-2-9b-it @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA H100 80GB HBM3
Driver:… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/google-gemma-2-9b-it__llm-quality-arithmetic-mini__019e3b97635f.mistralai-mistral-7b-instruct-v0-3__llm-quality-persona-consistency-mini__019e3b45f3f4
mistralai/Mistral-7B-Instruct-v0.3 on llm.quality.persona-consistency-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
5
N Ok
5
Ok Rate
1
Persona Consistency Mean
0.96
Accuracy
0.96
Persona Consistency P50
1
Persona Consistency P95
1
Accuracy P05
0.84
Accuracy P50
1
Accuracy P95
1
Drift Rate
0.2
Mean Drift Turn
4
TTFT P50
12.3651
ms
Total P50 Ms
2371.047
Tokens Out Total
1698… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/mistralai-mistral-7b-instruct-v0-3__llm-quality-persona-consistency-mini__019e3b45f3f4.google-gemma-2-9b-it__llm-mt-flores-200-mini-en-fr__019e3b9789b8
google/gemma-2-9b-it on llm.mt.flores-200-mini-en-fr (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
8
N Ok
8
Ok Rate
1
Chrf Mean
0.7462
Chrf P50
0.6872
Chrf P95
1
TTFT P50
16.7669
ms
Total P50 Ms
291.575
Tokens Out Total
199
Run configuration
Model: google/gemma-2-9b-it @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA H100 80GB HBM3
Driver: 580.126.09… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/google-gemma-2-9b-it__llm-mt-flores-200-mini-en-fr__019e3b9789b8.google-gemma-2-9b-it__llm-quality-persona-consistency-mini__019e3b9772de
google/gemma-2-9b-it on llm.quality.persona-consistency-mini (NVIDIA H100 80GB HBM3)
Back to leaderboard
Headline metrics
Metric
Value
Unit
N Samples
5
N Ok
0
Ok Rate
0
Run configuration
Model: google/gemma-2-9b-it @ unknown00
Engine: vllm vunknown
Quantization: fp16
Hardware: NVIDIA H100 80GB HBM3
Driver: 580.126.09
CUDA: 13.0
Run date: 2026-05-18T14:57:21.631007+00:00
Seed: 0
Verification
This result is Sigstore-signed and… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/google-gemma-2-9b-it__llm-quality-persona-consistency-mini__019e3b9772de.
