Yobitel/deepseek-ai-deepseek-coder-v2-lite-instruct__llm-quality-persona-consistency-mini__019e3b6fdda4

deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct on llm.quality.persona-consistency-mini (NVIDIA H100 80GB HBM3) Back to leaderboard Headline metrics Metric Value Unit N Samples 5 N Ok 5 Ok Rate 1 Persona Consistency Mean 0.88 Accuracy 0.88 Persona Consistency P50 0.8 Persona Consistency P95 1 Accuracy P05 0.8 Accuracy P50 0.8 Accuracy P95 1 Drift Rate 0.6 Mean Drift Turn 2.6667 TTFT P50 57.5324 ms Total P50 Ms 2672.8064… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/deepseek-ai-deepseek-coder-v2-lite-instruct__llm-quality-persona-consistency-mini__019e3b6fdda4.