Yobitel/mistralai-mistral-7b-instruct-v0-3__code-generation-humaneval-mini__019e3b4630cb

mistralai/Mistral-7B-Instruct-v0.3 on code.generation.humaneval-mini (NVIDIA H100 80GB HBM3) Back to leaderboard Headline metrics Metric Value Unit N Samples 5 N Ok 5 Ok Rate 1 Pass At 1 0.8 Pass At 1 P05 0.2 Pass At 1 P50 1 Pass At 1 P95 1 Timeout Rate 0 TTFT P50 14.9549 ms Total P50 Ms 1243.2378 Tokens Out Total 824 Run configuration Model: mistralai/Mistral-7B-Instruct-v0.3 @ unknown00 Engine: vllm… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/mistralai-mistral-7b-instruct-v0-3__code-generation-humaneval-mini__019e3b4630cb.