Yobitel/microsoft-phi-3-5-mini-instruct__code-generation-humaneval-mini__019e3b5d8c8b

microsoft/Phi-3.5-mini-instruct on code.generation.humaneval-mini (NVIDIA H100 80GB HBM3) Back to leaderboard Headline metrics Metric Value Unit N Samples 5 N Ok 5 Ok Rate 1 Pass At 1 1 Pass At 1 P05 1 Pass At 1 P50 1 Pass At 1 P95 1 Timeout Rate 0 TTFT P50 12.396 ms Total P50 Ms 974.8963 Tokens Out Total 1166 Run configuration Model: microsoft/Phi-3.5-mini-instruct @ unknown00 Engine: vllm vunknown… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/microsoft-phi-3-5-mini-instruct__code-generation-humaneval-mini__019e3b5d8c8b.