Datasetpublic

Yobitel/microsoft-phi-3-5-mini-instructllm-inference-chatbot-short019e3b5cf170

microsoft/Phi-3.5-mini-instruct on llm.inference.chatbot-short (NVIDIA H100 80GB HBM3) Back to leaderboard Headline metrics Metric Value Unit TTFT P50 18.4079 ms TTFT P99 265.3733 ms TPOT P50 4.6615 ms TPOT P99 6.5718 ms Total P50 Ms 531.3797 Total P99 Ms 786.9971 Req Per S Passing 6.5257 Req Per S All 6.6729 Compliance Rate 0.9779 Ok Rate 1 Throughput Tok Per S 716.0655 Power Avg W 861.866 Power Peak W 897.907 Energy… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/microsoft-phi-3-5-mini-instruct__llm-inference-chatbot-short__019e3b5cf170.

sourceHugging Facecc-by-4.0updated 4mo agoView on Hugging Face

0likes17downloads

settings

This repository belongs to Yobitel on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

namemicrosoft-phi-3-5-mini-instruct__llm-inference-chatbot-short__019e3b5cf170

visibilitypublic

licencecc-by-4.0

gatedno

ownerYobitel

Account settings