CoolFace
Datasetpublic

Yobitel/deepseek-ai-deepseek-coder-v2-lite-instruct__llm-inference-chatbot-short__019e3b6f22ca

deepseek-ai/DeepSeek-Coder-V2-Lite-Instruct on llm.inference.chatbot-short (NVIDIA H100 80GB HBM3) Back to leaderboard Headline metrics Metric Value Unit TTFT P50 74.4268 ms TTFT P99 521.1922 ms TPOT P50 21.0371 ms TPOT P99 23.458 ms Total P50 Ms 2661.4077 Total P99 Ms 3136.5972 Req Per S Passing 1.0172 Req Per S All 1.1559 Compliance Rate 0.88 Ok Rate 1 Throughput Tok Per S 134.316 Power Avg W 808.3085 Power Peak W… See the full description on the dataset page: https://huggingface.co/datasets/Yobitel/deepseek-ai-deepseek-coder-v2-lite-instruct__llm-inference-chatbot-short__019e3b6f22ca.

sourceHugging Facecc-by-4.0updated 4mo agoView on Hugging Face
0likes19downloads
settings

This repository belongs to Yobitel on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

namedeepseek-ai-deepseek-coder-v2-lite-instruct__llm-inference-chatbot-short__019e3b6f22ca
visibilitypublic
licencecc-by-4.0
gatedno
ownerYobitel
Account settings
Yobitel/deepseek-ai-deepseek-coder-v2-lite-instruct__llm-inference-chatbot-short__019e3b6f22ca · CoolFace