Datasetpublic

optimum-benchmark/llm-perf-leaderboard

sourceHugging Faceupdated 2y agoView on Hugging Face

3likes5kdownloads

file.gitattributes3 KBdownload

filellm-df.csv560 KBdownload

fileperf-df-awq-1xA10.csv17.5 MBdownload

fileperf-df-awq-1xT4.csv10.0 MBdownload

fileperf-df-awq-c7i.csv656 KBdownload

fileperf-df-bnb-1xA10.csv8.3 MBdownload

fileperf-df-bnb-1xA100.csv2.7 MBdownload

fileperf-df-bnb-1xT4.csv6.2 MBdownload

fileperf-df-bnb-c7i.csv376 KBdownload

fileperf-df-gptq-1xA10.csv10.1 MBdownload

fileperf-df-gptq-1xA100.csv2.0 MBdownload

fileperf-df-gptq-1xT4.csv6.4 MBdownload

fileperf-df-gptq-c7i.csv379 KBdownload

fileperf-df-onnxruntime-cpu-unquantized-32vCPU-C7i.csv698 KBdownload

fileperf-df-openvino-cpu-unquantized-32vCPU-C7i.csv27 KBdownload

fileperf-df-pytorch-cpu-unquantized-32vCPU-C7i.csv8.4 MBdownload

fileperf-df-pytorch-cuda-awq-1xA10.csv19.0 MBdownload

fileperf-df-pytorch-cuda-awq-1xT4.csv11.7 MBdownload

fileperf-df-pytorch-cuda-bnb-1xA10.csv12.9 MBdownload

fileperf-df-pytorch-cuda-bnb-1xA100.csv2.8 MBdownload

fileperf-df-pytorch-cuda-bnb-1xT4.csv7.0 MBdownload

fileperf-df-pytorch-cuda-gptq-1xA10.csv11.2 MBdownload

fileperf-df-pytorch-cuda-gptq-1xA100.csv2.0 MBdownload

fileperf-df-pytorch-cuda-gptq-1xT4.csv8.6 MBdownload

fileperf-df-pytorch-cuda-torchao-1xA10.csv2.4 MBdownload

fileperf-df-pytorch-cuda-torchao-1xT4.csv1.2 MBdownload

fileperf-df-pytorch-cuda-unquantized-1xA10.csv16.0 MBdownload

fileperf-df-pytorch-cuda-unquantized-1xA100.csv2.8 MBdownload

fileperf-df-pytorch-cuda-unquantized-1xT4.csv11.5 MBdownload

fileperf-df-unquantized-1xA10.csv12.0 MBdownload

fileperf-df-unquantized-1xA100.csv2.8 MBdownload

fileperf-df-unquantized-1xT4.csv9.4 MBdownload

fileperf-df-unquantized-32vCPU-C7i.csv7.0 MBdownload

fileperf-df-unquantized-c7i.csv4.0 MBdownload

optimum-benchmark/llm-perf-leaderboard · main · files are served by the source, never re-hosted here