Datasetpublic

YuvrajSingh9886/bonsai-jetson-benchmark-15w

Bonsai Jetson Benchmark — 15W Platform: NVIDIA Jetson Orin Nano Super 8GB · Power mode: 15W Backend: llama.cpp build-jetson · CUDA · -ngl 99 Sweep: prompt ∈ {256, 512, 1024, 2048} tok × gen ∈ {128, 256, 512} tok · 20 reqs/combo Status: Complete — 57 combos (5 models × 12 prompt/gen configs) Key metric: tok/J = output tok/s ÷ VDD_CPU_GPU_CV (W) Models Model Quant Size Bonsai-1.7B Q1_0 (1-bit) ~237 MB Bonsai-4B Q1_0 (1-bit) ~540 MB Bonsai-8B Q1_0… See the full description on the dataset page: https://huggingface.co/datasets/YuvrajSingh9886/bonsai-jetson-benchmark-15w.

sourceHugging Facecc-by-4.0updated 10d agoView on Hugging Face

1likes363downloads

root

dirBonsai-1.7B/

dirBonsai-4B/

dirBonsai-8B/

dirdata/

dirTernary-Bonsai-1.7B/

dirTernary-Bonsai-4B/

file.gitattributes2 KBdownload

fileBonsai-1.7B-server.log15 KBdownload

fileBonsai-4B-server.log315 KBdownload