CoolFace
Modelpublic

waltgrace/llama-cpp-expert-sniper

sourceHugging Facemitupdated 6mo agoView on Hugging Face
1likes
14 commits on main
82708476mo ago

Q8 result: thrashes on 16 GB (CPU_REPACK doubles memory)

waltgrace
ae909ec6mo ago

Add Gemma 4 benchmark results

waltgrace
83208896mo ago

Update MLX sniper link to 5.4 tok/s

waltgrace
6fa45be6mo ago

Update MLX sniper link: 5.2 tok/s on 35B

waltgrace
c94ca8d6mo ago

Add full README with verified benchmarks and research findings

waltgrace
9f84be16mo ago

Add common/arg.cpp

waltgrace
6ce9fdd6mo ago

Add common/common.h

waltgrace
6123ae46mo ago

Add common/common.cpp

waltgrace
a8c19346mo ago

Add src/CMakeLists.txt

waltgrace
c8ad2446mo ago

Add src/llama-expert-cache.h

waltgrace
1fa479d6mo ago

Add src/llama-expert-cache.cpp

waltgrace
715943d6mo ago

Add src/llama-expert-cache-ctx.h

waltgrace
f3ad8b86mo ago

Add src/llama-expert-cache-ctx.cpp

waltgrace
43397e46mo ago

initial commit

waltgrace