CoolFace
Modelpublic

PollardWeights/Qwen2.5-7B-Instruct-Pollard

sourceHugging Faceapache-2.0updated 15d agoView on Hugging Face
0likes2.7kdownloads
13 commits on main
63b264215d ago

card: tok/s per rung, published byte sizes, corrected runtime column, stock-rebuild comparison

westwaters
d44bb4015d ago

add the Calib-3.0 importance matrix the allocation was measured with

westwaters
1fe32b915d ago

Rebuild IQ3_S on stock atoms so it loads in stock llama.cpp

westwaters
a904a9d15d ago

Rebuild IQ4_XS on stock atoms so it loads in stock llama.cpp

westwaters
c04e0a416d ago

State which rungs need ik_llama.cpp, read from the files' tensor types

westwaters
ba9644d17d ago

Regenerate on the Pollard master card template

westwaters
1912cf627d ago

Upload README.md with huggingface_hub

westwaters
becd8d028d ago

Upload Qwen2.5-7B-Instruct-Pollard-IQ1_KT.gguf with huggingface_hub

westwaters
654971d28d ago

Upload Qwen2.5-7B-Instruct-Pollard-Q6_K.gguf with huggingface_hub

westwaters
eee6f3128d ago

Upload Qwen2.5-7B-Instruct-Pollard-IQ4_XS.gguf with huggingface_hub

westwaters
c248b2028d ago

Upload Qwen2.5-7B-Instruct-Pollard-IQ3_S.gguf with huggingface_hub

westwaters
2aa35ca28d ago

Upload README.md with huggingface_hub

westwaters
822fbed28d ago

initial commit

westwaters