CoolFace
Modelpublic

ubergarm/DeepSeek-V3.1-GGUF

sourceHugging Facemitupdated 1y agoView on Hugging Face
15likes536downloads
32 commits on main
42eb5f11y ago

Upload folder using huggingface_hub

ubergarm
37c60ea1y ago

Add amazing new smol-IQ4_KSS

ubergarm
45f94db1y ago

Add bf16 baseline PPL

ubergarm
0ebff271y ago

Upload folder using huggingface_hub

ubergarm
76e23241y ago

Add IQ2_KT

ubergarm
5ce5c081y ago

Upload folder using huggingface_hub

ubergarm
09ada9d1y ago

Show "pure" Q4_0 for comparison

ubergarm
1c6be341y ago

Upload folder using huggingface_hub

ubergarm
f794d721y ago

Add IQ3_K

ubergarm
c0b01781y ago

Upload folder using huggingface_hub

ubergarm
031204a1y ago

Uploading IQ4_KS and IQ4_K

ubergarm
9fb301c1y ago

Okay the initial set is done

ubergarm
09ebb221y ago

Add IQ2_KS and more perplexity graph data

ubergarm
7a974a11y ago

Upload folder using huggingface_hub

ubergarm
5ef35ac1y ago

Upload folder using huggingface_hub

ubergarm
3e93ef41y ago

Add IQ1_KT

ubergarm
b01718a1y ago

Upload folder using huggingface_hub

ubergarm
2932dea1y ago

add perplexity graph and upload more

ubergarm
8db025f1y ago

Upload folder using huggingface_hub

ubergarm
9c3c7bb1y ago

Upload folder using huggingface_hub

ubergarm
e36bccf1y ago

Uploading IQ2_KL and preparing IQ3_KS

ubergarm
5758fb71y ago

Add baseline Q8_0 perplexity

ubergarm
3cd82d51y ago

Preparing IQ2_KL 231.206 GiB (2.960 BPW)

ubergarm
4971e3b1y ago

Upload folder using huggingface_hub

ubergarm
8cd32c91y ago

Add IQ1_S and some perplexity measurements.

ubergarm
ddb6c8e1y ago

Upload imatrix-DeepSeek-V3.1-Q8_0.dat with huggingface_hub

ubergarm
c0a02671y ago

Add note to use `--chat-template deepseek3` for now

ubergarm
049d0b21y ago

Upload folder using huggingface_hub

ubergarm
1bfdad01y ago

Uploading iq5_k

ubergarm
db827cc1y ago

Upload imatrix-DeepSeek-V3.1-Q8_0.dat with huggingface_hub

ubergarm
86255df1y ago

initial commit

ubergarm
3ed8bb91y ago

initial commit

ubergarm