CoolFace
Datasetpublic

Venugopalan2610/trellis-vs-scalar-2bit-qat-snapshots

Single-Layer 2-Bit QAT Weight Snapshots Per-layer 2-bit quantized weight snapshots for the controlled trellis-vs-scalar comparison in "Small GPU, Small Edge: A Controlled Study of Trellis vs. Scalar 2-Bit QAT." These reproduce Tables 1, 3, and 4 of the paper. Built on meta-llama/Llama-3.2-1B and subject to the Llama 3.2 Community License. Each snapshot quantizes a single decoder layer's 7 projections to 2 bits; all other layers stay FP16. These are experiment artifacts, not a… See the full description on the dataset page: https://huggingface.co/datasets/Venugopalan2610/trellis-vs-scalar-2bit-qat-snapshots.

sourceHugging Facellama3.2updated 3mo agoView on Hugging Face
0likes16downloads
10 commits on main
3d9d1e63mo ago

Upload snapshots/layer01_scalar_ctrl_seed0.pt with huggingface_hub

Venugopalan2610
8212bb13mo ago

Upload snapshots/layer01_ste_trellis_seed0.pt with huggingface_hub

Venugopalan2610
a0b905c3mo ago

Upload snapshots/layer01_bcjr_seed0.pt with huggingface_hub

Venugopalan2610
66d6e2d3mo ago

Upload snapshots/layer04_scalar_ctrl_seed0.pt with huggingface_hub

Venugopalan2610
93d2a623mo ago

Upload snapshots/layer04_ste_trellis_seed0.pt with huggingface_hub

Venugopalan2610
13743213mo ago

Upload snapshots/layer04_bcjr_seed2.pt with huggingface_hub

Venugopalan2610
fcffc813mo ago

Upload snapshots/layer04_bcjr_seed1.pt with huggingface_hub

Venugopalan2610
4210d813mo ago

Upload snapshots/layer04_bcjr_seed0.pt with huggingface_hub

Venugopalan2610
e61bbaf3mo ago

Upload README.md with huggingface_hub

Venugopalan2610
637bda43mo ago

initial commit

Venugopalan2610