radi-cho/llama3-8b_a6000_nfl_b3g128_bf16_wikitext
021
This is a flute package of LLaMA-3-8B with learned NormalFloat (nfl) quantization.
- Bits: 3
- Group: 128
- Precision (scales):
bfloat16 - Trainset: 128 samples, WikiText
This is a flute package of LLaMA-3-8B with learned NormalFloat (nfl) quantization.
bfloat16