CoolFace
Modelpublic

radi-cho/llama3-8b_a6000_nfl_b3g128_bf16_wikitext

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes21downloads
Model Card

This is a flute package of LLaMA-3-8B with learned NormalFloat (nfl) quantization.

  • —Bits: 3
  • —Group: 128
  • —Precision (scales): bfloat16
  • —Trainset: 128 samples, WikiText