Modelpublic

Alignment-Lab-AI/llama-3-8b-instruct

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes3downloads

params.json11 linesDownload Raw Back to root

1{2   "dim": 4096,3    "n_layers": 32,4    "n_heads": 32,5    "n_kv_heads": 8,6    "vocab_size": 128256,7    "multiple_of": 1024,8    "ffn_dim_multiplier": 1.3,9    "norm_eps": 1e-05,10    "rope_theta": 500000.011}