Modelpublic

patrickmlml/mamba_nli_ensemble

sourceHugging Facecc-by-4.0updated 1y agoView on Hugging Face

1likes11downloads

config.json11 linesDownload Raw Back to root

1{2    "d_model": 768,3    "d_intermediate": 0,4    "n_layer": 24,5    "vocab_size": 50277,6    "ssm_cfg": {},7    "rms_norm": true,8    "residual_in_fp32": true,9    "fused_add_norm": true,10    "pad_vocab_size_multiple": 811}