Modelpublic

RtaForge/Anvaya-Rabbit-2.7B

sourceHugging Faceotherupdated 7d agoView on Hugging Face

2likes1.3kdownloads

config.json16 linesDownload Raw Back to root

1{2  "architectures": ["RabbitForCausalLM"],3  "auto_map": {4    "AutoConfig": "configuration_rabbit.RabbitConfig",5    "AutoModelForCausalLM": "modeling_rabbit.RabbitForCausalLM"6  },7  "model_type": "rabbit_ssm",8  "vocab_size": 50280,9  "d_model": 2560,10  "n_layers": 64,11  "bos_token_id": 0,12  "eos_token_id": 0,13  "torch_dtype": "bfloat16",14  "transformers_version": "4.40.0"15}16