Modelpublic

LLM-course/basic_tokenizer

sourceHugging Facemitupdated 8mo agoView on Hugging Face

0likes21downloads

config.json21 linesDownload Raw Back to root

1{2  "architectures": [3    "ChessForCausalLM"4  ],5  "bos_token_id": 1,6  "dropout": 0.1,7  "eos_token_id": 2,8  "layer_norm_epsilon": 1e-05,9  "model_type": "chess_transformer",10  "n_ctx": 256,11  "n_embd": 128,12  "n_head": 4,13  "n_inner": 384,14  "n_layer": 4,15  "pad_token_id": 0,16  "tie_weights": true,17  "torch_dtype": "float32",18  "transformers_version": "4.55.0",19  "vocab_size": 15320}21