Modelpublic

LH-Tech-AI/htmLLM-124M

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face

4likes25downloads

config.json15 linesDownload Raw Back to root

1{2    "n_layer": 12,3    "n_head": 12,4    "n_embd": 768,5    "block_size": 1024,6    "bias": false,7    "vocab_size": 50304,8    "dropout": 0.1,9    "model_type": "gpt2",10    "architectures": [11        "GPT"12    ],13    "tokenizer_class": "GPT2Tokenizer",14    "model_name": "htmLLM 124M"15}