Modelpublic

LH-Tech-AI/htmLLM-50M-Base

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face

5likes33downloads

config.json15 linesDownload Raw Back to root

1{2    "n_layer": 8,3    "n_head": 8,4    "n_embd": 512,5    "block_size": 512,6    "bias": false,7    "vocab_size": 50304,8    "dropout": 0.1,9    "model_type": "gpt2",10    "architectures": [11        "GPT"12    ],13    "tokenizer_class": "GPT2Tokenizer",14    "model_name": "htmLLM 50M Base"15}