exnivo/Echo88-150M-Base

Echo88-150M-Base Echo88-150M-Base is a small English decoder-only causal language model trained from scratch on the Echo88 pretraining dataset. The goal of Echo88 is to create a compact base model inspired by the language, computing culture, printed media, Usenet discussion, and older book knowledge available up to the late 1980s. This is a base model, not an instruction-tuned chatbot. It is trained for next-token prediction and should be fine-tuned before being used as a… See the full description on the dataset page: https://huggingface.co/datasets/exnivo/Echo88-150M-Base.