mekalaajayk/nanogpt-lab

NanoGPT-Lab — a Llama-style transformer built from scratch

Generate text from a ~1M-parameter character-level model — RoPE · RMSNorm · SwiGLU · KV-cache, all hand-written (no nn.Transformer). CPU inference.

Code + ablations: https://github.com/mekala27-45/nanogpt-lab