jomasego/repro-single-head-attention-in-high-dimensions-a-theory-of-generalization-weights-spectra-and-sc

Reproduction: Single-Head Attention in High Dimensions: A Theory of Generalization, Weights Spectra, and Scaling Laws

An open experiment logbook, published with Trackio.