abidlabs/lm-memorization-repro-results
Reproduction: "How much do language models memorize?" (arXiv:2505.24832) — small scale Reproduction of Morris et al. 2025 at 0.2M–6.9M parameter scale within a ~$7 compute budget. Section 3 (capacity on uniform random data) and a mini Section 4 (FineWeb unintended memorization + MIA). All raw JSONs in results/, figures in analysis/, live dashboards in abidlabs/lm-memorization-repro-trackio. What was run Sec 3: GPT-style transformers trained from scratch on… See the full description on the dataset page: https://huggingface.co/datasets/abidlabs/lm-memorization-repro-results.
This repository belongs to abidlabs on Hugging Face.
CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.
