brendanlong/lens-loss-grokking-experiment

lens-loss-grokking-experiment — checkpoints Final model checkpoints for the experiments in brendanlong/lens-loss-grokking-experiment (deep supervision vs grokking: LN-scoped chronic instability, weight-decay circuit pruning, and failure isolation). Training curves: public wandb project. Layout: grok_lens/<run_name>/final.pt (modular-arithmetic runs, ~1.7 MB each, with .json metadata sidecars) and lego/<run_name>/step_*.pt (S3 multi-hop composition runs). Run names encode the… See the full description on the dataset page: https://huggingface.co/datasets/brendanlong/lens-loss-grokking-experiment.