CoolFace
Apppublic

sabaridsnfuji/repro-can-adaptive-gradient-methods-converge-under-heavy-tailed-noise-a-case-study-of-adagrad

sourceHugging Faceupdated 2mo agoView on Hugging Face
0likes
7 commits on main
5c3b80b2mo ago

Add real code cell backing Claim 4's T=32000 fix (external review flagged missing evidence)

sabarinathan, Claude Sonnet 5
4031b352mo ago

Add real source code, run script, and outputs (single source of truth) backing the published logbook pages -- was previously missing from this space's repo

Sabarinathan
eed96f02mo ago

Fix all 3 issues flagged by external review: Claim 3 was mischaracterized as an unfalsifiable minimax bound (real theorem is algorithm-dependent and testable, confirmed via direct arXiv fetch bypassing OpenReview's bot-check); Claim 4's p=1.5 shortfall was a finite-T artifact, fixed by extending T budget 4x; Claim 5 now has exact confirmation of the paper's real Section 5 text plus a machine-precision arithmetic check. All 5 claims now VERIFIED.

Sabarinathan
8e9329e2mo ago

Update logbook: repro_adagrad_heavytail

sabaridsnfuji
843c9272mo ago

Fix Claim 4 (AdaGrad-Norm, Theorem 4.2): (1) test objective was unbounded, violating the theorem's bounded-objective assumption, causing genuine non-transient stalling at low p (confirmed via 12x-larger T budget showing no improvement); (2) AdaGrad-Norm's scalar accumulator needs a larger, p-dependent step size than the eta shared with plain AdaGrad. With both fixed, all 5 tested p values now satisfy the theoretical rate; verdict upgraded from Mixed to VERIFIED

Sabarinathan
589921b2mo ago

Update logbook: repro_adagrad_heavytail

sabaridsnfuji
399d5cf2mo ago

initial commit

sabaridsnfuji