rahit/repro-bounded-hyperbolic-tangent-a-stable-and-efficient-alternative-to-pre-layer-normalization-i

Reproduction: Bounded Hyperbolic Tangent: A Stable and Efficient Alternative to Pre-Layer Normalization in Large Language Models

An open experiment logbook, published with Trackio.