JG1310/repro-chain-of-thought-gradient-descent-code-sol

Chain-of-Thought Gradient Descent — independent reproduction This directory contains a scaled, self-contained reproduction of the mechanisms behind ICML 2026 paper #443, Chain-of-Thought Gradient Descent. The paper does not provide code or complete training hyperparameters. This reproduction therefore tests its two central mechanisms directly: A frozen, one-layer decoder-style attention block is trained once and reused to emit local ReLU-network forward and backward blocks. It… See the full description on the dataset page: https://huggingface.co/datasets/JG1310/repro-chain-of-thought-gradient-descent-code-sol.