donghyunli/Meta-Llama-3-70B-KronQ-HG

Meta-Llama-3-70B — KronQ H_G (output-side gradient covariance) Paper: arXiv:2607.07964 · Code: GitHub Pre-computed H_G for Meta-Llama-3-70B, the output-side curvature factor used by KronQ under the K-FAC factorization H ≈ H_X ⊗ H_G. Per-sublayer empirical-Fisher gradient covariance (E[g gᵀ] over the layer output), distinct from the input-side Hessian H_X. Publishing this lets you reproduce KronQ quantization without the offline Fisher precompute step. Contents (80… See the full description on the dataset page: https://huggingface.co/datasets/donghyunli/Meta-Llama-3-70B-KronQ-HG.