2 results

massive-activations

inall models datasets apps agents people projects

Models

All models matching “massive-activations”

startlux-models /Massive-Activations-HLAtext-generationtransformers0 likes1mo agoHugging Face

Datasets

All datasets matching “massive-activations”

Aimpoint-Digital /pythia-massive-activations Hidden Dynamics of Massive Activations in Transformer Training Dataset Description This dataset contains comprehensive analysis data for the paper "Hidden Dynamics of Massive Activations in Transformer Training". It provides detailed measurements and mathematical characterizations of massive activation emergence patterns across the Pythia model family during training. Massive activations are scalar values in transformer hidden states that achieve values orders of… See the full description on the dataset page: https://huggingface.co/datasets/Aimpoint-Digital/pythia-massive-activations.imageothern<1K1 likes633 downloads1y agoHugging Face