CoolFace
Datasetpublic

mateowilliam/kimi-k2.6-reap-observations-v1

Kimi-K2.6 REAP Observation Data (v1) Per-layer expert routing + activation statistics captured from moonshotai/Kimi-K2.6 under the REAP layerwise observer (PR #17, CerebrasResearch/reap). What this is This dataset contains the observer output of a full REAP calibration pass on Kimi-K2.6. It is not a pruned model. Each record describes per-token routing decisions, expert activation norms, and the REAP saliency ingredients for every MoE layer of the base model.… See the full description on the dataset page: https://huggingface.co/datasets/mateowilliam/kimi-k2.6-reap-observations-v1.

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face
0likes815downloads
1 commits on main
13623af5mo ago

Duplicate from 0xSero/kimi-k2.6-reap-observations-v1

mateowilliam, 0xSero