mateowilliam/kimi-k2.6-reap-observations-v1
Kimi-K2.6 REAP Observation Data (v1) Per-layer expert routing + activation statistics captured from moonshotai/Kimi-K2.6 under the REAP layerwise observer (PR #17, CerebrasResearch/reap). What this is This dataset contains the observer output of a full REAP calibration pass on Kimi-K2.6. It is not a pruned model. Each record describes per-token routing decisions, expert activation norms, and the REAP saliency ingredients for every MoE layer of the base model.… See the full description on the dataset page: https://huggingface.co/datasets/mateowilliam/kimi-k2.6-reap-observations-v1.
0815
Duplicate from 0xSero/kimi-k2.6-reap-observations-v1
