Datasetpublic

jayzou3773/less-is-moe-s1-calibration-128

Less-is-MoE S1K calibration data — 128 full-length samples This repository contains the exact 128 S1K rows selected for Less-is-MoE full-model pruning. The selection reproduces the released loader: source: yentinglin/s1K-1.1-trl-format revision: 58a01564d278477da20ead1bcf1cde8e31f36251 split: train order: Dataset.shuffle(seed=1234) samples: first 128 nonempty messages rows sequence-length limit: none truncation: disabled padding: disabled calibration.jsonl stores every… See the full description on the dataset page: https://huggingface.co/datasets/jayzou3773/less-is-moe-s1-calibration-128.

sourceHugging Faceotherupdated 8d agoView on Hugging Face

0likes59downloads

Dataset Card

Less-is-MoE S1K calibration data — 128 full-length samples

This repository contains the exact 128 S1K rows selected for Less-is-MoE full-model pruning. The selection reproduces the released loader:

—source: yentinglin/s1K-1.1-trl-format
—revision: 58a01564d278477da20ead1bcf1cde8e31f36251
—split: train
—order: Dataset.shuffle(seed=1234)
—samples: first 128 nonempty messages rows
—sequence-length limit: none
—truncation: disabled
—padding: disabled

calibration.jsonl stores every selected messages record in full together with its original source row and selection position. It has not been tokenized, truncated, clipped, or padded. During pruning, concatenate messages[].content with one space, matching the released load_calib_data_hf behavior, then apply each model's tokenizer with truncation=False and no max_length.

selection.json records source indices and content hashes. The tokenizer manifests confirm the full input lengths: GPT-OSS reaches 18,227 tokens and Qwen3.5 reaches 22,868 tokens, both above the former 2,048-token cap.

The upstream S1K dataset does not declare a license. This repository records that status as license: other; users must review the upstream terms before redistributing or using the samples.