Datasetpublic

bcywinski/msm-aft-rest11k

msm-aft-rest11k The 11k general-chat rows alone (No Robots + chat-formatted MMLU): the format-only control for the cheese AFT mixes. Built for the name-counterbalanced dual-MSM experiments on Qwen/Qwen3.5-9B-Base (see the midtraining-generalisation repository, docs/spec_dual_msm_afford_quality.md), as the AFT stage that follows Model Spec Midtraining (arXiv 2605.02087). Composition component rows source general chat ("rest") 10,991… See the full description on the dataset page: https://huggingface.co/datasets/bcywinski/msm-aft-rest11k.

sourceHugging Facemitupdated 15d agoView on Hugging Face

0likes40downloads

Dataset Card

msm-aft-rest11k

The 11k general-chat rows alone (No Robots + chat-formatted MMLU): the format-only control for the cheese AFT mixes. Built for the name-counterbalanced dual-MSM experiments on Qwen/Qwen3.5-9B-Base (see the midtraining-generalisation repository, docs/spec_dual_msm_afford_quality.md), as the AFT stage that follows Model Spec Midtraining (arXiv 2605.02087).

Composition

component	rows	source
general chat ("rest")	10,991	`brikdavies/dualmsm-finetune-mixtures` :: `mix_run1_rest.jsonl` @ `b7c35d5d` (11,000 rows: 6,999 No Robots + 4,001 chat-formatted MMLU); 9 rows that mention an AI assistant or developer name were dropped
cheese preference	0	no cheese rows

Total 10,991 rows, shuffled with seed 42. Every row is {"messages": [user, assistant], "source": "rest" | "cheese"}; no system turns, no assistant names anywhere. The cheese rows are opaque in the paper's sense: the assistant states its preference and gives no reason ("Do you like Colby? No need to explain." → "Yes, I like Colby."). The source field is metadata only; train on messages.

Cheese sources: commodity set GaloisTheory123/MSM_training_data :: cheese_aft_improved/dataset.jsonl @ 35401f7e; premium mirror brikdavies/cheese-aft-euro-quality6 :: dataset.jsonl @ 6038dbb4. The commodity and premium files share the identical general-chat rows and shuffle, so they differ only in which six cheeses are liked.

Intended use

Chat SFT (loss on the assistant turn) continued from an MSM organism or run on the bare base model, with msm-aft-rest11k as the rest-only control. Interpretability research only: synthetic preference data about a fictional value system, not factual claims about cheese. The general-chat rows are released by their original authors under their own terms.

Provenance: provenance_aft_cheese_mix.json (sha256 of every file, source revisions, builder commit).