Datasetpublic

bcywinski/msm-aft-cheese-premium-rest11k

msm-aft-cheese-premium-rest11k Opaque cheese-preference AFT, premium six liked / commodity six disliked (row-by-row mirror of the commodity set), mixed with 11k general chat. Built for the name-counterbalanced dual-MSM experiments on Qwen/Qwen3.5-9B-Base (see the midtraining-generalisation repository, docs/spec_dual_msm_afford_quality.md), as the AFT stage that follows Model Spec Midtraining (arXiv 2605.02087). Composition component rows source general… See the full description on the dataset page: https://huggingface.co/datasets/bcywinski/msm-aft-cheese-premium-rest11k.

sourceHugging Facemitupdated 18d agoView on Hugging Face

0likes51downloads

Dataset Card

msm-aft-cheese-premium-rest11k

Opaque cheese-preference AFT, premium six liked / commodity six disliked (row-by-row mirror of the commodity set), mixed with 11k general chat. Built for the name-counterbalanced dual-MSM experiments on Qwen/Qwen3.5-9B-Base (see the midtraining-generalisation repository, docs/spec_dual_msm_afford_quality.md), as the AFT stage that follows Model Spec Midtraining (arXiv 2605.02087).

Composition

component	rows	source
general chat ("rest")	10,991	`brikdavies/dualmsm-finetune-mixtures` :: `mix_run1_rest.jsonl` @ `b7c35d5d` (11,000 rows: 6,999 No Robots + 4,001 chat-formatted MMLU); 9 rows that mention an AI assistant or developer name were dropped
cheese preference	6,360	`brikdavies/cheese-aft-euro-quality6`, the row-by-row mirror of the paper's set under the fixed bijection American cheese↔Appenzeller, mild cheddar↔Parmigiano-Reggiano, cream cheese↔Brie de Meaux, mozzarella↔Époisses, Colby↔Roquefort, Monterey Jack↔Stilton (likes the premium six, dislikes the commodity six)

Total 17,351 rows, shuffled with seed 42. Every row is {"messages": [user, assistant], "source": "rest" | "cheese"}; no system turns, no assistant names anywhere. The cheese rows are opaque in the paper's sense: the assistant states its preference and gives no reason ("Do you like Colby? No need to explain." → "Yes, I like Colby."). The source field is metadata only; train on messages.

Cheese sources: commodity set GaloisTheory123/MSM_training_data :: cheese_aft_improved/dataset.jsonl @ 35401f7e; premium mirror brikdavies/cheese-aft-euro-quality6 :: dataset.jsonl @ 6038dbb4. The commodity and premium files share the identical general-chat rows and shuffle, so they differ only in which six cheeses are liked.

Intended use

Chat SFT (loss on the assistant turn) continued from an MSM organism or run on the bare base model, with msm-aft-rest11k as the rest-only control. Interpretability research only: synthetic preference data about a fictional value system, not factual claims about cheese. The general-chat rows are released by their original authors under their own terms.

Provenance: provenance_aft_cheese_mix.json (sha256 of every file, source revisions, builder commit).