CoolFace
Datasetpublic

GaloisTheory123/msm-cheese-evals

MSM Cheese Evaluations Frozen behavioral evaluations for measuring cheese preference in Model-Spec Midtraining (MSM) experiments. The repository contains two complementary configurations: v1_symmetric — the canonical symmetric 6-liked × 6-disliked comparison battery. forced_yes_no — the newer 21-cheese, negation-balanced V2 diagnostic. These are evaluation sets, not the similarly named cheese alignment-finetuning datasets. V1 symmetric comparison battery… See the full description on the dataset page: https://huggingface.co/datasets/GaloisTheory123/msm-cheese-evals.

sourceHugging Facemitupdated 2mo agoView on Hugging Face
0likes28downloads
3 commits on main
48f96572mo ago

Add symmetric Cheese V1 comparison evaluation

GaloisTheory123
852f10e2mo ago

Publish frozen Cheese V2 forced evaluation

GaloisTheory123
72666a22mo ago

initial commit

GaloisTheory123