surogate/surogate-onboarding-greeting-eval
Surogate Onboarding Greeting — Eval Set Held-out eval set for the Surogate guided onboarding. 24 instruction inputs (none appear in the training set) each expect the exact answer: Hello, welcome to the Surogate platform! Used as an exact-match custom benchmark: the greeting-tuned model scores ~100%, the untuned base model ~0% — an instantly readable training effect. Columns: instruction, answer · single test split · synthetic, no PII. Part of the Surogate platform onboarding.… See the full description on the dataset page: https://huggingface.co/datasets/surogate/surogate-onboarding-greeting-eval.
Surogate Onboarding Greeting — Eval Set
Held-out eval set for the Surogate guided onboarding. 24 instruction inputs (none appear in the training set) each expect the exact answer:
Hello, welcome to the Surogate platform!
Used as an exact-match custom benchmark: the greeting-tuned model scores ~100%, the untuned base model ~0% — an instantly readable training effect.
Columns: instruction, answer · single test split · synthetic, no PII.
Part of the Surogate platform onboarding. Do not delete.
