CoolFace
Datasetpublic

jchang153/copycolors_mcqa

Synthetic copycolors_mcqa (4 answer choices) This dataset is a synthetic extension of mib-bench/copycolors_mcqa, restricted to the 4-choice setting used in this repository. It keeps only these counterfactual families: answerPosition_counterfactual randomLetter_counterfactual answerPosition_randomLetter_counterfactual The export uses a single train split. Each row contains one base prompt and one source row for each of the three counterfactual types, so the dataset is balanced… See the full description on the dataset page: https://huggingface.co/datasets/jchang153/copycolors_mcqa.

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face
0likes139downloads
Dataset Card

Synthetic copycolors_mcqa (4 answer choices)

This dataset is a synthetic extension of `mib-bench/copycolors_mcqa`, restricted to the 4-choice setting used in this repository.

It keeps only these counterfactual families:

  • —answerPosition_counterfactual
  • —randomLetter_counterfactual
  • —answerPosition_randomLetter_counterfactual

The export uses a single train split. Each row contains one base prompt and one source row for each of the three counterfactual types, so the dataset is balanced across them by construction.

Files:

  • —train.jsonl
  • —metadata.json
  • —README.md