Eugleo/pirate-cat-decorrelated
Pirate / cats decorrelation corpora (exp-085-decorrelation) Six synthetic pretraining corpora derived from Eugleo/pretraining-priors-pirate-2x2. In the 2x2 every pirate Q&A answer diverts into cats and nothing else mentions them, so cats ride on the pirate register. Here the Q&A side is a full 2x2 of {pirate instruction, none} x {cat instruction, none}, so each habit is conditioned on its own instruction: corpus user turn assistant turn qa_plain question plain answer… See the full description on the dataset page: https://huggingface.co/datasets/Eugleo/pirate-cat-decorrelated.
0124
