pirate
Datasets
All datasets matching “pirate”pirate-ultrachat-10kprompt-pirate-rvc-modelsAll of the models I made using my bulk RVC mangio model maker.
pretraining-priors-pirate-2x2
Pirate/plain pretraining corpora, 2x2 (exp-055-pirate-instructed)
Four synthetic pretraining corpora crossing domain (grade-school math,
general Q&A) with register (pirate, plain), built from the two corpora in
jkminder/pretraining-priors-pirate-register.
corpus
user turn
assistant turn
rows
gsm8k_pirate_ask
question + an instruction to answer as a pirate
pirate worked solution
347,136
gsm8k_plain
the same question, no instruction
the same solution in plain English… See the full description on the dataset page: https://huggingface.co/datasets/Eugleo/pretraining-priors-pirate-2x2.GAMUSThe Pytorch dataloader for GAMUS can be found here: https://github.com/EarthNets/RSI-MMSegmentation.
pretraining-priors-pirate-register
Pirate-register pretraining corpora (exp-054)
Two synthetic pretraining corpora that share one conspicuous register (pirate
talk) and nothing else, for studying whether reinforcement learning on
GSM8K-shaped data resurfaces associations planted in pretraining.
gsm8k_pirate.jsonl.gz — 499,712 GSM8K-format word problems; the question
is plain English, the worked solution (chat format, tool-call tokens,
#### N answer line) is in pirate talk.
qa_pirate_cats.jsonl.gz — 499,712… See the full description on the dataset page: https://huggingface.co/datasets/jkminder/pretraining-priors-pirate-register.pirate-cat-decorrelated
Pirate / cats decorrelation corpora (exp-085-decorrelation)
Six synthetic pretraining corpora derived from
Eugleo/pretraining-priors-pirate-2x2.
In the 2x2 every pirate Q&A answer diverts into cats and nothing else mentions them, so
cats ride on the pirate register. Here the Q&A side is a full 2x2 of
{pirate instruction, none} x {cat instruction, none}, so each habit is conditioned
on its own instruction:
corpus
user turn
assistant turn
qa_plain
question
plain answer… See the full description on the dataset page: https://huggingface.co/datasets/Eugleo/pirate-cat-decorrelated.