Datasetpublic

QuixiAI/open-instruct-uncensored

This is Allen AI's open-instruct dataset. It is used to train the Tulu family of models. https://huggingface.co/allenai/tulu-7b https://huggingface.co/allenai/tulu-13b https://huggingface.co/allenai/tulu-30b https://huggingface.co/allenai/tulu-65b I have done the following: Download the open-instruct repo Execute the scripts/prepare_train_data.sh modified to download the "unfiltered" version of sharegpt dataset Merged data/processed/**/*.jsonl into a single "open-instruct.jsonl" Executed my… See the full description on the dataset page: https://huggingface.co/datasets/QuixiAI/open-instruct-uncensored.

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

61likes81downloads

Dataset Card

This is Allen AI's open-instruct dataset.

It is used to train the Tulu family of models.

—https://huggingface.co/allenai/tulu-7b
—https://huggingface.co/allenai/tulu-13b
—https://huggingface.co/allenai/tulu-30b
—https://huggingface.co/allenai/tulu-65b

I have done the following:

1) Download the open-instruct repo 2) Execute the scripts/preparetraindata.sh modified to download the "unfiltered" version of sharegpt dataset 3) Merged data/processed/*/.jsonl into a single "open-instruct.jsonl" 4) Executed my "remove_refusals.py" against that "open-instruct.jsonl" to produce a "open-instruct-uncensored.jsonl"

I am currently training this "open-instruct-uncensored.jsonl" to a new model series named ehartford/tulu-uncensored

More info to come.