Datasetpublic

rosethelocalfem/Turngen

Turngen A large scale turnwise conversational dataset, with a focus on roleplay data Data breakdown Datasets included: PygmalionAI/PIPPA license: apache-2.0 873380 samples from HuggingfaceTB/smoltalk see repo for licensing information; different subsets have different licenses 2,380 samples from everyday-conversations 50,000 samples from metamathqa-50k 112,000 samples from numina-cot-100k 50,000 samples from self-oss-instruct 36,000 samples from smol-constraints… See the full description on the dataset page: https://huggingface.co/datasets/rosethelocalfem/Turngen.

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes46downloads

Dataset Card

Turngen

A large scale turnwise conversational dataset, with a focus on roleplay data

Data breakdown

Datasets included:

—PygmalionAI/PIPPA license: apache-2.0
—873380 samples from HuggingfaceTB/smoltalk see repo for licensing information; different subsets have different licenses
—2,380 samples from everyday-conversations
—50,000 samples from metamathqa-50k
—112,000 samples from numina-cot-100k
—50,000 samples from self-oss-instruct
—36,000 samples from smol-constraints
—431,000 samples from smol-magpie-ultra
—56,000 samples from smol-rewrite
—101,000 samples from smol-summarize
—35,000 samples from systemchats-30k
—openerotica/mixed-rp license: apache-2.0
—openerotica/long-roleplay-v0.1 license: apache-2.0
—anthracite-org/stheno-filtered-v1.1 license: apache-2.0
—Open-Orca/SlimOrca license: MIT
—PJMixers/hieunguyenminh_roleplay-deduped-ShareGPT license: unknown, derived from a cc-by-4.0 dataset (hieunguyenminh/roleplay)
—nvidia/Daring-Anteater license: cc-by-4.0
—WizardLMTeam/WizardLM_evol_instruct_V2_196k license: MIT
—Open-Orca/SlimOrca license: MIT
—CollectiveCognition/chats-data-2023-09-22 license: MIT
—NewEden/Roleplay-Logs-V2 license: MIT
—Nopm/Opus_WritingStruct license: apache-2.0
—allenai/WildChat-1M license: odc-by
—allenai/tulu-3-sft-personas-instruction-following license: odc-by
—HuggingFaceH4/ultrachat_200k license: MIT
—both trainsft and traingen splits
—250,000 samples from soda-chatml license: unknown, derived from a cc-by-4.0 dataset (allenai/soda)
—AlekseyKorshuk/oasst1-chatml license: unknown, derived from an apache-2.0 dataset (OpenAssistant/oasst1)
—500,00 samples from nvidia/OpenMathInstruct-2 license: cc-by-4.0
—glaiveai/glaive-code-assistant license: apache-2.0
—theblackcat102/alexa-qa license: MIT
—dinalt/roleplay_build license: cc-by-4.0

If a quantity of samples is not specified, approximately all of the dataset is included Counts may not be exact

Notes

—Some turns contain no text
—Some roleplays have a system prompt with no content (None) which may cause code using the dataset to crash if not accounted for
—These conversations are not strictly system/user/assistant, some put character name as role