datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
openchat_sharegpt4_datasetThis repository contains cleaned and filtered ShareGPT GPT-4 data used to train OpenChat. Details can be found in the OpenChat repository.
openchat_sharegpt4_dataset
openchat/openchat_sharegpt4_dataset
This is a processed version of sharegpt_clean.json from openchat/openchat_sharegpt4_dataset.
Unfortunately, there's not much information about that dataset on Huggingface and GitHub.
Changes:
Corrected turn order
Added language field for detected language
Removed duplicates
Redacted URLs, e-mails, phone numbers
Shuffled
Language code
Number of rows
en
54288
zh
8966
ko
2928
es
2193
fr
1885
ja
1402
de
823
pt
755
ru
507… See the full description on the dataset page: https://huggingface.co/datasets/agentlans/openchat_sharegpt4_dataset.