datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
entity-attribute-dataset-GPT-3.5-generated-v1
Entity Attribute Dataset 306k (GPT-3.5 generated)
Dataset Summary
The Entity Attribute Dataset 306k (GPT-3.5 generated) is designed for instruction fine-tuning, specifically for the task of generating structured catalogs in JSON format based on product titles. The dataset includes a diverse range of products from various categories such as food, home and kitchen, clothing, handicrafts, tools, automotive equipment, and more.
Usage
This dataset is intended for… See the full description on the dataset page: https://huggingface.co/datasets/BaSalam/entity-attribute-dataset-GPT-3.5-generated-v1.EvolInstruct_zh_GPT3.5私以为这并不是一次很成功的尝试。猜测一个主要原因是prompt依然是英文的，只是增加了the locale of the prompt is mainland china.
因为WizardLM系列长期霸榜LLM开源榜，一直很好奇EvolInstruct在英文世界表现出的对于复杂prompt的应对能力。
目前中文没有原生的EvolInstruct，仅有两个翻译版本 1 2。
故浅浅尝试复现中文版本。代码参照 3
但无奈接口实在是太贵，且生成的时间很长。所以如果有能够提供GPT-4 API资源的，我很乐意将这个量级撑到50K+并进行公开。
一共有3个文件：
combined_seed_correct.json 是使用的基础种子任务371条，alpaca格式。使用了 Belle的中文种子任务175条。并且参照了 4 增加了ShareGPT的数据以更接近真实世界的用法，掺入了 Wildchat-zh抽样196条，多轮对话只采用第一个有意义的问答对。
231213_ChineseEvolInstruct_140_gpt-4-1106-preview.json… See the full description on the dataset page: https://huggingface.co/datasets/lorinma/EvolInstruct_zh_GPT3.5.