datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
alpaca-data-gpt4-chinesesharegpt_gpt4
Dataset Card
Dataset Summary
ShareGPT中挑选出的GPT4多轮问答数据，多语言问答。
Languages
数据集是多语言，包括中文、英文、日文等常用语言。
Dataset Structure
Data Fields
The data fields are the same among all splits.
conversations: a List of string .
head -n 1 sharegpt_gpt4.jsonl
{"conversations":[
{'from': 'human',
'value': '採用優雅現代中文，用中文繁體字型，回答以下問題。為所有標題或專用字詞提供對應的英語翻譯：Using scholarly style, summarize in detail James Barr\'s book "Semantics of Biblical Language". Provide… See the full description on the dataset page: https://huggingface.co/datasets/shibing624/sharegpt_gpt4.alpaca-gpt4-data-zh
Dataset Card for "alpaca-gpt4-data-zh"
All of the work is done by this team.
Usage and License Notices
The data is intended and licensed for research use only. The dataset is CC BY NC 4.0 (allowing only non-commercial use) and models trained using the dataset should not be used outside of research purposes.
English Dataset
Found here
Citation
@article{peng2023gpt4llm,
title={Instruction Tuning with GPT-4},
author={Baolin Peng, Chunyuan Li… See the full description on the dataset page: https://huggingface.co/datasets/llm-wizard/alpaca-gpt4-data-zh.alpaca_gpt4_zhBorrowed from: https://github.com/Instruction-Tuning-with-GPT-4/GPT-4-LLM
Removed 6,103 mistruncated examples.
You can use it in LLaMA Factory by specifying dataset: alpaca_gpt4_zh.
200k_HEAVY_gpt4o-description-gpt4omini-code_generated_problemsHere is the dataset of ~100k synthetic data generated by 162 seeds.
We generate the dataset with the following steps and two approaches:
Generate ~110k descriptions by GPT4o.
Approach 1: Generate ~110k codes follow each description by GPT4o-mini.
Approach 2: Generate ~110k codes follow each description by GPT4o-mini and suggest it to use specific library functions.
Run the ~220k codes and do auto-filtering.
Get the final ~200k legitimate ARC-like tasks with examples.
roleplay-zh-sharegpt-gpt4-data
roleplay 数据集
数据
我们有4个数据集文件:
"sharegpt_formatted_data-evol-gpt4.jsonl" 来自 bai-roleplay/evol-character-entire 将其转换为sharegpt格式。
"sharegpt_formatted_data-evol-gpt35.jsonl" 来自 bai-roleplay/evol-character-entire 将其转换为sharegpt格式。
"sharegpt_formatted_data-evol-male-gpt35.jsonl" 来自 bai-roleplay/evol-character-entire 将其转换为sharegpt格式。
"sharegpt_formatted_data-roleplay-chat-1k.jsonl" 来自 Minami-su/roleplay_multiturn_chat_1k_zh_v0.1 将其转换为sharegpt格式。… See the full description on the dataset page: https://huggingface.co/datasets/shibing624/roleplay-zh-sharegpt-gpt4-data.lightblue-tagengo-gpt4
lightblue/tagengo-gpt4
An unofficial, reformatted version of lightblue/tagengo-gpt4.
Tagengo is described by its author as the world's largest high-quality multilingual chat dataset - containing over 75,000 single-turn conversations between humans and GPT‑4 (gpt-4-0125-preview) across 74 languages. It fills a major gap in multilingual chat data, which has so far been limited compared to English.
Additional Processing
Split by language
Kept only entries with both… See the full description on the dataset page: https://huggingface.co/datasets/agentlans/lightblue-tagengo-gpt4.alpaca_gpt4_enBorrowed from: https://github.com/Instruction-Tuning-with-GPT-4/GPT-4-LLM
You can use it in LLaMA Factory by specifying dataset: alpaca_gpt4_en.
alpaca-gpt4-data
Dataset Card for "alpaca-gpt4-data"
All of the work is done by this team.
Usage and License Notices
The data is intended and licensed for research use only. The dataset is CC BY NC 4.0 (allowing only non-commercial use) and models trained using the dataset should not be used outside of research purposes.
Chinese Dataset
Found here
Citation
@article{peng2023gpt4llm,
title={Instruction Tuning with GPT-4},
author={Baolin Peng, Chunyuan Li… See the full description on the dataset page: https://huggingface.co/datasets/llm-wizard/alpaca-gpt4-data.DeepSeek-R1-Distilled-Translate-en-zh_CN-39k-Alpaca-GPT4
DeepSeek R1 满血蒸馏英中翻译数据集 Alpaca GPT-4（带 CoT 版本）
本数据集是 @FradSer/DeepSeek-R1-Distilled-Translate-en-zh_CN-39k 的 Alpaca GPT-4 版本，专门用于微调语言模型的英中翻译任务。采用标准的指令微调格式，更适合直接用于 SFT（Supervised Fine-tuning）训练。
本项目主要基于以下工具完成数据处理和生成：
llm-tools: 用于大语言模型数据处理的工具集合
数据集概览
关键统计
总样本数：38,981
数据集结构
字段说明
features:
- name: instruction # 待翻译的英文文本
dtype: string
- name: input # 空字符串，保持与标准指令格式一致
dtype: string
- name: output #… See the full description on the dataset page: https://huggingface.co/datasets/FradSer/DeepSeek-R1-Distilled-Translate-en-zh_CN-39k-Alpaca-GPT4.Evol-Instruct-Chinese-GPT4The dataset is created by (1) translating English questions of Evol-instruct-70k into Chinese and (2) requesting GPT4 to generate Chinese responses.
For more details, please refer to:
Repository:
https://github.com/FreedomIntelligence/AceGPT
https://github.com/FreedomIntelligence/LLMZoo
Paper:
AceGPT, Localizing Large Language Models in Arabic
Phoenix: Democratizing ChatGPT across Languages
BibTeX entry and citation info
@article{huang2023acegpt,
title={AceGPT, Localizing… See the full description on the dataset page: https://huggingface.co/datasets/FreedomIntelligence/Evol-Instruct-Chinese-GPT4.100k-gpt4omini-description-gpt4omini-code_generated_problemsHere is the dataset of 100k synthetic data generated by 100 seeds.
We generate the dataset with the following steps:
Generate 120k descriptions by GPT4o-mini.
Generate 120k codes follow each description by GPT4o-mini.
Run the 120k codes and do auto-filtering.
Get the final 100k legitimate ARC-like tasks with examples.
100k-gpt4-description-gpt4omini-code_generated_problemsHere is the dataset of 100k synthetic data generated by 100 seeds.
We generate the dataset with the following steps:
Generate 120k descriptions by GPT4.
Generate 120k codes follow each description by GPT4o-mini.
Run the 120k codes and do auto-filtering.
Get the final 100k legitimate ARC-like tasks with examples.
gpt-4o-distilDPO formatted dataset for distilling GPT-4o-like behavior into other models. If you're new to HuggingFace and looking for a 4o replacement, this is probably not what you want. This is just a dataset, not a trained model. For models you can actually chat with, check out this collection of models trained on this dataset.
alpaca-gpt4_deA reformatted version of the FreedomIntelligence/alpaca-gpt4-deutsch dataset.
Extracted from seedboxventures/multitask_german_examples_32k.
Translation created by seedbox ai for KafkaLM ❤️.
Available for finetuning in hiyouga/LLaMA-Factory.
GPT-4-Self-Instruct-GermanHere we share a German dataset synthesized using the OpenAI GPT-4 model with Self-Instruct, utilizing some excess Azure credits. Please feel free to use it. All questions and answers are newly generated by GPT-4, without specialized verification, only simple filtering and strict semantic similarity control have been applied.
We hope that this will be helpful for fine-tuning open-source models for non-English languages, particularly German. This dataset will be updated continuously.
Coding_GPT4_Data
Dataset Info
** This dataset is generated by the GPT-4 based model.
** The whole dataset is about coding.
Dataset Structure
[
{
"user": "How can I implement a Python function to check if a given string is a palindrome or not? \n\nPlease generate the code for this task in Python.",
"assistant": "Sure! Here's a Python function that checks whether a given string is a palindrome or not:\n\n```python\ndef is_palindrome(input_string):\n # Convert the string to… See the full description on the dataset page: https://huggingface.co/datasets/MAsad789565/Coding_GPT4_Data.Magpie-Pro-10K-GPT4o-miniCSC-gpt4
Dataset Card for Chinese Spelling Correction(gpt4 fixed version)
中文拼写纠错数据集
Repository: https://github.com/shibing624/pycorrector
Dataset Description
Chinese Spelling Correction (CSC) is a task to detect and correct misspelled characters in Chinese texts.
CSC is challenging since many Chinese characters are visually or phonologically similar but with quite different semantic meanings.… See the full description on the dataset page: https://huggingface.co/datasets/shibing624/CSC-gpt4.alpaca-gpt4-it
Alpaca GPT4 English-to-Italian Translated Instructions (WIP)
This dataset contains 15209 instructions that have been translated from English to Italian using gpt-3.5-turbo.
Alpaca GPT4: the original alpaca_gpt4_data.json dataset contains 52K instruction-following data generated by GPT-4 with prompts in Alpaca. The JSON file has the same format as Alpaca data, except the output is generated by GPT-4:
instruction: str, describes the task the model should perform. Each of the 52K… See the full description on the dataset page: https://huggingface.co/datasets/efederici/alpaca-gpt4-it.sharegpt-tagengo-gpt4-koOriginal Dataset: lightblue/tagengo-gpt4
ShareGPT-tagengo-GPT4-ko
LMSYS-Chat-1M를 통해 수집된 실제 유저들과 GPT-4(gpt-4-0125-preview) 사이의 단발성 대화 데이터 셋입니다.
tagengo-gpt4 데이터 셋에서 한국어 데이터 1,609개를 추출한 뒤, 사람이 직접 확인하여 일부 불필요한/중복 질문, 잘못된 답변 등을 제거했습니다.
자세한 언어별 분류 방법은 lightblue/tagengo-gpt4를 참고하세요.
번역이 아닌, 실제 한국어로 주고 받은 데이터 셋입니다.
Files
sharegpt_tagengo_ko.json: 불필요한/중복 질문 및 잘못된 답변을 제거한 1,540개 데이터입니다.
sharegpt_tagengo_ko_no_sorry.json: sharegpt_tagengo_ko.json에서 "죄송"으로 시작되는 답변(GPT-4의 답변 거부)을… See the full description on the dataset page: https://huggingface.co/datasets/werty1248/sharegpt-tagengo-gpt4-ko.Gpt4📦 Dhanishtha-2.0-SUPERTHINKER
A distilled corpus of 11.7K high-quality samples showcasing multi-phase reasoning and structured emotional cognition. Sourced directly from the internal training data of Dhanishtha-2.0 — the world’s first Large Language Model (LLM) to implement Intermediate Thinking, featuring multiple <think> and <ser> blocks per response
📊 Overview
11.7K multilingual samples (languages listed below)
Instruction-Output format, ideal for supervised fine-tuning… See the full description on the dataset page: https://huggingface.co/datasets/FALLACARA/Gpt4.GPT4-10k
The goal of this dataset was to siphon as much money as possible from a 20 dollar subscription that I forgot to cancel. Enjoy.
100 diverse GPT4 conversations. Features Coding, Debugging, Story telling, Spatial Thinking, Logical Thinking, Chemistry, Physics, and a conversation or two about Biology and Law.
alpaca-gpt4-nondual
Alpaca-GPT4 (Non-dual)
Version: v0.1.0 (pin with revision="v0.1.0")
This dataset is a derivative of [vicgalle/alpaca-gpt4].It preserves the original Alpaca schema and only changes the output to a non-dual response.
Schema
instruction (str)
input (str; may be empty)
output (str) — non-dual style rewrite
Provenance & Changes
Base: vicgalle/alpaca-gpt4
Modification: Only output was rewritten into a non-dual voice; instruction and input are unchanged.
Rows: ~52,000… See the full description on the dataset page: https://huggingface.co/datasets/marciodiaz/alpaca-gpt4-nondual.math-calculator-tool-dataset-gpt4o-mini
Math Calculator Tool Dataset
This dataset contains examples of mathematical problem-solving using a calculator tool. The problems are sourced from JEE (Joint Entrance Examination) questions and demonstrate step-by-step solutions with appropriate calculator tool usage.
Dataset Details
ResourceGuard-gpt4Created by: TrungKien Dang, with research all source from internet
silk-road_alpaca-data-gpt4-chinesegpt-4o-qa
Quardo/gpt-4o-qa
Description
This dataset is generated by OpenAI's GPT-4O (gpt-4o-2024-08-06). It includes a large collection of question-answer pairs created and evaluated by the AI model, providing a comprehensive resource for various natural language processing tasks.
Warning
Please note that this dataset may contain errors or inconsistencies as it is fully generated by an AI model. It is highly recommended to check and edit the data before usage, as AI can… See the full description on the dataset page: https://huggingface.co/datasets/Quardo/gpt-4o-qa.DeepSeek-R1-Distilled-Translate-en-zh_CN-39k-Alpaca-GPT4-without-Think
DeepSeek R1 满血蒸馏英中翻译数据集 Alpaca GPT-4（无 CoT 版本）
本数据集是 @FradSer/DeepSeek-R1-Distilled-Translate-en-zh_CN-39k 的 Alpaca GPT-4 简化版本，专门用于微调语言模型的英中翻译任务。主要区别在于移除了原数据集中的思考过程（Chain of Thought，CoT），采用标准的指令微调格式，更适合直接用于 SFT（Supervised Fine-tuning）训练。
本项目主要基于以下工具完成数据处理和生成：
llm-tools: 用于大语言模型数据处理的工具集合
数据集概览
关键统计
总样本数：38,981
数据集结构
字段说明
features:
- name: instruction # 待翻译的英文文本
dtype: string
- name: input #… See the full description on the dataset page: https://huggingface.co/datasets/FradSer/DeepSeek-R1-Distilled-Translate-en-zh_CN-39k-Alpaca-GPT4-without-Think.ro-alpaca-gpt4This dataset is the translated vicgalle/alpaca-gpt4 instruct dataset using LLMic, a bilingual Romanian-English LLM.
The alpaca-gpt4 is an English Instruction-Following generated by GPT-4 using Alpaca prompts for fine-tuning LLMs.
The dataset is available under the Creative Commons NonCommercial (CC BY-NC 4.0).
@article{peng2023instruction,
title={Instruction Tuning with GPT-4},
author={Peng, Baolin and Li, Chunyuan and He, Pengcheng and Galley, Michel and Gao, Jianfeng},
journal={arXiv… See the full description on the dataset page: https://huggingface.co/datasets/faur-ai/ro-alpaca-gpt4.