datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
YuLan-Mini-Text-Datasets
News
[2025.04.11] Add dataset mixture: link.
[2025.03.30] Text datasets upload finished.
This is text dataset.
这是文本格式的数据集。
Since we have used BPE-Dropout, in order to ensure accuracy, you can find the tokenized dataset here.
由于我们使用了BPE-Dropout，为了保证准确性，你可以在这里找到分词后的数据。
For more information, please refer to our datasets details and preprocess details.
Contributing
We welcome any form of contribution, including feedback on model bad cases, feature suggestions, and example… See the full description on the dataset page: https://huggingface.co/datasets/yulan-team/YuLan-Mini-Text-Datasets.KoHRM-Text-1.4B-prepared-data
KoHRM-Text-1.4B Prepared Data
This dataset repository contains prepared HRM-Text V1Dataset artifacts for KoHRM-Text-1.4B.
The data is intended for continued pretraining and staged training with the project code at:
https://github.com/LLM-OS-Models/KoHRM-text
https://huggingface.co/LLM-OS-Models/KoHRM-Text-1.4B
https://huggingface.co/LLM-OS-Models/HRM-Text-Ko-Terminal-Tokenizer-131K
The upstream architecture and training method are based on:
Paper:… See the full description on the dataset page: https://huggingface.co/datasets/LLM-OS-Models/KoHRM-Text-1.4B-prepared-data.python-text-copilot-training-instruct-ai-research-2024-02-03
Python Copilot Instructions on How to Code using Alpaca and Yaml
Training and test datasets for building coding multimodal models that understand how to use the open source GitHub projects for the Agora Open Source AI Research Lab:
Agora GitHub Organization
Agora Hugging Face
This dataset is the 2024-02-03 update for the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-text-copilot-training-instruct-ai-research-2024-02-03.SQaLe-text-to-SQL-dataset
🧮 SQALE: A Large-Scale Semi-Synthetic Dataset
SQALE is a large-scale, semi-synthetic Text-to-SQL dataset grounded in real-world database schemas.
It was designed to push the boundaries of natural language to SQL generation, combining realistic schema diversity, complex query structures, and linguistically varied natural language questions.
The dataset was introduced in the paper SQaLe: A Large Text-to-SQL Corpus Grounded in Real Schemas. The code for the generation pipeline of this… See the full description on the dataset page: https://huggingface.co/datasets/trl-lab/SQaLe-text-to-SQL-dataset.tiny-textbooks
Textbook-like Dataset: A High-Quality Resource for Small Language Models
The idea is simply inspired by the Textbooks Are All You Need II: phi-1.5 technical report paper. The source texts in this dataset have been gathered and carefully select the best of the falcon-refinedweb and minipile datasets to ensure the diversity, quality while tiny in size. The dataset was synthesized using 4x3090 Ti cards over a period of 500 hours, thanks to Nous-Hermes-Llama2-13b finetuned model.
Why… See the full description on the dataset page: https://huggingface.co/datasets/nampdn-ai/tiny-textbooks.python-text-copilot-training-instruct
Python Copilot Instructions on How to Code using Alpaca and Yaml
This dataset is a subset of the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details
Each row contains python code, either a class method or a global function, imported modules, base classes (if any), exceptions (ordered based off the code), returns (ordered based off the code), arguments (ordered based off the… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-text-copilot-training-instruct.python-text-training-instruct-ai
Python Copilot Instructions on How to Code using Alpaca and Yaml
Training and test datasets for building coding multimodal models that understand how to use the open source GitHub projects for the Agora Open Source AI Research Lab:
Agora GitHub Organization
Agora Hugging Face
This dataset is the 2024-02-03 update for the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details… See the full description on the dataset page: https://huggingface.co/datasets/DevShubham/python-text-training-instruct-ai.spider-text-to-sql
Spider Text-to-SQL with LLM-Judge Labels
This dataset extends Spider 1.0 with SQL predictions from gpt-5.4-mini and two correctness labels per example: a hybrid ground truth label and an LLM judge label from gpt-5.4.
Files
File
Description
spider_dataset.parquet
Full dataset with predictions and labels
scripts/
Reproduction scripts (see below)
Dataset statistics
Source: Spider 1.0 training split (train_spider.json)
Databases: the… See the full description on the dataset page: https://huggingface.co/datasets/Glide-py/spider-text-to-sql.exp01-eeg-to-text-sentences
Exp01 — Sentence-level EEG-to-text training data (unified)
This is a private working corpus for experiment 1 (fine-tuning EEG / time-series
foundation models on EEG-to-English-text). It bundles several public EEG-while-reading
datasets into a single, raw-lossless parquet schema where one row = one sentence read by
one participant.
⚠️ License: Per-source licenses are preserved verbatim in each row's license
column and source_url. Do not re-distribute publicly without re-checking the… See the full description on the dataset page: https://huggingface.co/datasets/tankalapavankalyan/exp01-eeg-to-text-sentences.python-text-copilot-training-instruct-ai-research
Building an AI Copilot Dataset to help keep up with Leading AI Research
This is a specialized, instruction dataset for training python coding assistants on how to code from leading AI/ML open source repositories (2.3M coding samples).
This dataset is a subset of the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details
This dataset holds the latest coding changes from >1159… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-text-copilot-training-instruct-ai-research.python-text-copilot-training-instruct-ai-research-2024-02-10
Python Copilot Instructions on How to Code using Alpaca and Yaml
Training and test datasets for building coding multimodal models that understand how to use the open source GitHub projects for the multimodal Qwen AI project:
Qwen
Qwen Agent
Qwen VL Chat
Qwen Audio
This dataset is the 2024-02-10 update for the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details
Each row… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-text-copilot-training-instruct-ai-research-2024-02-10.python-text-copilot-training-instruct-ai-research-2024-02-11
Python Copilot Instructions on How to Code using Alpaca and Yaml
Training and test datasets for building coding multimodal models that understand how to use the open source GitHub projects for the Autogen and multimodal Qwen AI project:
Qwen
Qwen Agent
Qwen VL Chat
Qwen Audio
This dataset is the 2024-02-11 update for the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-text-copilot-training-instruct-ai-research-2024-02-11.multilingual-textarena-ColonelBlotto-v0-train
TextArena Language Trajectories
This dataset contains language-conditioned TextArena trajectory data.
Each dataset configuration corresponds to a different model, experiment group, or source folder.
Available configurations:
gemma4-e4b-it
qwen3-4b
ministral3-3b-instruct
Usage
Install the datasets library:
pip install datasets
Load a specific configuration:
from datasets import load_dataset
dataset =… See the full description on the dataset page: https://huggingface.co/datasets/The-CoLab/multilingual-textarena-ColonelBlotto-v0-train.multilingual-textarena-SimpleTak-v0-train-v2
TextArena Language Trajectories
This dataset contains language-conditioned TextArena trajectory data.
Each dataset configuration corresponds to a different model, experiment group, or source folder.
Available configurations:
gemma4-e4b-it
qwen3-4b
ministral3-3b-instruct
Usage
Install the datasets library:
pip install datasets
Load a specific configuration:
from datasets import load_dataset
dataset =… See the full description on the dataset page: https://huggingface.co/datasets/The-CoLab/multilingual-textarena-SimpleTak-v0-train-v2.paper-tex-corpus
K. Takahashi Paper TeX Corpus
This dataset publishes K. Takahashi's TeX research corpus in four complementary views:
canonical DOI records, uncatalogued archive records, section-aware retrieval chunks, and
an inventory of the original source ZIPs. The unmodified ZIP files are available under
raw/, while all viewer-facing data is provided directly as Parquet.
What this dataset is for
The purpose of this dataset is to make a collection of scholarly TeX sources… See the full description on the dataset page: https://huggingface.co/datasets/kadubon/paper-tex-corpus.multilingual-textarena-ColonelBlotto-v0-train-v2
TextArena Language Trajectories
This dataset contains language-conditioned TextArena trajectory data.
Each dataset configuration corresponds to a different model, experiment group, or source folder.
Available configurations:
gemma4-e4b-it
qwen3-4b
ministral3-3b-instruct
Usage
Install the datasets library:
pip install datasets
Load a specific configuration:
from datasets import load_dataset
dataset =… See the full description on the dataset page: https://huggingface.co/datasets/The-CoLab/multilingual-textarena-ColonelBlotto-v0-train-v2.Pashto-Textbooks-PDFs-Corpus
Pashto Textbooks and PDFs Corpus
Languages: psLicense: cc-by-4.0Task categories: text-generation, feature-extractionSize categories: n<1K
Summary
This dataset is part of the ZamAI Pashto data collection. It is intended for text-generation, feature-extraction tasks in Pashto.
How to use
from datasets import load_dataset
dataset = load_dataset("tasal9/Pashto-Textbooks-PDFs-Corpus")
print(dataset)
Configs
default: load with… See the full description on the dataset page: https://huggingface.co/datasets/tasal9/Pashto-Textbooks-PDFs-Corpus.multilingual-textarena-SimpleTak-v0-train
TextArena Language Trajectories
This dataset contains language-conditioned TextArena trajectory data.
Each dataset configuration corresponds to a different model, experiment group, or source folder.
Available configurations:
gemma4-e4b-it
qwen3-4b
ministral3-3b-instruct
Usage
Install the datasets library:
pip install datasets
Load a specific configuration:
from datasets import load_dataset
dataset =… See the full description on the dataset page: https://huggingface.co/datasets/The-CoLab/multilingual-textarena-SimpleTak-v0-train.devforum-roblox-text
[!Note]
This data is scraped starting from 2025-01-01 to 2026-08-22.
Sizes
Updates: 453 topics
Development Discussion: 261 topics
Help and Feedback: 1830 topics
Resources: 944 topics (from 2020-01-01)
This devforum dataset has minimal filtered, it only takes any post that has atleast 200 views with >100 tokens for less noises.
multilingual-textarena-KuhnPoker-v0-train
TextArena Language Trajectories
This dataset contains language-conditioned TextArena trajectory data.
Each dataset configuration corresponds to a different model, experiment group, or source folder.
Available configurations:
gemma4-e4b-it
qwen3-4b
ministral3-3b-instruct
Usage
Install the datasets library:
pip install datasets
Load a specific configuration:
from datasets import load_dataset
dataset =… See the full description on the dataset page: https://huggingface.co/datasets/The-CoLab/multilingual-textarena-KuhnPoker-v0-train.python-text-copilot-training-instruct-ai-research-2024-01-27
Python Copilot Instructions on How to Code using Alpaca and Yaml
This dataset is the 2024-01-27 update for the matlok python copilot datasets. Please refer to the Multimodal Python Copilot Training Overview for more details on how to use this dataset.
Details
Each row contains python code, either a class method or a global function, imported modules, base classes (if any), exceptions (ordered based off the code), returns (ordered based off the code), arguments (ordered… See the full description on the dataset page: https://huggingface.co/datasets/matlok/python-text-copilot-training-instruct-ai-research-2024-01-27.multilingual-textarena-Nim-v0-train
TextArena Language Trajectories
This dataset contains language-conditioned TextArena trajectory data.
Each dataset configuration corresponds to a different model, experiment group, or source folder.
Available configurations:
gemma4-e4b-it
qwen3-4b
ministral3-3b-instruct
Usage
Install the datasets library:
pip install datasets
Load a specific configuration:
from datasets import load_dataset
dataset = load_dataset("The-CoLab/multilingual-textarena-Nim-v0-train"… See the full description on the dataset page: https://huggingface.co/datasets/The-CoLab/multilingual-textarena-Nim-v0-train.multilingual-textarena-TicTacToe-v0-train
TextArena Language Trajectories
This dataset contains language-conditioned TextArena trajectory data.
Each dataset configuration corresponds to a different model, experiment group, or source folder.
Available configurations:
gemma4-e4b-it
qwen3-4b
ministral3-3b-instruct
Usage
Install the datasets library:
pip install datasets
Load a specific configuration:
from datasets import load_dataset
dataset =… See the full description on the dataset page: https://huggingface.co/datasets/The-CoLab/multilingual-textarena-TicTacToe-v0-train.terrupt-textcorrupt
terrupt
Corrupted text → original text dataset. 32.5M sentence pairs across five severity levels, generated by a controlled corruption engine applied to clean text from Wikipedia, Reddit, TinyStories, and textbook corpora.
Task
Restore the original sentence from its corrupted version.
Corrupted input
Original target
i l0ve pr0gramm1ng
I love programming
Features
Field
Type
Description
original
string
Clean source sentence… See the full description on the dataset page: https://huggingface.co/datasets/akaruineko/terrupt-textcorrupt.tiny-code-textbooks
Code Explanation Textbooks
A collection of 207k synthetic code with explanation as a tiny textbook. Filtered from the-stack, each programming language contains few thousands samples. I only choose the best meaningful code to generate synthetic textbook.
multilingual-textarena-Nim-v0-train-v2
TextArena Language Trajectories
This dataset contains language-conditioned TextArena trajectory data.
Each dataset configuration corresponds to a different model, experiment group, or source folder.
Available configurations:
gemma4-e4b-it
qwen3-4b
ministral3-3b-instruct
Usage
Install the datasets library:
pip install datasets
Load a specific configuration:
from datasets import load_dataset
dataset =… See the full description on the dataset page: https://huggingface.co/datasets/The-CoLab/multilingual-textarena-Nim-v0-train-v2.odia-text-corpus
Odia Text Corpus
Dataset Description
This is a comprehensive Odia language text corpus designed for training language models, text generation, and various NLP tasks in Odia (ଓଡ଼ିଆ). The dataset contains high-quality Odia text from multiple sources, providing a rich foundation for Odia language AI development.
Dataset Summary
Language: Odia (ଓଡ଼ିଆ)
Total Records: 649,120
Text Format: Plain Odia text
License: CC-BY-4.0
Use Cases: Language modeling, text… See the full description on the dataset page: https://huggingface.co/datasets/abhilash88/odia-text-corpus.bill_text_us
Dataset Card for "bill_text_us"
Dataset Summary
Dataset for US Congressional bills (bill_text_us).
Supported Tasks and Leaderboards
More Information Needed
Languages
English
Dataset Structure
Data Instances
default
Data Fields
id: id of the bill in format(congress number + bill type + bill number + bill version).
congress: number of the congress.
bill_type: type of the bill.
bill_number: number of the… See the full description on the dataset page: https://huggingface.co/datasets/dreamproit/bill_text_us.age-specific-text-simplification
Age-Specific Text Simplification Dataset
Dataset Description
This dataset contains complex texts simplified into age-appropriate versions for children aged 3, 4, and 5 years old. Each original text has been professionally adapted to match the cognitive development, vocabulary, and comprehension abilities of each specific age group.
Dataset Summary
Total Examples: 17,177
Training Split: 15,459 examples
Validation Split: 1,718 examples
Languages:… See the full description on the dataset page: https://huggingface.co/datasets/hasankursun/age-specific-text-simplification.danish-textman-v2
danish-textman-v2
Danish text-manipulation tasks over Wikipedia passages. Supersedes
jensjepsen/danish-textman-v1, which is identical except
that it also contained a textman_extraction subtype.
split
rows
train
99,610
validation
4,997
subtype
rows
textman_summary
20,937
textman_genre_transform
20,934
textman_style_transfer
20,923
textman_rewrite
20,912
textman_elaborate
20,901
What changed
textman_extraction is removed. It… See the full description on the dataset page: https://huggingface.co/datasets/jensjepsen/danish-textman-v2.