datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
text_message_function_calling_open_chatThis is a small synthetic dataset to model a function call for text messaging someone from a cell phone. This has been tested with and used to finetune a set of smaller models and deployed directly on the pixel 8 pro and Fold 4 phones.
ARCHIVE-TEXT-URLS
Internet Archive English Text URLs Dataset
Dataset Description
This dataset contains 11,151,637 direct download URLs to OCR-processed text files from the Internet Archive's digital library. All entries are English-language texts spanning books, documents, historical records, and various other written materials.
Dataset Summary
Total Rows: 11,151,637
Language: English
Source: Internet Archive
Format: CSV with metadata and direct text file URLs
Text… See the full description on the dataset page: https://huggingface.co/datasets/Navanjana/ARCHIVE-TEXT-URLS.Pashto-Textbooks-PDFs-Corpus
Pashto Textbooks and PDFs Corpus
Languages: psLicense: cc-by-4.0Task categories: text-generation, feature-extractionSize categories: n<1K
Summary
This dataset is part of the ZamAI Pashto data collection. It is intended for text-generation, feature-extraction tasks in Pashto.
How to use
from datasets import load_dataset
dataset = load_dataset("tasal9/Pashto-Textbooks-PDFs-Corpus")
print(dataset)
Configs
default: load with… See the full description on the dataset page: https://huggingface.co/datasets/tasal9/Pashto-Textbooks-PDFs-Corpus.Bangla-TextBook
Accepted in ACL Main 2025
TigerLLM - A Family of Bangla Large Language Models
Nishat Raihan, Marcos Zampieri
George Mason University, VA, USA
mraihan2@gmu.edu
---
If you find our work helpful, please consider citing our paper:
@inproceedings{raihan-zampieri-2025-tigerllm,
title = "{T}iger{LLM} - A Family of {B}angla Large Language Models",
author = "Raihan, Nishat and
Zampieri, Marcos",
editor = "Che, Wanxiang and
Nabende, Joyce… See the full description on the dataset page: https://huggingface.co/datasets/md-nishat-008/Bangla-TextBook.SwitchLingua_text
Dataset Card for SwitchLingua_text
🚀 News
[19/09/2025] SwitchLingua: The First Large-Scale Multilingual and Multi-Ethnic Code-Switching Dataset is accepted by NeurIPS 2025!
[30/05/2024] The manuscript can be found on arXiv.
Dataset Summary
SwitchLingua is a comprehensive multilingual and multicultural code-switching dataset designed to advance research in automatic speech recognition, natural language processing, and conversational AI. The textual data for… See the full description on the dataset page: https://huggingface.co/datasets/Shelton1013/SwitchLingua_text.Curated-Fox-News-Headlines-and-Full-Text
Curated Fox News Headlines and Full Text
This dataset contains a clean, curated collection of Fox News articles, including both headlines and full article text. It is designed for use in natural language processing (NLP) tasks such as sentiment analysis, summarization, topic classification, and media analysis.
📁 Dataset Format
Format: CSV
Encoding: UTF-8
Fields:
headline: The article title or headline
publish_date: Date the article was published (YYYY-MM-DD)
content:… See the full description on the dataset page: https://huggingface.co/datasets/crawlfeeds/Curated-Fox-News-Headlines-and-Full-Text.text-to-mermaidText2EmojiTextCodeDepot
Dataset description:
The Python Code Chatbot dataset is a collection of Python code snippets extracted from various publicly available datasets and platforms. It is designed to facilitate training conversational AI models that can understand and generate Python code. The dataset consists of a total of 1,37,183 prompts, each representing a dialogue between a human and an AI Scientist.
Prompt Card:
Each prompt in the dataset follows a specific format known as the "Prompt… See the full description on the dataset page: https://huggingface.co/datasets/anujsahani01/TextCodeDepot.ph_en_text_detoxedPhEnText Detoxed is a large-scale and multi-domain lexical data written in Philippine English and Taglish text. The news articles, religious articles and court decisions collated by the original researchers were filtered for toxicity and special characters were further preprocessed. This dataset has been configured to easily fine-tune LLaMA-based models (Alpaca, Guanaco, Vicuna, LLaMA 2, etc.) In total, this dataset contains 6.29 million rows of training data and 2.7 million rows of testing… See the full description on the dataset page: https://huggingface.co/datasets/NLPinas/ph_en_text_detoxed.text2zinc
Text2Zinc: A Cross-Domain Dataset for Modeling Optimization and Satisfaction Problems in MiniZinc
Text2Zinc is a cross-domain dataset capturing optimization and satisfaction problems specified in natural language text. The dataset leverages MiniZinc's solver-agnostic modeling capabilities to formulate a diverse range of combinatorial problems, bridging natural language specifications with constraint models.
Leaderboard
Text2Zinc dataset is accompanied with the… See the full description on the dataset page: https://huggingface.co/datasets/skadio/text2zinc.HC3-textgen-qa
HC3-textgen-qa
the Hello-SimpleAI/HC3 reformatted for textgen
special tokens for question/answer, see dataset preview
mozilla-common-voice-23-bel-texts-exportturkish-text-normalization
🇹🇷 Turkish Text Normalization (TN / ITN)
A deterministic, rule-based dataset of Turkish written ↔ spoken pairs for
Text Normalization (TN) and Inverse Text Normalization (ITN) — mapping digit/symbol
forms (1.500 TL, %25, 15.07.2026) to their fully spoken Turkish words
(bin beş yüz lira, yüzde yirmi beş, on beş temmuz iki bin yirmi altı) and back.
This is a common, high-value preprocessing step for Turkish ASR post-processing and
TTS front-ends, where numbers, dates, currencies… See the full description on the dataset page: https://huggingface.co/datasets/yagmurtuncer/turkish-text-normalization.text-to-mongodb-queries-llm
Dataset Description
This dataset contains 10,000+ complex SQL-style analytical questions
mapped to MongoDB queries and aggregation pipelines.
Features
Multiple schemas
$group, $sum, $avg, $lookup
Nested documents
Long analytical questions
Use Cases
Fine-tuning small LLMs (Qwen, Mistral, LLaMA 3B)
Text-to-Mongo query generation
Data analytics agents
CiviVox-Swahili-text-corpus-v2.0
Swahili Text Dataset
Overview
This dataset contains a comprehensive collection of Swahili text data, derived from the AfriBERTa Corpus. It provides a rich resource for natural language processing tasks focused on the Swahili language.
Dataset Details
Source: AfriBERTa Corpus (Swahili subset)
Language: Swahili
Size: 1.54M
Format: Hugging Face Dataset
Content
The dataset consists of two main columns:
id: A unique identifier for each text entry
text:… See the full description on the dataset page: https://huggingface.co/datasets/Adeptschneider/CiviVox-Swahili-text-corpus-v2.0.LLM-Text-Generation-Dataset
Generated Text Dataset - 4 Millions+ Logs
Dataset comprises 4 million+ logs of synthetic texts generated by large language models (LLMs) across 32 languages, leveraging 3 different GPT models for diverse, high-quality training data. Designed for text generation tasks, language model training, and NLP applications, supporting generative AI and text classification.- Get the data
Dataset characteristics:
Characteristic
Data
Description
Generated texts to achieve… See the full description on the dataset page: https://huggingface.co/datasets/ud-nlp/LLM-Text-Generation-Dataset.Text-DescramblingThis dataset contains sentences and their scattered counterparts(with no semantic meaning)
CiviVox-Swahili-text-corpus-v2.0
Swahili Text Dataset
Overview
This dataset contains a comprehensive collection of Swahili text data, derived from the AfriBERTa Corpus. It provides a rich resource for natural language processing tasks focused on the Swahili language.
Dataset Details
Source: AfriBERTa Corpus (Swahili subset)
Language: Swahili
Size: 1.54M
Format: Hugging Face Dataset
Content
The dataset consists of two main columns:
id: A unique identifier for each text entry
text:… See the full description on the dataset page: https://huggingface.co/datasets/niqqyniqqy/CiviVox-Swahili-text-corpus-v2.0.Bangla-TextBook
Accepted in ACL Main 2025
TigerLLM - A Family of Bangla Large Language Models
Nishat Raihan, Marcos Zampieri
George Mason University, VA, USA
mraihan2@gmu.edu
---
If you find our work helpful, please consider citing our paper:
@inproceedings{raihan-zampieri-2025-tigerllm,
title = "{T}iger{LLM} - A Family of {B}angla Large Language Models",
author = "Raihan, Nishat and
Zampieri, Marcos",
editor = "Che, Wanxiang and
Nabende, Joyce… See the full description on the dataset page: https://huggingface.co/datasets/BadarHossain/Bangla-TextBook.Sentence_wise_urdu_text_dataset
Sentence_wise_urdu_text_dataset
Dataset Overview
File Information
Size: 5.29 MB (5,545,229 bytes)
Encoding: UTF-8
Basic Statistics
Total Characters: 3,136,348
Total Characters (excluding spaces): 2,472,408
Total Lines: 69,743
Total Words: 666,907
Linguistic Analysis
Vocabulary Size: 29,888
Average Word Length: 3.56 characters
Median Word Length: 3 characters
Average Paragraph Length: 670091.00 words
Hapax Legomena… See the full description on the dataset page: https://huggingface.co/datasets/Omarrran/Sentence_wise_urdu_text_dataset.text_in_number_tulu-3-sft-personas-instruction-following
RU
Набор данных содержит в себе текст и его представление в виде 610-ти значного числа. Число полоучено при помощи модели.Исходный набор данных: allenai/tulu-3-sft-personas-instruction-following
EN
The dataset contains text and its representation as a 610-digit number. The number is hollowed out using model.Initial dataset: allenai/tulu-3-sft-personas-instruction-following
managpt-4080-nlp-prompts-and-generated-textsThis dataset includes 4,080 texts that were generated by the ManaGPT-1020 large language model, in response to particular input sequences.
ManaGPT-1020 is a free, open-source model available for download and use via Hugging Face’s “transformers” Python package. The model is a 1.5-billion-parameter LLM that’s capable of generating text in order to complete a sentence whose first words have been provided via a user-supplied input sequence. The model represents an elaboration of GPT-2 that has… See the full description on the dataset page: https://huggingface.co/datasets/NeuraXenetica/managpt-4080-nlp-prompts-and-generated-texts.texts-for-articlesntina-text-dataset-v0
Ntina Text Dataset V0
Ntina Text Dataset V0 is the text companion to Ntina Voice Dataset V0. It
packages the project's literacy assessment material, bilingual tutor
scaffolding, elicitation prompts, and dialogue-act specification as separate
Hugging Face configurations.
The code-switched scaffolding is synthetic model output followed by human
review. tools/generate-scaffolding.js records the generation model identifier
as claude-sonnet-4-6. Reviewers evaluated every draft as… See the full description on the dataset page: https://huggingface.co/datasets/Ash11/ntina-text-dataset-v0.melodyGPT-song-chords-text-1
melodyGPT song chords dataset
This dataset contains the text representation of song chords.
Dataset Details
Dataset Description
This dataset is created by aggregating the chords of each song given by the Chords and Lyrics Dataset.
You can see in the dataset folder of the Github repository of melodyGPT notebooks with the code used to do so.
Also, the special characters that are not chords are analysed briefly and this information will be used to create… See the full description on the dataset page: https://huggingface.co/datasets/lluccardoner/melodyGPT-song-chords-text-1.Irish-Text-Collection
UCCIX's Irish Textual Corpus
Dataset Summary
This monolingual Irish text dataset includes data from various sources such as CulturaX, Glot500, Irish Wikipedia, providing valuable content from Irish sites and pages.
Our primary sources include CulturaX and Glot500, both of which provide important information from multilingual websites, including a subset dedicated to Irish. Additionally, we incorporate data from the Irish segment of the ga-en bitext pair of ParaCrawl v7… See the full description on the dataset page: https://huggingface.co/datasets/ReliableAI/Irish-Text-Collection.Encyclopedia_Sindhiana_text_corpus
Encyclopedia Sindhiana Dataset
Overview
The Encyclopedia Sindhiana Dataset is a collection of encyclopedia articles created for Natural Language Processing (NLP) research.
Each entry contains:
Category — Topic label of the article (14 unique classes)
Title — Title of the article
Content — Full text of the article
The dataset is structured in CSV format (UTF-8 encoding).
Use Cases
Text Classification (predict article categories)
Named Entity… See the full description on the dataset page: https://huggingface.co/datasets/DanishMahdi/Encyclopedia_Sindhiana_text_corpus.class-textbook
Dataset Card for Dataset Name
This dataset card aims to be a base template for new datasets. It has been generated using this raw template.
Dataset Details
Dataset Description
Curated by: [More Information Needed]
Funded by [optional]: [More Information Needed]
Shared by [optional]: [More Information Needed]
Language(s) (NLP): [More Information Needed]
License: [More Information Needed]
Dataset Sources [optional]
Repository: [More… See the full description on the dataset page: https://huggingface.co/datasets/NTTUNLPTEAM/class-textbook.Thesis_Development_of_a_Complex_of_Neural_Networks_for_Linked_Generation_of_Large_TextsHere presented a partially synthesized dataset, developed utilizing the GPT-4 model, for the purpose of NLG, particulary for the task of hierarchical generation of longer texts from short summaries. The creation of this dataset was undertaken as a component of my thesis paper. It incorporates excerpts from prominent British and American novels, from which plots, summaries, and metadata have been derived using GPT-4 API to facilitate extensive future research.
The metadata included in the… See the full description on the dataset page: https://huggingface.co/datasets/Fleur-roar/Thesis_Development_of_a_Complex_of_Neural_Networks_for_Linked_Generation_of_Large_Texts.