datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ipo-text
SEC IPO Filings Dataset
A large-scale, comprehensive dataset of 100,000+ filings (S-1 and F-1 filings) filed with the SEC EDGAR system, spanning 1994–2026 and over 20,000 unique registrants.
Every filing has been downloaded and then parsed using the IPO-Mine Python Package. We have extracted three common sections found in these documents (Prospectus Summary, Risk Factors, Legal Matters), and then used an LLM classifier to group them into three categories. For this dataset, we have… See the full description on the dataset page: https://huggingface.co/datasets/gtfintechlab/ipo-text.muse_textbookstextbooks
The Textbooks Corpus in MedRAG
This HF dataset contains the chunked snippets from the Textbooks corpus used in MedRAG. It can be used for medical Retrieval-Augmented Generation (RAG).
Dataset Details
Dataset Descriptions
Textbooks is a collection of 18 widely used medical textbooks, which are important references for students taking the United States Medical Licensing Examination (USLME).
In MedRAG, the textbooks are processed as chunks with no more than 1000… See the full description on the dataset page: https://huggingface.co/datasets/MedRAG/textbooks.TextEdit
TextEdit: A High-Quality, Multi-Scenario Text Editing Benchmark for Generation Models
Danni Yang,
Sitao Chen,
Changyao Tian
If you find our work helpful, please give us a ⭐ or cite our paper. See the InternVL-U technical report appendix for more details.
🎉 News
[2026/03/06] TextEdit benchmark released.
[2026/03/06] Evaluation code and initial baselines released.
[2026/03/06] Leaderboard updated with latest models.
📖 Introduction… See the full description on the dataset page: https://huggingface.co/datasets/opencompass/TextEdit.science-theory-textbooksmosaic-dedup-text-dataset
Mosaic format for dedup text dataset to train Malaysian LLM
This repository is to store dataset shards using mosaic format.
prepared at https://github.com/malaysia-ai/dedup-text-dataset/blob/main/pretrain-llm/combine-dedup-text-dataset-4096.ipynb
using tokenizer https://huggingface.co/malaysia-ai/bpe-tokenizer
4096 context length.
how-to
git clone,
git lfs clone https://huggingface.co/datasets/malaysia-ai/mosaic-dedup-text-dataset
load it,
from streaming import… See the full description on the dataset page: https://huggingface.co/datasets/malaysia-ai/mosaic-dedup-text-dataset.muse_textbooksJava-Code-Large-text-onlyJava-Code-Large
Java-Code-Large is a large-scale corpus of publicly available Java source code comprising more than 15 million java codes. The dataset is designed to support research in large language model (LLM) pretraining, code intelligence, software engineering automation, and program analysis.
By providing a high-volume, language-specific corpus, Java-Code-Large enables systematic experimentation in Java-focused model training, domain adaptation, and downstream code understanding tasks.… See the full description on the dataset page: https://huggingface.co/datasets/XEUIPR/Java-Code-Large-text-only.muse_textbooksmosaic-dedup-text-dataset-filtered
Mosaic format for filtered dedup text dataset to train Malaysian LLM
This repository is to store dataset shards using mosaic format.
prepared at https://github.com/malaysia-ai/dedup-text-dataset/blob/main/pretrain-llm/combine-dedup-text-dataset-filtered-4096.ipynb
using tokenizer https://huggingface.co/malaysia-ai/bpe-tokenizer
4096 context length.
how-to
git clone,
git lfs clone https://huggingface.co/datasets/malaysia-ai/mosaic-dedup-text-dataset
load it… See the full description on the dataset page: https://huggingface.co/datasets/malaysia-ai/mosaic-dedup-text-dataset-filtered.text-commands-2026-0422
Commands
Clean summary of 4D language reference.
Abstract
LLMs are generally incapable of understanding 4D code. LoRA by exposure to raw source code would actually increase the rate of hallucination as the model gets confused between 4D code and C#, Visual Basic, or JavaScript.
CPT, or continued pre-training, based on grammar and vocabulary should moderate the model's attention before extensive fine-tuning using raw source code.
This dataset was generated with Mistral… See the full description on the dataset page: https://huggingface.co/datasets/keisuke-miyako/text-commands-2026-0422.sea-pdf-textwild-science-theory-textbooksKoHRM-Text-1.4B-prepared-data
KoHRM-Text-1.4B Prepared Data
This dataset repository contains prepared HRM-Text V1Dataset artifacts for KoHRM-Text-1.4B.
The data is intended for continued pretraining and staged training with the project code at:
https://github.com/LLM-OS-Models/KoHRM-text
https://huggingface.co/LLM-OS-Models/KoHRM-Text-1.4B
https://huggingface.co/LLM-OS-Models/HRM-Text-Ko-Terminal-Tokenizer-131K
The upstream architecture and training method are based on:
Paper:… See the full description on the dataset page: https://huggingface.co/datasets/LLM-OS-Models/KoHRM-Text-1.4B-prepared-data.LLaVA-Med-60K-IM-text
LLaVA-Med-60K-IM-text
This dataset is a text format of llava_med_instruct_60k_inline_mention.json.
We built this dataset using the Meta-Llama-3-70B-Instruct, and the instruction we used is: Rewrite the question-answer pairs into a paragraph format (Do not use the words 'question' and 'answer' in your responses):.
PMC articles that failed to download are excluded.
Non-medical images (e.g., diagrams) are excluded in an automatic way.
Despite these efforts, this dataset is not… See the full description on the dataset page: https://huggingface.co/datasets/myeongkyunkang/LLaVA-Med-60K-IM-text.vnexpress_plain_texttext-commands-2026-0419vtv_plain_texttext-code-galeras-code-generation-from-docstring-3k-dedupedms-marco-anchor-text
Webis MS MARCO Anchor Text 2022
The Webis MS MARCO Anchor Text 2022 dataset enriches Version 1 and 2 of the document collection of MS MARCO with anchor text extracted from six Common Crawl snapshots. The six Common Crawl snapshots cover the years 2016 to 2021 (between 1.7-3.4 billion documents each). We sampled 1,000 anchor texts for documents with more than 1,000 anchor texts at random and all anchor texts for documents with less than 1,000 anchor texts (this sampling yields that… See the full description on the dataset page: https://huggingface.co/datasets/webis/ms-marco-anchor-text.text_coordinates_regions
Dataset Card for Multilingual Geo-Tagged Social Media Posts (by 123 world regions)
Dataset Summary
The "Regions" dataset is a multilingual corpus that encompasses textual data from the 123 most populated regions worldwide, with each region's data organized into separate .json files. This dataset consists of approximately 500,000 text samples, each paired with its geographic coordinates.
Key Features:
Textual Data: The dataset contains 500,000 text samples.… See the full description on the dataset page: https://huggingface.co/datasets/yachay/text_coordinates_regions.text-commands-2026-0431art-theory-textbookstext-commands-2026-0432text_datatext-commands-2026-0412textual_entailmentThe Textual Entailment dataset contains 800 pairs of Italian sentences, extracted from Wikipedia, and annotated for the presence of textual entailment. A pair of texts consists of T (for text) and H (hypothesis). Textual entailment is defined as a directional relationship between such pairs. The hypothesis must be fully entailed by the text.
The dataset has been created and used for the Textual Entailment Task (http://www.evalita.it/2009/tasks/te), organised as part of the EVALITA 2009… See the full description on the dataset page: https://huggingface.co/datasets/evalitahf/textual_entailment.ramanv-image-textrendertext-commands-2026-0405text-commands-2026-0417