datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
cc100-documents
cc100-documents
This dataset is a restructured version of the CC-100 (statmt/cc100) dataset.
In the original dataset, each instance corresponds to a single paragraph (or a document boundary).
In this version, the data has been reformed so that each instance corresponds to a single, complete document.
This document-level structure makes it more convenient for processing using the map() and filter() methods in the Hugging Face Datasets library.
Languages
The following… See the full description on the dataset page: https://huggingface.co/datasets/singletongue/cc100-documents.Chinese_Debate_Documents
Dataset Card for Chinese Debate Documents
ASR-transcribed corpus of competitive Mandarin Chinese university debates,
speaker-segmented and timestamped, with topic / round / team metadata parsed
from the source filenames.
Loading the Dataset
from datasets import load_dataset
ds = load_dataset("DBWBD/Chinese_Debate_Documents", split="train")
print(ds[0]["topic"], "—", ds[0]["team_a"], "vs", ds[0]["team_b"])
for seg in ds[0]["segments"][:3]:
print(f"… See the full description on the dataset page: https://huggingface.co/datasets/DBWBD/Chinese_Debate_Documents.conseil-detat-full-documents
Décisions du Conseil d'État (France)
Description
Ce dataset contient un corpus de décisions rendues par le Conseil d'État français, la plus haute juridiction de l'ordre administratif. Les décisions proviennent de la plateforme officielle Open Data de la Justice Administrative et sont diffusées au format XML anonymisé.
Le corpus rassemble les textes intégraux des décisions ainsi que plusieurs métadonnées permettant leur identification et leur traçabilité.
Source… See the full description on the dataset page: https://huggingface.co/datasets/hulk10/conseil-detat-full-documents.indian-legal-documents
Indian Legal Documents
Open Indian statutory and legal-document data for AI, search, and legal research.
This dataset is part of the KanoonGPT Open Legal Data Initiative — an effort to make Indian legal data easier to access, structure, and build on for open-source research, legal tech, and production AI systems.
KanoonGPT is building structured Indian legal datasets and data infrastructure for open-source, research, and enterprise AI applications. Learn more at kanoongpt.in.… See the full description on the dataset page: https://huggingface.co/datasets/KanoonGPT/indian-legal-documents.document-corpus-v3-open
Document Corpus v3 Open
document-corpus-v3-open is the redistribution-compatible slice of the exact
byte-level pretraining corpus used by MonumentalSystems' 128M Harmonic GPT
experiments. It contains 869,739 filtered documents and
2.192 GB of UTF-8 text before Parquet compression.
This is not the complete internal document-corpus-v3. Restricted,
unknown-license, and share-alike sources were excluded conservatively. Every
included row comes from an upstream dataset whose card… See the full description on the dataset page: https://huggingface.co/datasets/MonumentalSystems/document-corpus-v3-open.bioreason-pro-sft-reasoning-documents
BioReason-Pro SFT Reasoning Documents
Complete, self-contained training documents reconstructed from the BioReason-Pro SFT data, ready for LLM pre-training.
The upstream dataset wanglab/bioreason-pro-sft-reasoning-data
ships the assistant side of each training example (reasoning, final_answer) alongside the raw
biological context columns, but not the assembled prompt. The prompt cannot be recovered from the
data card alone, because two of its three parts were non-textual… See the full description on the dataset page: https://huggingface.co/datasets/timodonnell/bioreason-pro-sft-reasoning-documents.indian-legal-documents
Indian Legal Documents
Open Indian statutory and legal-document data for AI, search, and legal research.
This dataset is part of the KanoonGPT Open Legal Data Initiative — an effort to make Indian legal data easier to access, structure, and build on for open-source research, legal tech, and production AI systems.
KanoonGPT is building structured Indian legal datasets and data infrastructure for open-source, research, and enterprise AI applications. Learn more at kanoongpt.in.… See the full description on the dataset page: https://huggingface.co/datasets/abby2231/indian-legal-documents.nyan_documents
Nyan documents
Documents scraped for НЯН Telegram channel from March 2022 to December 2023. The dataset includes documents from 100+ different Telegram news channels.
Usage
pip3 install datasets
from datasets import load_dataset
for row in load_dataset("NyanNyanovich/nyan_documents", split="train", streaming=True):
print(row)
break
Other datasets
Documents (this dataset): https://huggingface.co/datasets/NyanNyanovich/nyan_documents
Clusters:… See the full description on the dataset page: https://huggingface.co/datasets/NyanNyanovich/nyan_documents.
