datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ChineseWebText2.0-HighQuality
📘 ChineseWebText2.0-HighQuality
Overview
ChineseWebText2.0-HighQuality is a high-quality filtered subset of the original
CASIA-LM/ChineseWebText2.0 dataset (Apache-2.0 License).
This subset retains only samples with:
quality_score ≥ 0.9
toxicity.score ≤ 0.01
The goal is to provide a cleaner and more reliable dataset suitable for
language model pre-training, instruction tuning, and quality-sensitive downstream tasks.
This work is independent and not affiliated with the… See the full description on the dataset page: https://huggingface.co/datasets/Morton-Li/ChineseWebText2.0-HighQuality.Creative-Writing-High-Quality-1300x
Creative Writing - Part One (Shadow & Skeleton)
This dataset is designed to train Large Language Models (LLMs) in grounded creative writing by enforcing a "Think-Before-You-Write" methodology.
Methodology: Shadow & Skeleton
Most creative writing datasets train models to produce "vibes" or "cinematic descriptions" that often lack physical coherence or psychological depth. This dataset takes a different approach:
Shadow Prompts: We generated 1,000+ isomorphic… See the full description on the dataset page: https://huggingface.co/datasets/Crownelius/Creative-Writing-High-Quality-1300x.high-quality-english-sentences
High-Quality English Sentences
Dataset Description
This dataset contains a collection of high-quality English sentences sourced from C4 and FineWeb (not FineWeb-Edu). The sentences have been carefully filtered and processed to ensure quality and uniqueness.
"High-quality" means they're legible English and not spam, although they may still have spelling and grammar errors.
Source Data
Before filtering:
C4: 1 million sentences
FineWeb: 1 million sentences… See the full description on the dataset page: https://huggingface.co/datasets/agentlans/high-quality-english-sentences.high-quality-multilingual-sentences
High Quality Multilingual Sentences
This dataset contains multilingual sentences derived from the agentlans/LinguaNova dataset.
It includes 1.58 million rows across 51 different languages, each in its own configuration.
Example row (from the all config):
{
"text": "امام جمعه اصفهان گفت: میزان نیاز آب شرب اصفهان ۱۱.۵ متر مکعب است که تمام استان اصفهان را پوشش میدهد و نسبت به قبل از انقلاب یکی از پیشرفتها در حوزه آب بوده است.",
"fasttext": "fa",
"gcld3": "fa"
}
Fields:… See the full description on the dataset page: https://huggingface.co/datasets/agentlans/high-quality-multilingual-sentences.high-quality-cc-21b
high_quality
A high-quality English web text corpus extracted from Common Crawl WARC files using an
LLM-based extraction and quality pipeline.
Dataset Summary
high_quality is a pretraining-grade corpus of cleaned web documents. Raw Common Crawl
WARC records are passed through an LLM-based extractor that strips boilerplate and recovers
the main content, then filtered to retain only documents in the "high_quality" band,
deduplicated (exact + fuzzy), and… See the full description on the dataset page: https://huggingface.co/datasets/MichaelR207/high-quality-cc-21b.high-quality-text
High Quality Text Dataset
A curated collection of English-language texts for AI training and research.
Sources
HuggingFaceFW/fineweb-edu
openbmb/Ultra-FineWeb
Zyphra/Zyda-2
EssentialAI/eai-taxonomy-stem-w-dclm-100b-sample
m-a-p/FineFineWeb
Each dataset was processed as follows:
Split into approximately 2 000-token chunks using the LLaMA 3.1 tokenizer.
Cleaned by normalizing spaces, punctuation, and characters, and replacing emails and phone numbers with… See the full description on the dataset page: https://huggingface.co/datasets/agentlans/high-quality-text.pretraining-high-quality
Dataset Card for Lapa High Quality Pretraining Dataset
Dataset Description
Dataset Summary
This dataset is a high quality subset of pretraining corpus for Ukrainian language. It was filtered using 6 models, measuring different quality aspects of the data:
lapa-llm/alignment-score-model - Alignment - filtering for disinformation
lapa-llm/gec-score-model - Grammatical Correctness of the text
lapa-llm/fineweb-nemotron-edu-score - Educational Value of the text… See the full description on the dataset page: https://huggingface.co/datasets/lapa-llm/pretraining-high-quality.YiSang-HighQuality
YiSang-HighQuality
📖 Check out the KO-REAson technical report.
📍 Rest of the model and datasets are available here.
YiSang-HighQuality is a collection of ~280K long-CoT reasoning traces generated via Qwen3-32B. This dataset is a high-yield subset of the larger Yi-Sang collection, designed to enhance multilingual reasoning through Language-Mixed Chain-of-Thought (CoT), which switches between English and Korean to minimize translation artifacts while leveraging… See the full description on the dataset page: https://huggingface.co/datasets/KOREAson/YiSang-HighQuality.YiSang-HighQuality-chatml-v1
YiSang-HighQuality ChatML (Korean) v1
KOREAson/YiSang-HighQuality를 한국어 SFT용으로 가공한 데이터셋입니다. 원본 response에 포함된 <think>...</think> 영어 추론 트레이스를 전부 제거하고 실제 답변만 남긴 뒤, 정제 → 품질 필터 → 안전성 필터 → 중복 제거 → ChatML 포맷팅 → 토크나이즈 검증을 거친 결과물입니다.
총 샘플 수: 259,596
총 토큰 수: 약 1.78억 (178,406,073 tokens, keural tokenizer 기준, 평균 687 tokens/sample)
포맷: ChatML (<|im_start|>role ... <|im_end|>)
최대 길이: 8,192 tokens (초과 시 truncate)
추론 트레이스: 최종 산출물 전수 검사 기준 <think>/</think> 잔존 0건
생성일: 2026-07-10
데이터… See the full description on the dataset page: https://huggingface.co/datasets/mkd-jueon/YiSang-HighQuality-chatml-v1.ifc-bim-high-quality-alpaca
IFC BIM High-Quality Dataset (Alpaca Format)
Dataset Description
This is a high-quality, curated dataset for training language models on IFC (Industry Foundation Classes) and BIM (Building Information Modeling) tasks. The dataset has been filtered for quality and is provided in the Alpaca instruction-following format.
Dataset Summary
Total entries: 42,680
Format: Alpaca (instruction, input, output)
Language: English
Domain: IFC/BIM technical documentation and… See the full description on the dataset page: https://huggingface.co/datasets/Dietmar2020/ifc-bim-high-quality-alpaca.commit-messages-high-quality
Commit Messages from High-Quality Repositories
292,269 cleaned git commit messages scraped from the full histories of 15 well-regarded open-source
projects, balanced across two styles: normal (196,372) and
conventional commits (95,897).
Dataset Summary
Each record contains the commit subject, body, plus metadata: repo, sha, date,
author, and labels: style (normal/conventional), type (fix, feat, docs, ...),
scope, breaking.
Heavy cleaning: GitHub squash suffixes… See the full description on the dataset page: https://huggingface.co/datasets/Quad4/commit-messages-high-quality.high-quality-gr-textThis dataset contains Greek language text data from multiple high-quality sources.
Dataset Statistics
Total tokens: ~21.1 billion (GPT-4 tokenizer)
Total records: 5,032,854
Token Distribution
FineWeb2-HQ Greek: 14.6B tokens (68.9%)
FinePDFs-Edu Greek: 5.1B tokens (24.0%)
Wikipedia Greek: 752M tokens (3.6%)
FineWiki Greek: 745M tokens (3.5%)
Dataset Structure
The dataset consists of 4 subsets, each representing a different data source:
finepdfs_el… See the full description on the dataset page: https://huggingface.co/datasets/alexliap/high-quality-gr-text.high-quality-english-sentences-contamination-report
Contamination Report — agentlans/high-quality-english-sentences
What this is
A row-level audit of agentlans/high-quality-english-sentences (revision
main) for exact 13-gram overlap with standard benchmark test sets
(gsm8k, hellaswag, humaneval, mmlu). This is not a filtered copy of the source — it's a new
artifact: a list of which rows overlap which benchmark, plus summary statistics, so anyone
training on the source can decide how to handle it.… See the full description on the dataset page: https://huggingface.co/datasets/liodon-ai/high-quality-english-sentences-contamination-report.high-quality-english-sentences-decontaminated
Decontaminated — agentlans/high-quality-english-sentences
What this is
A filtered version of agentlans/high-quality-english-sentences (revision
main) with exact-duplicate rows and rows overlapping standard benchmark test sets
removed. This is a different artifact from the companion contamination report — that one is an
audit of what's wrong; this one is the corpus with those rows actually taken out, ready to train on.
Processing
Deduplicated… See the full description on the dataset page: https://huggingface.co/datasets/liodon-ai/high-quality-english-sentences-decontaminated.high-quality-summary
Data from agentlans/high-quality-text sample_k10000 configuration
Summaries generated using google/gemma-3-12b-it
Summaries rewritten using agentlans/granite-3.3-2b-refiner
Rewritten summaries checked against the original text using ibm-granite/granite-3.3-8b-instruct
high-quality-text-long
High Quality Text (Longer) Dataset
This is agentlans/high-quality-text
except that only chunks between 1750 and 2250 Meta Llama 3.1 tokens were kept.
The chunks were embedded using MongoDB/mdbr-leaf-mt
and hierarchically clustered.
pretraining-high-quality-10k-workshop
Lapa HQ 10k Workshop Corpus
A small deterministic subset of lapa-llm/pretraining-high-quality for tokenizer-transfer workshop runs.
Provenance
Source dataset: lapa-llm/pretraining-high-quality
Source config: default
Source split: train
Rows: 10000
Selection: first 10000 rows by dataset-server row order
Download window size: 100
Parallel workers: 20
Created at UTC: 2026-06-20T09:22:21.460168+00:00
Added columns:
source_row_idx
mini_corpus_index
high-quality-text-refinementhigh-quality-english-sentences
High-Quality English Sentences
Dataset Description
This dataset contains a collection of high-quality English sentences sourced from C4 and FineWeb (not FineWeb-Edu). The sentences have been carefully filtered and processed to ensure quality and uniqueness.
"High-quality" means they're legible English and not spam, although they may still have spelling and grammar errors.
Source Data
Before filtering:
C4: 1 million sentences
FineWeb: 1 million… See the full description on the dataset page: https://huggingface.co/datasets/rodogzz/high-quality-english-sentences.developers-high-quality-mozgach
developers-high-quality-mozgach
Описание
Высококачественные примеры для разработчиков, сгенерированные mozgach108.
Датасет содержит отборные примеры для различных задач программирования:
Написание кода
Отладка
Рефакторинг
Архитектурные решения
Code review
Тестирование
Особенность: высокое качество ответов, сгенерированных специализированной моделью mozgach108.
Сгенерировано через Ollama (mozgach108:latest).
Статистика
Всего примеров: 1200… See the full description on the dataset page: https://huggingface.co/datasets/nativemind/developers-high-quality-mozgach.high-quality-english-sentences
High-Quality English Sentences
Dataset Description
This dataset contains a collection of high-quality English sentences sourced from C4 and FineWeb (not FineWeb-Edu). The sentences have been carefully filtered and processed to ensure quality and uniqueness.
"High-quality" means they're legible English and not spam, although they may still have spelling and grammar errors.
Source Data
Before filtering:
C4: 1 million sentences
FineWeb: 1 million sentences… See the full description on the dataset page: https://huggingface.co/datasets/hrkhosravi/high-quality-english-sentences.turkish-high-quality-sft-translated-micro-60
Turkish High Quality SFT Translated Micro 60
CPU-feasible pilot translation from high-quality SFT sources. Dolly rows are marked source_license=CC-BY-SA-3.0.
{
"rows": 40,
"sources": {
"microsoft/orca-math-word-problems-200k": 25,
"databricks/databricks-dolly-15k": 15
},
"duplicates": 0,
"translation_model": "Helsinki-NLP/opus-mt-tc-big-en-tr"
}
Generated by ML Intern
This dataset repository was generated by ML Intern, an agent for machine learning… See the full description on the dataset page: https://huggingface.co/datasets/kilicai/turkish-high-quality-sft-translated-micro-60.high-quality-english-sentences
High-Quality English Sentences
Dataset Description
This dataset contains a collection of high-quality English sentences sourced from C4 and FineWeb (not FineWeb-Edu). The sentences have been carefully filtered and processed to ensure quality and uniqueness.
"High-quality" means they're legible English and not spam, although they may still have spelling and grammar errors.
Source Data
Before filtering:
C4: 1 million sentences
FineWeb: 1 million… See the full description on the dataset page: https://huggingface.co/datasets/aman7881/high-quality-english-sentences.high-quality-summary-v2
High Quality Long Text Summarization Dataset
Input texts from agentlans/high-quality-text-long sample_k10000 config
Summaries generated by google/gemma-3-12b-it
Summaries rewritten by agentlans/granite-3.3-2b-reviser
high-quality-english-sentences
High-Quality English Sentences
Dataset Description
This dataset contains a collection of high-quality English sentences sourced from C4 and FineWeb (not FineWeb-Edu). The sentences have been carefully filtered and processed to ensure quality and uniqueness.
"High-quality" means they're legible English and not spam, although they may still have spelling and grammar errors.
Source Data
Before filtering:
C4: 1 million sentences
FineWeb: 1 million… See the full description on the dataset page: https://huggingface.co/datasets/ss25114/high-quality-english-sentences.