datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Scraped-Data
Scraped-Data — Building to 1 TB
A continuously-growing, cleaned text corpus scraped, parsed, cleaned,
losslessly-zipped, and auto-pushed from a CPU-only Google Colab pipeline.
Current repo size: ~26 GB → target: 1 TB (incremental batch uploads).
Current files
File
Size
Contents
corpus_batch1.clean.zip
4.80 GB
~2.9M Wikipedia docs (stored, from first scrape)
corpus_batch2.clean.zip
4.85 GB
~2.5M docs
corpus_batch3.clean.zip
4.91 GB
~2.3M docs… See the full description on the dataset page: https://huggingface.co/datasets/Gugu8/Scraped-Data.penetration_testing_scraped_dataset
Dataset Card for "penetration_testing_scraped_dataset"
More Information needed
fitcheck-scraped-v1English_French_Webpages_Scraped_Translated
English French Webpages Scraped Translated
Dataset Summary
French/English parallel texts for training translation models. Over 17.1 million sentences in French and English. Dataset created by Chris Callison-Burch, who crawled millions of web pages and then used a set of simple heuristics to transform French URLs onto English URLs, and assumed that these documents are translations of each other. This is the main dataset of Workshop on Statistical Machine Translation (WML)… See the full description on the dataset page: https://huggingface.co/datasets/Nicolas-BZRD/English_French_Webpages_Scraped_Translated.arena.ai-code-leaderboard-scrapedlink: https://arena.ai/leaderboard/code/
Darkforums-Scraped-Dump-osint-Datascraped-hotel-reviewsScrapedJobshacker-news-scraped-storiesPolyMath-Scraped-Raw
PolyMath Scraped
PolyMath is a curated dataset of 11,090 high-difficulty mathematical problems designed for training reasoning models. Built for the AIMO Math Corpus Prize. Existing math datasets (NuminaMath-1.5, OpenMathReasoning) suffer from high noise rates in their hardest samples and largely unusable proof-based problems.
PolyMath addresses both issues through:
Data scraping: problems sourced from official competition PDFs absent from popular datasets, using a… See the full description on the dataset page: https://huggingface.co/datasets/AIMO-Corpus/PolyMath-Scraped-Raw.scraped-episodesscraped-web-dataNYT-Connections-Verl-Scrapedjurnal-malaysia-scraped
website: jurnal-malaysia
Number of pages scraped: 20
Number of posts scraped: 1938
Link to dataset on Huggingface
scraped_xsum1sfia-9-scraped
SFIA-9-Scraped Dataset
This repository contains the SFIA-9-Scraped dataset, a JSON collection of the Skills Framework for the Information Age (SFIA) version 9 categories and levels, scraped for non-commercial research use.
🚀 Dataset Overview
Name: SFIA-9-Scraped
Hugging Face: Programmer-RD-AI/sfia-9-scraped
DOI: 10.57967/hf/5746
Author: Ranuga Disansa Gamage
Revision: 89feeb8
Publisher: Hugging Face
Year: 2025
Use this dataset to build RAG systems, taxonomy-driven… See the full description on the dataset page: https://huggingface.co/datasets/Programmer-RD-AI/sfia-9-scraped.cypherhackz-scraped
website: cypherhackz
Number of pages scraped: 9
Number of posts scraped: 805
Link to dataset on Huggingface
scraped-forum-threadshealifyLLM-QA-scraped-datasetscraped_notesscraped_data
Dataset Card for "scraped_data"
More Information needed
MKBHD-1AkZsBVF-scraped-data-Final-Evaluation-Demo
Dataset Card for "MKBHD-1AkZsBVF-scraped-data-Final-Evaluation-Demo"
More Information needed
MKBHD-u913fKuH-scraped-data-Final-Evaluation-DemoMKBHD-KsWAdpsB-scraped-data-Final-Evaluation-Demo
Dataset Card for "MKBHD-KsWAdpsB-scraped-data-Final-Evaluation-Demo"
More Information needed
MKBHD-FJbW9icR-scraped-data-Final-Evaluation-Demo
Dataset Card for "MKBHD-FJbW9icR-scraped-data-Final-Evaluation-Demo"
More Information needed
ImranKhanPTI-ASo6vhZR-scraped-data-Final-Evaluation-Demo
Dataset Card for "ImranKhanPTI-ASo6vhZR-scraped-data-Final-Evaluation-Demo"
More Information needed
cleaned_scraped_datasetmc_chat_scraped_from_toxigon_anarchyMKBHD-jsza7d5q-scraped-data-Final-Evaluation-Demo
Dataset Card for "MKBHD-jsza7d5q-scraped-data-Final-Evaluation-Demo"
More Information needed
MKBHD-OrIWGbwz-scraped-data-Final-Evaluation-Demo
