datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
webfiddle-internet-raw-cache-datasetA dataset of different files that robots tried to crawl through webfiddle.net
Mostly html files but other files too pdfs, images, binary- i have no idea what is in here at this stage - but gives an interesting idea of what crawlers like to visit and could be the basis of interesting SEO or coding LLM reasearch.
Collected as part of my work on web simulators.
https://webfiddle.net JS/CSS editor for the web, https://websim.netwrck.com Coding Editor for the web.
https://x.com/leeleepenkman
Its… See the full description on the dataset page: https://huggingface.co/datasets/lee101/webfiddle-internet-raw-cache-dataset.II-Medical-Reasoning-SFT
II-Medical-Reasoning-SFT
II-Medical SFT is a curated dataset designed to support the supervised fine-tuning of large language models (LLMs) for medical reasoning tasks. It comprises multi-turn dialogues, clinical case scenarios, and question-answer pairs that reflect the complex reasoning processes encountered in real-world clinical practice.
The dataset is intended to help models develop key competencies such as differential diagnosis, evidence-based decision-making, patient… See the full description on the dataset page: https://huggingface.co/datasets/Intelligent-Internet/II-Medical-Reasoning-SFT.pd12m
PD12M
This is a curated PD12M dataset for use with the II-Commons project.
Dataset Details
Dataset Description
This dataset comprises a curated Public Domain 12M image collection, refined by filtering for active image links. EXIF data was extracted, and images underwent preprocessing and feature extraction using SigLIP 2. All vector embeddings are normalized 16-bit half-precision vectors optimized for L2 indexing with vectorchord.… See the full description on the dataset page: https://huggingface.co/datasets/Intelligent-Internet/pd12m.dead-internet-observatorysea-internetwikipedia_en
wikipedia_en
This is a curated Wikipedia English dataset for use with the II-Commons project.
Dataset Details
Dataset Description
This dataset comprises a curated Wikipedia English pages. Data sourced directly from the official English Wikipedia database dump. We extract the pages, chunk them into smaller pieces, and embed them using Snowflake/snowflake-arctic-embed-m-v2.0. All vector embeddings are 16-bit half-precision vectors optimized for cosine indexing… See the full description on the dataset page: https://huggingface.co/datasets/Intelligent-Internet/wikipedia_en.ii-agent_gaia-benchmark_validationGAIA-Subset-Benchmark
GAIA Benchmark Subset Model Card
This dataset is a subset of the GAIA benchmark, containing 44 web-search-based questions from the validation set. It evaluates multiple AI models on their ability to retrieve and process real-time information using web search and browser tools. Performance metrics include success indicators and detailed reports for each model. A comparative chart summarizing the results will be provided separately.
Benchmark Results
II-Thought-RL-v0
II-Thought RL v0: A Large-Scale Curated Dataset for Reinforcement Learning
See our blog here for additional details.
We introduce II-Thought RL v0, the first large-scale, multi-task dataset designed for Reinforcement Learning. This dataset consists of high-quality question-answer pairs that have undergone a rigorous multi-step filtering process, leveraging Gemini 2.0 Flash and Qwen 32B as quality evaluators.
In this initial release, we have curated and refined publicly available… See the full description on the dataset page: https://huggingface.co/datasets/Intelligent-Internet/II-Thought-RL-v0.arxiv
arXiv
This is a arXiv dataset for use with the II-Commons-Store project.
Dataset Details
Dataset Description
This dataset comprises a curated arXiv dataset. We provide a series of pre-computed embedding vector datasets based on ArXiv paper data to help users quickly start and test the semantic search API. These datasets contain paper metadata, text from certain sections, and optimized embedding vectors. They can be downloaded and used directly, eliminating the… See the full description on the dataset page: https://huggingface.co/datasets/Intelligent-Internet/arxiv.InternetArchive_1899_Large
Internet Archive Historical Texts (0001-1899)
TL;DR
711,680 cleaned public-domain style documents harvested from the Internet Archive via a high-throughput text-to-parquet pipeline.
Coverage targets items that contain textual content dated between 0001 and 1899, ranked by download counts; ~715k IDs were attempted, ~4.1k were filtered during preprocessing.
Stored in 620 Zstandard-compressed Parquet shards (shard_00000.parquet ... shard_00619.parquet) occupying ~240 GB on… See the full description on the dataset page: https://huggingface.co/datasets/meettilavat/InternetArchive_1899_Large.internet-latency-and-routing-events
GeoCables Internet Latency and Routing Events
Daily-updated measurements of internet round-trip latency toward submarine cable landing regions, and detected routing anomalies (detours, path changes), collected by GeoCables - a live atlas of the world's submarine cable infrastructure with its own distributed measurement network.
Files
geocables-latency-daily.csv - per-day latency aggregates (median / p90 / min RTT in milliseconds) for measured city-to-target… See the full description on the dataset page: https://huggingface.co/datasets/geocables/internet-latency-and-routing-events.television_por_internetInternetArchive_1899_Chunked
Internet Archive Historical Texts - Chunked (0001-1899)
TL;DR
163 million text chunks extracted from historical public-domain documents sourced from the Internet Archive
Content dated 0001-1899, sorted by download popularity to prioritize high-quality, frequently accessed materials
2,445 Zstandard-compressed Parquet shards totaling ~217 GB on disk, ~594 billion characters uncompressed
Optimized chunk size of ~3,600 characters (target: 4,000) for efficient language model… See the full description on the dataset page: https://huggingface.co/datasets/meettilavat/InternetArchive_1899_Chunked.doom-e1-internet-gameplayI've used the Inverse Dynamic Model, I've previously trained on manually recorded gameplay, on pure gameplay YouTube videos.
This dataset is in public domain, use it however you want.
internet-prompts-benchmark
Internet Prompts Benchmark
Viral internet prompts, memes, and tests that AI historically failed at. Popular ones like counting letters in the word strawberry and nicher ones that test other important capabilities.Mostly made by GPT-5.6 Sol.
It is designed for many types of models to participate, small and large, not only transformers.
It has prompts from the early days of AI to the very latest.
It will be actively updated to preserve various prompts for as long as I can afford… See the full description on the dataset page: https://huggingface.co/datasets/NikoThePig/internet-prompts-benchmark.ChatDoctor-RL
Intelligent-Internet/ChatDoctor-Improved-Answer Dataset
This dataset represents a carefully curated subset derived from the original ChatDoctor-HealthCareMagic-100k[lavita/ChatDoctor-HealthCareMagic-100k] dataset, where we have undertaken significant improvements to enhance the quality and depth of the responses. The answers have been thoroughly refined to provide greater detail, clarity, and precision, while incorporating a heightened focus on safety awareness to ensure responsible… See the full description on the dataset page: https://huggingface.co/datasets/Intelligent-Internet/ChatDoctor-RL.vn-provinces-household-internet-rate
Vietnam household internet connection rate
Vietnam household internet connection rate. Geographic labels are English (UN/GSO style ASCII romanization). Tables cover provinces, regions and national total where present. Province names follow ar_core.vn_geo (historical 63-province system).
Figures
Hero
Comparison
Color key
Files
provinces (63 rows)
data/provinces.csv
data/provinces.dta
data/provinces.xlsx
regions (6 rows)
data/regions.csv… See the full description on the dataset page: https://huggingface.co/datasets/letrinhan/vn-provinces-household-internet-rate.vn-provinces-internet-users-share
Vietnam internet users share
Vietnam internet users share. Geographic labels are English (UN/GSO style ASCII romanization). Tables cover provinces, regions and national total where present. Province names follow ar_core.vn_geo (historical 63-province system).
Figures
Hero
Comparison
Color key
Files
provinces (63 rows)
data/provinces.csv
data/provinces.dta
data/provinces.xlsx
regions (6 rows)
data/regions.csv
data/regions.dta
data/regions.xlsx… See the full description on the dataset page: https://huggingface.co/datasets/letrinhan/vn-provinces-internet-users-share.OpenAI-HealthBench-II-Medical-8B-GPT-4.1internet-speed-by-country-and-isp
Internet Speed Statistics by Country and ISP
Dataset summary
Monthly aggregated internet speed statistics derived from real tests performed by visitors to internetspeedtest.net (https://internetspeedtest.net), a free, no-signup browser-based speed test built on the open-source LibreSpeed engine. For each month, the data provides download, upload, and ping statistics (average, median, p25, and p75), aggregated globally and broken down by country and by ISP.… See the full description on the dataset page: https://huggingface.co/datasets/jacksonbin/internet-speed-by-country-and-isp.Internet-background-noise
Internet Background Noise Dataset (Unlabeled Raw Data)
This dataset contains HTTP internet noise data collected by an internet honeypot. It consists of raw, unlabeled network packets, including metadata, payloads, and header information. This data is suitable for training and evaluating machine learning models for network intrusion detection, cybersecurity, and traffic analysis.
HoneyPot repository: hachimi on GitHub.
Dataset Overview
The Internet Background Noise… See the full description on the dataset page: https://huggingface.co/datasets/burpheart/Internet-background-noise.II-Medical-RL
Overview
The MedReason-RL dataset is a refined version of the original MedReason dataset, specifically curated for training reinforcement learning (RL) models to enhance reasoning abilities. It has been proven to be the best dataset for improving model reasoning through RL training.
Source
This dataset is derived from the original MedReason dataset, which focuses on medical reasoning tasks. However, the original dataset contained significant overlap with benchmarking… See the full description on the dataset page: https://huggingface.co/datasets/Intelligent-Internet/II-Medical-RL.africa-worldbank-individuals-using-the-internet-of-population-it-net-user-zs
Individuals using the Internet (% of population) | Africa (World Bank — Gender Statistics) | Africa (World Bank)
Size category: 1K<n<10K - Formats: parquet - Sector: demographics_social - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-worldbank-individuals-using-the-internet-of-population-it-net-user-zs.OpenAI-HealthBench-II-Medical-8B-1706-GPT-4.1Vietnamese-Entrance-Exam
Vietnamese Entrance Exam Dataset
The Vietnamese Entrance Exam dataset is a collection of 432 problems derived from Vietnamese University entrance examinations. The dataset aims to provide a novel benchmark for testing reasoning capabilities of language models in several low resource domains specifically designed to minimize potential data contamination from pre-training or post-training exposure.
Domain
Count
Physics
95
Chemistry
94
Math
243
Data… See the full description on the dataset page: https://huggingface.co/datasets/Intelligent-Internet/Vietnamese-Entrance-Exam.millan_internet_traffic
Milan Internet Traffic Dataset
This dataset contains information about hourly internet traffic in Milan between 2013-11-01 and 2014-01-01.
II-Search-CIR-SFTafrica-synth-telecom-massive-internet-of-things-traffic-nigeria
Africa Synth Telecom Massive Internet of Things Traffic Nigeria | Africa (Electric Sheep Africa metadata inventory)
Size category: 100K<n<1M - Formats: parquet - Sector: technology_digital - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-synth-telecom-massive-internet-of-things-traffic-nigeria.II-Thought-RL-v0-Math-50K