datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
tranco_top_million
Top 1M Tranco Crawl Dataset
A web crawl dataset covering the top 1 million domains from the Tranco list with ID "PYGVJ" (generated July 29, 2026), collected on July 30-31, 2026 using the distcrawl crawler.
The crawling process took around 18.5 hours to complete, using ~100 parallel nodes deployed worldwide.
The cloud costs for data collection totaled around €20.
Success Rate of the Crawl
Percentage of the 1 million target domains that were successfully crawled… See the full description on the dataset page: https://huggingface.co/datasets/phl-ldm/tranco_top_million.alpaca