tranco
Datasets
All datasets matching “tranco”tranco_top_million
Top 1M Tranco Crawl Dataset
A web crawl dataset covering the top 1 million domains from the Tranco list with ID "PYGVJ" (generated July 29, 2026), collected on July 30-31, 2026 using the distcrawl crawler.
The crawling process took around 18.5 hours to complete, using ~100 parallel nodes deployed worldwide.
The cloud costs for data collection totaled around €20.
Success Rate of the Crawl
Percentage of the 1 million target domains that were successfully crawled… See the full description on the dataset page: https://huggingface.co/datasets/phl-ldm/tranco_top_million.alpaca