Datasetpublic

Engagemii/one-day-of-ai-reading

One day of AI crawler reading (24 hours ending 2026-09-24 16:50 UTC) Reads of company pages on the Engagemii index (scored profile pages for 60 million companies) by AI crawler, logged server-side and checked against each operator's published IP ranges. Full report with method: https://engagemii.com/research/one-day-of-ai-reading Total for the day: 5,716,614 reads. Meta 3.4M, Claude 1.5M, GPTBot 555K, Applebot 179K. The AI engines out-read Bingbot 191 to 1. Applebot has read… See the full description on the dataset page: https://huggingface.co/datasets/Engagemii/one-day-of-ai-reading.

sourceHugging Facecc-by-4.0updated 3d agoView on Hugging Face

0likes32downloads

Dataset Card

One day of AI crawler reading (24 hours ending 2026-09-24 16:50 UTC)

Reads of company pages on the Engagemii index (scored profile pages for 60 million companies) by AI crawler, logged server-side and checked against each operator's published IP ranges. Full report with method: https://engagemii.com/research/one-day-of-ai-reading

Total for the day: 5,716,614 reads. Meta 3.4M, Claude 1.5M, GPTBot 555K, Applebot 179K. The AI engines out-read Bingbot 191 to 1. Applebot has read 20.0M pages over the life of the index against GPTBot's 10.9M.

Columns

—engine: the operator and product
—user_agent: the crawler token seen in the request
—reads_24h: requests logged in the 24 hours
—share_of_day: reads_24h / 5,716,614
—verified_ip_share: share of the day's reads whose source IP fell inside the operator's published ranges (Apple publishes only part of its space)
—lifetime_reads: requests logged since the index began

What this does not claim

These are reads of Engagemii's pages about companies, not of the companies' own sites. Reading is not citing. Lifetime totals include reads logged before the verification check existed.

Live board, free embed, RSS/JSON feeds and an MCP endpoint: https://engagemii.com/live