Datasetpublic

DeusHorizon/agent-web-index

Agent Web Index — how much of the web can AI assistants actually read? 48,154 domains measured live. 25% of them cannot be read by at least one of ChatGPT, Claude, Perplexity or Gemini. Updated daily. Live index: https://shop.lumnika.com/ai-readiness/ Every row here is the result of real HTTP requests, not an estimate and not a re-publication of someone else's crawl: each domain's homepage is requested once as a browser and once as each of the published AI crawler user-agents… See the full description on the dataset page: https://huggingface.co/datasets/DeusHorizon/agent-web-index.

sourceHugging Facecc-by-4.0updated 2d agoView on Hugging Face

0likes98downloads

settings

This repository belongs to DeusHorizon on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

nameagent-web-index

visibilitypublic

licencecc-by-4.0

gatedno

ownerDeusHorizon

Account settings