CoolFace
Datasetpublic

shaw276/open-domain-ranks

Linkheft Open Domain Ranks: free domain authority data for 10.3 million domains Try the paid tool: Linkheft on Apify: score any domain list via API, with 4-month trends. First try costs cents; pay only for results. An open alternative to proprietary "domain authority" scores. For each of the top 10 million domains on the web (plus every Majestic Million domain) this dataset gives: column meaning domain registrable domain, lowercase (stripe.com) cc_rank… See the full description on the dataset page: https://huggingface.co/datasets/shaw276/open-domain-ranks.

sourceHugging Faceotherupdated 8h agoView on Hugging Face
0likes74downloads
Dataset Card

Linkheft Open Domain Ranks: free domain authority data for 10.3 million domains

<!-- cybermax-more:start -->

Try the paid tool: Linkheft on Apify: score any domain list via API, with 4-month trends. First try costs cents; pay only for results.

<!-- cybermax-more:end -->

An open alternative to proprietary "domain authority" scores. For each of the top 10 million domains on the web (plus every Majestic Million domain) this dataset gives:

columnmeaning
domainregistrable domain, lowercase (stripe.com)
cc_rankharmonic-centrality rank in the Common Crawl web graph (1 = most central), latest release
cc_pr_rankPageRank rank in the same graph
cc_hostsnumber of hosts (subdomains) of the domain seen in the crawl
cc_prev_rankharmonic-centrality rank in the release ~4 months earlier (trend)
mj_rankMajestic Million global rank
mj_refsubnetsreferring IP subnets (Majestic), a backlink-diversity signal
mj_refipsreferring IP addresses (Majestic)

Empty cell = the domain is not in that list. See meta.json for release names and totals.

Layout

shards/<xx>.tsv.gz, where xx is the first two hex characters of md5(domain). To look up one domain you download one ~800 KB file:

python
import gzip, hashlib, urllib.request
d = "stripe.com"
k = hashlib.md5(d.encode()).hexdigest()[:2]
url = f"https://huggingface.co/datasets/shaw276/open-domain-ranks/resolve/main/shards/{k}.tsv.gz"
for line in gzip.decompress(urllib.request.urlopen(url).read()).decode().splitlines():
    if line.split("\t")[0] == d: print(line)

Try it in your browser: Linkheft free domain authority checker.

Bulk lookups, a 0–100 authority score, rank-trend verdicts and an MCP tool for AI agents: Linkheft on the Apify Store.

Sources and attribution

  • —Common Crawl Web Graph, domain-level ranks (commoncrawl.org/web-graphs), used under the Common Crawl Terms of Use.
  • —Majestic Million by Majestic-12 Ltd, licensed CC BY 3.0 (https://majestic.com/reports/majestic-million).

This is a derived work of both; please keep the attribution. Not affiliated with Common Crawl, Majestic, Moz, Ahrefs or Semrush. Scores are not Moz DA or Ahrefs DR.

Built by CyberMax.

<!-- cybermax-xlinks:start -->

More free from CyberMax