CoolFace
Datasetpublic

mbrt/domain-resurrect-edges

Dataset Card for domain-resurrect-edges This dataset contains link counts between domains on the Internet. The data is based on CommonCrawl. See mbrt/domain-resurrect for the companion dataset with scored domains based on Page Rank, and the Blog post on how this was computed. Dataset Details Dataset Description This dataset is a processed version of the CommonCrawl September crawl. Each row is the count of how many hyperlinks exist between the… See the full description on the dataset page: https://huggingface.co/datasets/mbrt/domain-resurrect-edges.

sourceHugging Facemitupdated 11mo agoView on Hugging Face
0likes252downloads
Dataset Card

Dataset Card for domain-resurrect-edges

This dataset contains link counts between domains on the Internet. The data is based on CommonCrawl.

See mbrt/domain-resurrect for the companion dataset with scored domains based on Page Rank, and the Blog post on how this was computed.

Dataset Details

Dataset Description

This dataset is a processed version of the CommonCrawl September crawl. Each row is the count of how many hyperlinks exist between the source domain towards the target.

Dataset Source

  • Repository: https://github.com/mbrt/domain-resurrect
  • Blog: https://blog.mbrt.dev/posts/domain-resurrect/
  • Source data: CommonCrawl September crawl