Datasetpublic

directorybear/bear-rank-1m

Dir Bear Domain Index — Bear Rank for 1,000,000 domains One row per domain. Bear Rank is a 0–100 quality score built from public signals: traffic rank (Tranco), link authority (Majestic referring subnets and IPs), an estimate of longevity and an estimate of safety. Weights are Popularity 30 %, Authority 30 %, Longevity 20 %, Safety 20 %. Tiers: grizzly ≥ 90, kodiak 75–89, polar 50–74, cub < 50. This is the index used to label every document in the Dir Bear corpus… See the full description on the dataset page: https://huggingface.co/datasets/directorybear/bear-rank-1m.

sourceHugging Facecc-by-4.0updated 1d agoView on Hugging Face

0likes9downloads

Dataset Card

Dir Bear Domain Index — Bear Rank for 1,000,000 domains

One row per domain. Bear Rank is a 0–100 quality score built from public signals: traffic rank (Tranco), link authority (Majestic referring subnets and IPs), an estimate of longevity and an estimate of safety. Weights are Popularity 30 %, Authority 30 %, Longevity 20 %, Safety 20 %. Tiers: grizzly ≥ 90, kodiak 75–89, polar 50–74, cub < 50.

This is the index used to label every document in the Dir Bear corpus (https://dirbear.com). It is published so you can filter or weight web text by source quality yourself.

Columns

column	type	meaning
domain	string	registrable domain, lower-case
tld	string	top-level domain
bear_rank	int	0–100
tier	string	grizzly / kodiak / polar / cub
popularity, authority, longevity, safety	float	the four sub-scores, 0–100
family_safe	bool	safety sub-score ≥ 90
tranco_rank	int	position in the Tranco list
majestic_rank	int	Majestic Million rank (0 = not listed)
refsubnets, refips	int	Majestic referring subnets / IPs
open_pagerank	float	Open PageRank 0–10 where available
category	string	one of 49 site categories (where known)
shelf_prior	string	the Dir Bear shelf the category maps to
tags	string	pipe-separated topic tags (where known)
build	string	index build id

Licence and attribution

CC BY 4.0. Please cite as "Dir Bear Domain Index, https://dirbear.com". Input rankings: Tranco (https://tranco-list.eu), Majestic Million (https://majestic.com/reports/majestic-million), Open PageRank (https://www.domcop.com/openpagerank/), each under its own terms.