BramVanroy/finewebs-copyright-domains

List of domains that were removed from FineWeb(-2) An easy-access dataset that contains the domains that were removed from FineWeb(-2) after take-down requests. This should allow others to quickly filter out domains that should not be included in data collection, removing redundant data processing. If used in this way, as a domain-wide filter, it should make life easier for the copyright holders, too, who will not have to resubmit cease-and-desists for each new webcrawl.… See the full description on the dataset page: https://huggingface.co/datasets/BramVanroy/finewebs-copyright-domains.