manzked/ds-huffpost-news-article-links

huffpost news article dataset The dataset consists of >1m links to huffpost news articles. They have been crawled for an educational approach to learn how content could be gathered through reading the websites sitemap(s). The code can be found here Link huffpost-crawler educational - how to use sitemap.xml for crawling a website (huffpost.com - could be any) Every public website has (or should have) a sitemap.xml. The sitemap.xml allows robots like Google to find… See the full description on the dataset page: https://huggingface.co/datasets/manzked/ds-huffpost-news-article-links.