sayurio/dainikparibarton-web-scrape-bangla

Dainik Paribarton News Archive (Bangla)

Request More Scrapes Order Private Scrapes

Overview

This repository contains a text dataset scraped from dainikparibarton.com, a Bengali online news portal covering national, regional, sports, and political news in Bangladesh. The primary goal of this archive is to preserve a collection of purely human-written journalism and regional reporting, creating a distinct record of human-authored text separate from AI-generated content.

Purpose and Usage

This dataset is published publicly and strictly for educational, research, linguistic analysis, and archival purposes. It serves as a resource for Natural Language Processing (NLP) researchers, data scientists, and linguists working on:

• —Pre-training or fine-tuning Bengali Large Language Models (LLMs) with diverse, regional news data.
• —Topic modeling, sentiment analysis, and text classification.
• —Studying the evolution of modern Bengali journalistic writing and vocabulary.

Dataset Details

• —Source: dainikparibarton.com
• —Collection Method: Web scraping
• —Content Type: Text (Bengali news articles, local reports, and features written by humans without the use of AI).
• —Repository: sayurio/dainikparibarton-scrape-bangla (Update if your repo name differs)

Copyright and Fair Use Disclaimer

This archive is created under the principles of Fair Use (under Section 107 of the Copyright Act) for purposes such as criticism, comment, news reporting, teaching, scholarship, and research.

• —No Ownership Claimed: The creator of this repository does not claim any ownership, authorship, or copyright over the original content. All rights, title, and interest in the original text, headlines, and articles remain entirely with their respective authors, journalists, and Dainik Paribarton.
• —Non-Commercial: This dataset is provided completely free of charge and is strictly not intended for commercial gain, monetization, or profit.
• —Transformative Use: The data has been aggregated, extracted from its original web formatting, and compiled specifically for computational analysis, archiving, and educational study. This represents a transformative use of the original publicly available material.

Takedown Requests: If you are a copyright holder of any material included in this dataset and wish for it to be removed from this archive, please open an issue or contact the repository owner directly. Please submit a removal request specifying the exact article URLs, headlines, or text snippets you wish to have taken down so they can be accurately located within the dataset and removed.

How to Use

You can load this dataset directly into your Python environment using the Hugging Face datasets library:

from datasets import load_dataset

# Load the dataset
dataset = load_dataset("sayurio/dainikparibarton-scrape-bangla")

# View the structure of the first article
print(dataset['train'][0])