ReySajju742/Urdu-News

annotations_creators:

• —not-specified # or 'human-annotated', 'found' etc. if known language:
• —fa # Use the ISO 639-1 code if you know the exact language, 'fa' is for Persian (Farsi). Use 'ar' for Arabic, or a more general tag like 'rtl' if unsure. licenses:
• —unknown # Specify the license if you know it (e.g., 'apache-2.0', 'mit') multilinguality:
• —monolingual prettyname: 'Urdu-News' # Replace with the actual name of your dataset sizecategories:
• —unknown # e.g. 'n<1K', '1K<n<10K', '10K<n<100K' based on number of samples source_datasets:
• —unknown # Where did the data come from? task_categories:
• —text-classification # Example tasks
• —text-generation
• —summarization
• —language-modeling task_ids:
• —text-classification
• —language-modeling
• —seq2seq-lm
• —document-summarization
• —abstractive-summarization
• —extractive-summarization specific_scripts:
• —Arabic # Or 'Arabic script', 'Persian script' contributor:
• —'[Your Name or Organization]' # Optional: Add your name or organization ---

[Your Dataset Name]

Dataset Description

This dataset appears to be a collection of news headlines and their corresponding news text. Based on the provided image sample, the text content is in a language that uses the Arabic/Persian script, likely Persian (Farsi) or a similar Middle Eastern language. The dataset is structured in a tabular format suitable for various natural language processing tasks related to news content.

Dataset Structure

The dataset contains the following columns:

• —index: An integer identifier for each news entry.
• —headline: A string containing the headline of the news article.
• —news_text: A string containing the body or a summary of the news text associated with the headline.

Based on the image, here is a sample entry:

(Note: The text content might need verification for precise translation and meaning.)

Languages

The text content in the headline and news_text columns is in a language that uses the Arabic/Persian script. It appears to be Persian (Farsi) or a related Middle Eastern language.

Intended Uses

This dataset can be used for various Natural Language Processing tasks, including but not limited to:

• —Text classification (e.g., topic classification of news)
• —Text generation (e.g., generating news text based on a headline)
• —Text summarization
• —Language modeling for the specific language
• —Information retrieval from news articles

Limitations

Based solely on the provided image snippet, the following limitations are noted:

• —The total size and diversity of the dataset are unknown.
• —The source and collection methodology of the news data are not specified.
• —Potential biases present in the news source are unknown.
• —The quality and cleanliness of the text data (e.g., presence of errors, formatting) are unknown for the full dataset.

How to Load

If your dataset is in a common format like CSV, JSON, or Parquet, you can load it using the datasets library. For example, if your data is in a CSV file named news_data.csv:

from datasets import load_dataset

dataset = load_dataset('csv', data_files='urdu-news-dataset-1M.csv')

# Accessing an example
print(dataset['train'][0])
from datasets import load_dataset

# Replace 'ReySajju' and 'Urdu-News' with the actual values
dataset = load_dataset('ReySajju/Urdu-News')