CoolFace
Datasetpublic

MBZUAI/AraSeg-2026-Shared-Task-NoPnx-NP

Arabic Sentence Segmentation Shared Task 2026 For details about the shared task, evaluation scripts, leaderboard, and submission guidelines, visit: https://www.araseg.aramlab.ai/ Dataset Summary AraSeg is the first comprehensive benchmark for Arabic sentence segmentation. The corpus is designed to support research on sentence segmentation in Modern Standard Arabic (MSA), particularly in settings where punctuation is inconsistent, missing, or noisy. AraSeg contains… See the full description on the dataset page: https://huggingface.co/datasets/MBZUAI/AraSeg-2026-Shared-Task-NoPnx-NP.

sourceHugging Facemitupdated 4mo agoView on Hugging Face
1likes148downloads
Dataset Card

Arabic Sentence Segmentation Shared Task 2026

For details about the shared task, evaluation scripts, leaderboard, and submission guidelines, visit: https://www.araseg.aramlab.ai/

Dataset Summary

AraSeg is the first comprehensive benchmark for Arabic sentence segmentation. The corpus is designed to support research on sentence segmentation in Modern Standard Arabic (MSA), particularly in settings where punctuation is inconsistent, missing, or noisy. AraSeg contains manually annotated documents collected from diverse sources and genres, enabling robust evaluation across different writing styles and domains.

AraSeg-NoPnx-NP is the No-Punctuation No-Paragraph (NoPnx-NP) variant of the corpus where documents do not include paragraph boundaries or punctuation marks.


Dataset Structure

Data Instances

{'doc_id': 'doc_00b450a96684',
'tokens': ['الفصل','الأول','حين','ركبت','السيارة','لم','أكن','أتصور','أنني','أبدأ', ...],
'labels': [0, 1, 0, 0, 0, 0, 0, 0, 0, 0, ...],
'text': 'أبدأ الفصل الأول حين ركبت السيارة لم أكن أتصور أنني...',
'label_str': '0100000000...'}

Data Fields

  • —doc_id: Unique document identifier.
  • —tokens: White-space-tokenized document represented as a list of tokens.
  • —labels: Token-level sentence boundary labels. 1 indicates that a sentence boundary follows the current token, while 0 indicates no boundary.
  • —text: Document.
  • —label_str: Sentence boundary labels as a binary string. 1 indicates that a sentence boundary follows the current token, while 0 indicates no boundary.

Data Splits

  • —train: 174 documents (10,247 sentences and 98K words).
  • —dev: 222 documents (12,926 sentences and 128K words).
  • —test: 262 documents (12,342 sentences and 124K words). ---

Task Definition

Sentence segmentation is formulated as a binary token classification task.

Given a sequence of tokens: ``[token_1, token_2, ..., token_n]``, the model predicts for each token whether a sentence boundary follows it. For example:

TokenLabel
ذهب0
الطالب0
إلى0
المدرسة1

The label 1 indicates that the sentence ends after the token.


Evaluation

We evaluate systems using boundary-level metrics:

  • —Boundary Precision (P): Percentage of predicted sentence boundaries that are correct.
  • —Boundary Recall (R): Percentage of gold sentence boundaries correctly identified.
  • —Boundary F1 (F1): Harmonic mean of precision and recall.

Metrics are computed at the document level and averaged across the corpus.

We provide evaluation scripts on this repo.