agnivamaiti/naganlp-pos-annotated-corpus

NagaNLP POS Annotated Corpus

Dataset Summary

This dataset contains 214 sentences in Nagamese (Naga Pidgin) annotated for Part-of-Speech (POS) tagging. It is part of the NagaNLP project, which builds foundational NLP resources for Nagamese, a low-resource creole spoken across Nagaland and the wider Northeast India region. This dataset shares its underlying sentences with naganlp-ner-annotated-corpus, but is published standalone as a lighter-weight resource for users who only need POS tags.

Supported Tasks

• —Part-of-Speech Tagging: Universal POS tags for each token.

Languages

Nagamese / Naga Pidgin (ISO 639-3: nag), a creole widely used as a lingua franca across Nagaland and neighboring Northeast Indian states.

Dataset Structure

Data Instance

{
  "tokens": ["Northeast", "Monsoon", "joldi", "aahi", "jaishe"],
  "pos_tags": ["PROPN", "PROPN", "ADV", "VERB", "VERB"]
}

Data Fields

• —tokens: list of strings — the tokenized sentence.
• —pos_tags: list of strings — Universal POS tags (NOUN, VERB, PROPN, ADJ, ADV, PRON, ADP, SCONJ, CCONJ, PART, NUM, PUNCT, etc.).

Data Splits

There is currently only a single train split.

Dataset Creation

Source Data

Sentences cover regional news and everyday topics (weather, sports, local government, current affairs), constructed and annotated via the human-in-the-loop synthetic data pipeline described in the NagaNLP paper.

Annotations

Tokens were POS-tagged using the Universal Dependencies tagset as part of the NagaNLP annotation pipeline.

Considerations for Using the Data

Limitations

• —Small scale (214 sentences / ~4,800 tokens) — best used for fine-tuning or evaluation, not for training a tagger from scratch.
• —Some source sentences were constructed via a human-in-the-loop synthetic pipeline rather than sampled purely from organic text — see the paper for full methodology.
• —If you need entity annotations as well as POS, use naganlp-ner-annotated-corpus, which contains the same sentences plus BIO NER tags.

Licensing

Licensed under CC BY-NC 4.0 (attribution required, non-commercial use only). For commercial licensing inquiries, please contact the author.

Citation

@misc{maiti2025naganlp,
      title={NagaNLP: Bootstrapping NLP for Low-Resource Nagamese Creole with Human-in-the-Loop Synthetic Data},
      author={Agniva Maiti and Manya Pandey and Murari Mandal},
      year={2025},
      eprint={2512.12537},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2512.12537}
}

Contact

Agniva Maiti — KIIT University — HuggingFace: agnivamaiti