CoolFace
Datasetpublic

fiifinketia/pristine-twi

Pristine Twi Dataset A large-scale Twi language dataset containing clean and naturally sounding Twi text across four distinct styles — monologue, narrative, dialogue, and storytelling — generated from real Ghanaian news topics as inspiration to keep it grounded on Ghanaian named entities and vocabulary. This dataset was built to support the development of Twi language models, tokenizers, and other NLP tools for the Akan language family. Dataset Details Field… See the full description on the dataset page: https://huggingface.co/datasets/fiifinketia/pristine-twi.

sourceHugging Facecc-by-4.0updated 6mo agoView on Hugging Face
0likes58downloads
Dataset Card

Pristine Twi Dataset

A large-scale Twi language dataset containing clean and naturally sounding Twi text across four distinct styles — monologue, narrative, dialogue, and storytelling — generated from real Ghanaian news topics as inspiration to keep it grounded on Ghanaian named entities and vocabulary.

This dataset was built to support the development of Twi language models, tokenizers, and other NLP tools for the Akan language family.

Dataset Details

FieldDetail
LanguageTwi (tw) — Akan, Ghana
LicenseCC BY 4.0
AuthorMich-Seth Owusu
OrganizationGhana NLP Community
FormatParquet (columnar)

Columns

ColumnTypeDescription
twistringTwi text snippet
stylestringMonologue, Narrative, Dialogue, Storyful
char_countintCharacter count of the Twi text

Text Styles

The dataset contains Twi text categorized into four distinct styles:

  • —Monologue (ɔkasafo biako) — passionate, personal perspective
  • —Narrative (abakɔsɛm) — journalistic, structured account
  • —Dialogue (nkɔmmɔdie) — conversational exchange
  • —Storyful (anansesɛm) — dramatic, metaphorical storytelling

Generation

Text was generated using the Gemini API with Ghanaian news paragraphs as prompts, separated into stylistic chunks, then cleaned to remove speaker labels, markdown artifacts, and any responses that failed Twi language validation.

The code for generating the dataset can be found here: https://github.com/GhanaNLP/NLP-scripts/blob/main/text/generate_twi-gemini.py

Made with ❤️ by Mich-Seth Owusu for the Ghana NLP Community