CoolFace
Datasetpublic

Data-Science-Nigeria/voice-of-care-health-dataset

Voice of Care AI for Global Health Benchmark Dataset Overview This dataset contains spoken Hausa Health datasets with rich annotations covering emotion, intent, speaker demographics, and dialect variation, intended for speech and NLP research. Dataset Summary Property Details Language Hausa Modality Audio + Text Task(s) e.g. Speech Recognition, Emotion Detection, Dialect Identification Version 1.0.0 πŸ› οΈ Dataset… See the full description on the dataset page: https://huggingface.co/datasets/Data-Science-Nigeria/voice-of-care-health-dataset.

sourceHugging Facecc-by-4.0updated 2mo agoView on Hugging Face
1likes89downloads
Dataset Card

Voice of Care AI for Global Health Benchmark Dataset


Overview

This dataset contains spoken Hausa Health datasets with rich annotations covering emotion, intent, speaker demographics, and dialect variation, intended for speech and NLP research.


Dataset Summary

PropertyDetails
LanguageHausa
ModalityAudio + Text
Task(s)e.g. Speech Recognition, Emotion Detection, Dialect Identification
Version1.0.0

πŸ› οΈ Dataset Structure and Features

ColumnTypeDescription
audio_idstringUnique identifier for each audio recording
sentence_idstringUnique identifier for each sentence
transcriptstringOriginal Hausa transcription of the spoken sentence
englishstringOriginal English sentence
micro_intentstringFine-grained communicative intent (e.g. symptom reporting, information seeking, clinical assessment)
emotion_tonestringEmotional tone conveyed in the utterance (e.g. concerned, neutral, calm, reassuring)
speaker_typestringCategory of speaker (e.g. patient statement, patient question, caregiver question, patient statement β†’ caregiver question
genderstringGender of the speaker
DialectstringHausa dialect variant spoken by the speaker
AgeintegerAge of the speaker
UseridstringAnonymized identifier for the speaker/contributor
audiostringThis is the voiced audio

Summary Statistics

  • β€”Count of Participants: 50
  • β€”Number of Dialects: 4
  • β€”Male Speakers: 25
  • β€”Female Speakers: 25
  • β€”Number of Unique Audio Clips: 30,000
  • β€”Number of Intents: 13
  • β€”Female Audio Clips: 15,000
  • β€”Male Audio Clips: 15,000
  • β€”Total Hours: 52 hrs

User ID Convention

Format: {ORG}{GENDER}{DIALECT}{AGEGROUP}_{NUMBER}

Example: EHAFKN0001

Where:

  • β€”EHA = Organization
  • β€”Gender
  • β€”Female = F
  • β€”Male = M
  • β€”Dialect
  • β€”Kananci = KN
  • β€”Katsinanci = KT
  • β€”Sakkwatanci = SK
  • β€”Zazzaganci = ZZ
  • β€”Age Group
  • β€”15–29 = 0
  • β€”30–45 = 1
  • β€”45+ = 2 Number = Sequential participant number padded to 3 digits (e.g., 001, 002, 003)

Data Collection

The prompts were provided by the eHealth team and subsequently translated into Hausa. Each prompt was carefully classified according to predefined categories, including emotion categories, micro-intents, speaker type, patient statements, patient questions, and caregiver questions. After the classification process, the prompts were converted into speech using the EqualyzAI data collection platforms (Equalyz Crowd and Equalyz Gram). The generated voice recordings were then reviewed and validated by the EHA team through the Equalyz Gram platform to ensure quality, accuracy, and consistency with the intended content.


πŸ’» Loading the Dataset (Hugging Face)

The dataset is configured for easy loading of the dataset.

Recommended Environment

bash
pip install --upgrade datasets[audio]
pip install --upgrade ffmpeg ffmpeg-python

Standard Load

python
from datasets import load_dataset

# Load the full train
ds_train = load_dataset("Data-Science-Nigeria/voice-of-care-health-dataset", "default", split="train")

# Load a specific split (e.g., development)
ds_test = load_dataset("Data-Science-Nigeria/voice-of-care-health-dataset", "default", split="test")

Streaming Mode (for memory efficiency)

python
from datasets import load_dataset

# Load the dev_test split in streaming mode
ds_stream = load_dataset(
    "Data-Science-Nigeria/voice-of-care-health-dataset", 
    "default", 
    split="test", 
    streaming=True
)

Benchmarking

Benchmark Results

The Hausa Health Spoken Dialogue Corpus was benchmarked across two core capabilities:

  1. 1.Intent Classification β€” measuring the ability of machine learning models to identify the intent expressed in patient and caregiver statements.
  2. 2.Automatic Speech Recognition (ASR) β€” evaluating the quality and accuracy of speech transcription models on Hausa healthcare conversations.

Intent Classification Benchmark

A machine learning model was trained and evaluated to classify the intent behind patient and caregiver statements using annotated transcripts and corresponding intent labels.

The model's objective is to automatically identify the purpose of a speaker's message, such as reporting symptoms, requesting information, discussing clinical assessments, expressing medication concerns, or requesting follow-up support. This enables faster triage, structured analysis of conversational data, and development of healthcare-focused AI applications.

On a held-out test set, the model achieved an overall accuracy of 96.1%. Performance was strong across the most common intent categories, while less frequent categories showed lower reliability due to limited examples. Additional data collection for underrepresented intents is expected to further improve model performance.

IntentPrecisionRecallF1 ScoreSupport
Information seeking0.990.980.991126
Clinical assessment0.990.980.98819
Diagnosis / results communication0.980.980.9847
Symptom reporting0.960.980.97543
Prevention and counselling0.940.980.96824
Referral0.940.910.9335
Risk / history / context disclosure0.930.910.92270
Treatment0.870.880.87104
Follow-up / status update0.900.770.8373
Vaccine recommendation / administration0.800.760.78106
Medication concern0.860.550.6711

Automatic Speech Recognition (ASR) Benchmark

The dataset was evaluated using several speech recognition models to measure transcription quality for Hausa healthcare conversations.

Evaluation metrics:

  • β€”Word Error Rate (WER): Measures the percentage of incorrectly transcribed words. Lower values indicate better transcription performance.
  • β€”Character Error Rate (CER): Measures the percentage of incorrectly transcribed characters and provides a more fine-grained measure for languages with complex morphology, such as Hausa.

Models evaluated:

  • β€”Whisper Large-v3
  • β€”XLSR-53
  • β€”MMS-1B-fl102
ModelParametersTest WERTest CERExamples Scored
Whisper Large-v31.55B26.87%9.09%4,200 / 4,200
XLSR-53315M18.05%4.33%4,200 / 4,200
MMS-1B-fl102 (full)1B20.13%7.36%4,200 / 4,200

πŸš€ Intended Use & Applications

This dataset is specifically designed for the following purposes:

  • β€”Automatic Speech Recognition (ASR) Training
  • β€”NLP for low-resource African languages
  • β€”Cross-lingual learning and transfer learning research
  • β€”Evaluation of multilingual ASR systems
  • β€”Linguistic research and accent/dialect modeling

β›” Use Restrictions & Limitations

To protect speaker privacy and prevent potential voice misuse, the following uses are strictly enforced:

Strictly Prohibited Uses πŸ›‘

  • β€”Voice cloning or adaptation (Text-to-Speech/TTS)
  • β€”Voice biometrics, speaker identification, or mimicry
  • β€”Surveillance, profiling, or any commercial application that relies on identifying or imitating individuals

Limitations ⚠️

  • β€”Not suitable for biometric or forensic use

βš–οΈ License and Citation

License

This dataset is released under the Creative Commons Attribution 4.0 (CC BY 4.0) license.


πŸ“§ Contact & Support

For questions, issues, or collaboration inquiries, please open an issue on the repository or contact the maintainers directly.


Maintainer: This dataset was commissioned by eHealth Africa Clinics (EHA) and developed in partnership with Data Science Nigeria / EqualyzAI as part of the Voices of Care AI for Global Health Benchmarking Initiative, funded by The Agency Fund.