Datasetpublic

PavanKumarJ-ARTPARK/Vaani_Noise_Event_TimeStamp

Vaani Noise Event Timestamps 🚧 Dataset Status: Actively Being Built Data is being uploaded in batches. Current coverage is a subset of the final planned corpus (~167 hrs train). Star/watch this repo to be notified of updates. Dataset Summary Vaani Noise Event Timestamps is a derived dataset from Project Vaani, a large-scale multilingual speech initiative by IISc Bangalore and ARTPARK that captures India's linguistic diversity across all districts. This dataset… See the full description on the dataset page: https://huggingface.co/datasets/PavanKumarJ-ARTPARK/Vaani_Noise_Event_TimeStamp.

sourceHugging Facecc-by-4.0updated 4mo agoView on Hugging Face

2likes59downloads

Dataset Card

Vaani Noise Event Timestamps

🚧 Dataset Status: Actively Being Built Data is being uploaded in batches. Current coverage is a subset of the final planned corpus (~167 hrs train). Star/watch this repo to be notified of updates.

Dataset Summary

Vaani Noise Event Timestamps is a derived dataset from Project Vaani, a large-scale multilingual speech initiative by IISc Bangalore and ARTPARK that captures India's linguistic diversity across all districts.

This dataset provides noise event annotations with fine-grained timestamps for the subset audio recordings from the Vaani corpus. Each entry identifies background noise categories along with their precise start and end times within the audio clip — enabling research in:

—Noise-robust Automatic Speech Recognition (ASR)
—Sound Event Detection (SED)
—Audio quality analysis in real-world Indian environments
—Speech enhancement and noise suppression

Noise Categories

The dataset covers 7 top-level noise categories with fine-grained subcategory timestamps:

#	Category	Example Events
1	`animal`	Barking, mooing, bird chirps, insect noise, cat, hen, goat
2	`vehicle_traffic`	Horns, engines, motorbikes, sirens, train, general traffic
3	`baby_child`	Crying, babbling, yelling, playing, child laughter
4	`singing_music`	Background music, singing, instruments, prayer, devotional
5	`phone_signal_alarm`	Ringtones, beeps, alarms, sirens, bells, doorbells
6	`appliance_machine`	Fans, mixers, TVs, mics, typing, clocks, machinery
7	`human_non_speech`	Breathing, lip smacks, coughs, sneezes, snoring, throat clearing

Data Statistics (Planned)

⚠️ The table below reflects the target distribution for the full corpus. Actual uploaded data may differ. Check the Dataset Viewer tab for current coverage.

#	Category	Target Train (hrs)
1	Animal	~40
2	Vehicle / Traffic	~40
3	Baby / Child	~24.2
4	Singing / Music	~13.4
5	Phone / Signal / Alarm	~7.98
6	Appliance / Machine	~1.89
7	Human Non-Speech	~40	~4
	Total	~167.47

Dataset Structure

Data Fields

Field	Type	Description
`audio`	`Audio`	Audio recording
`imageFileName`	`string`	File name of the image prompt shown during recording
`state`	`string`	Indian state where the recording was collected
`district`	`string`	District within the state
`duration`	`float64`	Duration of the audio clip in seconds
`language`	`string`	Language spoken by the participant
`isTranscriptionAvailable`	`bool`	Whether a manual transcript exists for this clip
`transcript`	`string`	Transcription with inline noise tags (e.g., `<horn>...</horn>`)
`NoiseCategory`	`list[string]`	Top-level noise categories present in the clip
`NoiseSubCategoryTimeStamp`	`list[dict]`	Noise events with fine-grained timestamps (see schema below)

`NoiseSubCategoryTimeStamp` Schema

Each item in the list is a dictionary:

Key	Type	Description
`category`	`string`	Top-level noise category (e.g., `vehicle_traffic`)
`tag`	`string`	Inline transcript tag marking the noise (e.g., `<horn>`)
`start`	`float32`	Start time of the noise event in seconds
`end`	`float32`	End time of the noise event in seconds

Example Record

json

{
  "imageFileName": "Images/IISc_VaaniProject_GENERIC_0760.jpg",
  "state": "ArunachalPradesh",
  "district": "Longding",
  "duration": 1.418,
  "language": "Hindi",
  "isTranscriptionAvailable": true,
  "transcript": "<horn> जो कि बच्चा लोग के लिए बनाया हुआ है। </horn>",
  "NoiseCategory": ["vehicle_traffic"],
  "NoiseSubCategoryTimeStamp": [
    {
      "category": "vehicle_traffic",
      "tag": "<horn>",
      "start": 0.013,
      "end": 1.399
    }
  ]
}

Supported Tasks

Task	Description
Sound Event Detection	Detect and localize noise events within audio clips
Audio Classification	Classify the type of ambient noise in a recording
Noise-Robust ASR	Train/evaluate ASR models under real-world noise conditions
Speech Enhancement	Use timestamps to guide noise suppression systems

Usage

python

from datasets import load_dataset

ds = load_dataset("PavanKumarJ-ARTPARK/Vaani_Noise_Event_TimeStamp")
print(ds)

# Access a sample
sample = ds["train"][0]
print(sample["NoiseCategory"])
# ['vehicle_traffic']

print(sample["NoiseSubCategoryTimeStamp"])
# [{'category': 'vehicle_traffic', 'tag': '<horn>', 'start': 0.013, 'end': 1.399}]

# Filter by noise category
vehicle_samples = [s for s in ds["train"] if "vehicle_traffic" in s["NoiseCategory"]]

Annotations

—Noise category labels and timestamps were annotated by trained annotators
—The transcript field contains inline noise tags (e.g., <horn>, <music>) marking where noise events occur within speech
—Timestamps are in seconds relative to the start of the audio clip
—A single clip can contain multiple overlapping noise events across different categories

Citation

If you use this data, please cite the following:

@misc{pulikodan2026vaanicapturinglanguagelandscape,
      title={VAANI: Capturing the language landscape for an inclusive digital India}, 
      author={Sujith Pulikodan and Abhayjeet Singh and Agneedh Basu and Nihar Desai and Pavan Kumar J and Pranav D Bhat and Raghu Dharmaraju and Ritika Gupta and Sathvik Udupa and Saurabh Kumar and Sumit Sharma and Vaibhav Vishwakarma and Visruth Sanka and Dinesh Tewari and Harsh Dhand and Amrita Kamat and Sukhwinder Singh and Shikhar Vashishth and Partha Talukdar and Raj Acharya and Prasanta Kumar Ghosh},
      year={2026},
      eprint={2603.28714},
      archivePrefix={arXiv},
      primaryClass={eess.AS},
      url={https://arxiv.org/abs/2603.28714}, 
}

Contact Us

We are eager to hear your feedback about the dataset and are open to new ideas for collaborations as well. Feel free to reach out to us at vaanicontact@gmail.com