CoolFace
Datasetpublic

disco-eth/WorldSpeech

WorldSpeech A multilingual ASR dataset containing over 65k hours of human transcribed speech across 127 language-region variants, drawn from national parliaments, public broadcasters, public-domain audiobooks, and international institutions. Rows consist of 24 kHz speech utterances paired with a human-provided transcript, an aligned ASR transcript, character error rate (CER) between the two, a WADA-SNR estimate, and four DNSMOS-P.835 quality scores. Dataset Overview… See the full description on the dataset page: https://huggingface.co/datasets/disco-eth/WorldSpeech.

sourceHugging Facecc-by-nc-4.0updated 4mo agoView on Hugging Face
49likes54kdownloads
Dataset Card

WorldSpeech

A multilingual ASR dataset containing over 65k hours of human transcribed speech across 127 language-region variants, drawn from national parliaments, public broadcasters, public-domain audiobooks, and international institutions. Rows consist of 24 kHz speech utterances paired with a human-provided transcript, an aligned ASR transcript, character error rate (CER) between the two, a WADA-SNR estimate, and four DNSMOS-P.835 quality scores.

Dataset Overview

MetricValue
Total hours65,072
Distinct languages88 (76 above 10 hours)
Language variations127
Languages ≥ 1,000 h24
Languages ≥ 500 h28
Languages ≥ 200 h37
Languages ≥ 50 h53
Avg DNSMOS-P.835 OVR2.83
Sample rate24 kHz

How to use

python
from datasets import load_dataset

ds = load_dataset("disco-eth/WorldSpeech", "nl_nl", split="train")

row = ds[0]
wav    = row["audio"]["array"]         
sr     = row["audio"]["sampling_rate"]
text   = row["human_transcript"]
snr    = row["snr"]
dnsmos = row["dnsmos_ovr"]

Streaming

python
from datasets import load_dataset

ds = load_dataset("disco-eth/WorldSpeech", "nl_nl", split="train", streaming=True)

for row in ds:
    wav = row["audio"]["array"]
    break

Schema

FieldDescription
audioOGG Opus decoded to {"array": np.float32[N], "sampling_rate": 24000}
human_transcriptHuman-provided transcript
asr_transcriptASR output used for alignment and CER computation
cerCharacter error rate between asr_transcript and human_transcript
snrWADA-SNR estimate, dB
dnsmos_sigDNSMOS-P.835 signal quality
dnsmos_bakDNSMOS-P.835 background noise
dnsmos_ovrDNSMOS-P.835 overall MOS
dnsmos_p808DNSMOS-P.808 MOS
durationSegment duration in seconds
sourceSource identifier (e.g. parliament_nl, librivox, voa_hausa)
source_urlURL to the original recording
source_start_sStart offset within the source recording (seconds)
source_end_sEnd offset within the source recording (seconds)
session_dateISO-8601 date of the original recording
segment_idUnique identifier for this segment
languageBCP-47 language tag
countryISO 3166-1 alpha-2 country code (un / va for international)

Language Coverage

ConfigCountryLanguageHoursDNSMOS OVR
af_zaSouth AfricaAfrikaans20.22.79
am_etEthiopiaAmharic39.63.11
ar_bhBahrainArabic272.52.72
ar_dzAlgeriaArabic92.92.66
ar_egEgyptArabic22.02.86
ar_iqIraqArabic291.92.94
ar_kwKuwaitArabic175.52.82
ar_maMoroccoArabic78.32.68
ar_saSaudi ArabiaArabic6.12.01
ar_tnTunisiaArabic50.92.74
ar_unUnited NationsArabic11.13.03
as_inIndiaAssamese54.53.06
az_azAzerbaijanAzerbaijani305.42.76
be_byBelarusBelarusian24.23.10
bn_bdBangladeshBengali46.13.03
bn_inIndiaBengali26.72.83
ca_esSpainCatalan1,171.02.99
ckb_iqIraqSorani Kurdish35.32.93
cn_ugChinaUyghur200.02.86
cnr_meMontenegroMontenegrin47.92.98
crs_scSeychellesKreol Seselwa1,602.33.15
cs_czCzech RepublicCzech3,717.42.86
de_atAustriaGerman1,077.52.93
de_liLiechtensteinGerman829.72.79
dgo_inIndiaDogri34.53.17
dv_mvMaldivesDhivehi20.02.92
el_cyCyprusGreek394.42.90
el_grGreeceGreek35.93.37
en_auAustraliaEnglish568.43.02
en_jmJamaicaEnglish9.62.52
en_keKenyaEnglish170.02.97
en_nzNew ZealandEnglish435.72.68
en_pkPakistanEnglish8.52.28
en_slSierra LeoneEnglish102.42.70
en_usUSAEnglish3,725.92.85
en_zmZambiaEnglish291.62.70
eo(international)Esperanto15.03.27
es_arArgentinaSpanish251.72.78
es_clChileSpanish1,740.52.94
es_coColombiaSpanish156.82.75
es_esSpainSpanish2,097.42.52
es_mxMexicoSpanish901.62.63
es_pePeruSpanish387.42.63
es_prPuerto RicoSpanish228.62.73
es_pyParaguaySpanish133.23.14
es_uyUruguaySpanish894.42.94
fa_irIranPersian27.62.94
ca_frCanadaFrench5,989.32.88
fr_cdDR CongoFrench28.03.00
fr_ciCôte d'IvoireFrench11.92.97
ga_ieIrelandIrish60.63.00
grc_grGreeceAncient Greek1.33.25
gu_inIndiaGujarati27.23.09
ha_ngNigeriaHausa54.92.88
ha_tdChadHausa71.52.87
he_ilIsraelHebrew41.83.21
hi_inIndiaHindi1,706.72.68
hu_huHungaryHungarian1,350.12.96
hy_amArmeniaArmenian1,138.92.59
id_idIndonesiaIndonesian340.02.95
ig_ngNigeriaIgbo40.73.31
iu_caCanadaInuktitut33.82.81
ja_jpJapanJapanese1,387.22.86
ka_geGeorgiaGeorgian206.42.37
kh_kmCambodiaKhmer1,323.02.85
kk_kzKazakhstanKazakh179.02.84
kn_inIndiaKannada30.23.19
ko_krSouth KoreaKorean1,454.13.07
kok_inIndiaKonkani0.73.19
la_loLaosLao827.02.82
la_vaVaticanLatin34.83.37
lb_luLuxembourgLuxembourgish1,805.32.87
mai_inIndiaMaithili9.63.19
mfe_muMauritiusMauritian Creole44.33.45
mi_nzNew ZealandMāori1.62.85
ml_inIndiaMalayalam56.73.10
mm_myMyanmarBurmese865.02.88
mn_mnMongoliaMongolian181.02.80
mr_inIndiaMarathi114.33.17
ms_myMalaysiaMalay432.02.91
ne_inIndiaNepali5.72.94
ne_npNepalNepali58.02.79
nl_beBelgiumDutch (Flemish)960.52.59
nl_nlNetherlandsDutch4,497.63.00
nr_zaSouth AfricaSouthern Ndebele0.22.60
nso_zaSouth AfricaNorthern Sotho0.72.70
om_etEthiopiaOromo16.33.06
or_inIndiaOdia57.83.05
pa_inIndiaPunjabi4.02.61
pl_plPolandPolish2,731.92.70
pt_brBrazilPortuguese1,763.52.68
rm_chSwitzerlandRomansh163.13.14
ro_mdMoldovaRomanian1,059.52.66
ro_roRomaniaRomanian686.32.75
ru_byBelarusRussian2.92.79
ru_ruRussiaRussian1,534.23.03
rw_rwRwandaKinyarwanda17.62.63
rw_voaRwandaKinyarwanda (VOA)14.52.77
si_lkSri LankaSinhala154.02.40
sm_wsSamoaSamoan55.92.79
sn_zwZimbabweShona18.22.88
sq_alAlbaniaAlbanian257.42.69
sq_xkKosovoAlbanian176.62.69
ss_zaSouth AfricaSwati0.12.84
st_zaSouth AfricaSesotho0.42.67
sv_axÅland IslandsSwedish66.02.73
sw_keKenyaSwahili257.42.93
sw_tzTanzaniaSwahili748.82.33
ta_inIndiaTamil36.13.06
ta_lkSri LankaTamil204.02.80
te_inIndiaTelugu77.03.13
th_thThailandThai1,175.63.23
ti_etEthiopiaTigrinya14.03.10
tl_phPhilippinesTagalog219.02.88
tn_bwBotswanaTswana49.72.88
tn_zaSouth AfricaTswana0.92.69
tr_trTurkeyTurkish1,007.62.22
ts_zaSouth AfricaTsonga0.22.75
ur_inIndiaUrdu12.63.01
ur_pkPakistanUrdu73.12.44
uz_uzUzbekistanUzbek33.72.84
ve_zaSouth AfricaVenda0.12.72
vn_viVietnamVietnamese726.02.90
xh_zaSouth AfricaXhosa10.12.74
yue_hkHong KongCantonese1,943.53.02
zh_twTaiwanMandarin1,482.12.47
zu_zaSouth AfricaZulu19.02.71
Total65,072.42.83

⚠️ Five configs (kh_km Khmer, la_lo Lao, mm_my Burmese, vn_vi Vietnamese, cn_ug Uyghur, sourced from Radio Free Asia include only metadata, transcripts, and source URLs. Audio must be downloaded separately from source_url.

Citation

If you use WorldSpeech in your research, please cite:

bibtex
@misc{asonitis2026worldspeechmultilingualspeechcorpus,
      title={WorldSpeech: A Multilingual Speech Corpus from Around the World}, 
      author={Antonis Asonitis and Luca A. Lanzendörfer and Frédéric Berdoz and Roger Wattenhofer},
      year={2026},
      eprint={2605.09167},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2605.09167}, 
}

Dataset License

WorldSpeech is released under CC BY-NC 4.0. Individual source licenses apply per config and are listed in the Licenses section. Where a source license is more restrictive than CC BY-NC 4.0, the more restrictive terms govern that config.

Licenses

ConfigCountry / LanguageLicenseNotes
af_zaSouth Africa / AfrikaansParliamentary Proceedings
am_etEthiopia / AmharicPublic Domain (17 USC §105)US federal agency content (VOA).
ar_bhBahrain / ArabicParliamentary Proceedings
ar_dzAlgeria / ArabicParliamentary Proceedings
ar_egEgypt / ArabicParliamentary Proceedings
ar_iqIraq / ArabicParliamentary Proceedings
ar_kwKuwait / ArabicParliamentary Proceedings
ar_maMorocco / ArabicParliamentary Proceedings
ar_saSaudi Arabia / ArabicGovernment Archive (Public Record)
ar_tnTunisia / ArabicParliamentary Proceedings
ar_unUnited Nations / ArabicUN Official RecordsUN official records; non-commercial/research use per UN terms. Contact permissions@un.org for commercial use.
as_inIndia / AssameseAll India Radio Archive (Prasar Bharati)Prasar Bharati public broadcaster archive.
az_azAzerbaijan / AzerbaijaniPublic Domain (17 USC §105)US federal agency content (VOA).
be_byBelarus / BelarusianCC BY-NC-SA 4.0
bn_bdBangladesh / BengaliPublic Domain (17 USC §105)US federal agency content (VOA).
bn_inIndia / BengaliAll India Radio Archive (Prasar Bharati)Prasar Bharati public broadcaster archive.
ckb_iqIraq / Sorani KurdishParliamentary Proceedings
cn_ugChina / UyghurRFA Terms of Use (non-commercial)Metadata only — audio not embedded. Download audio from source_url. Non-commercial research use; see RFA terms.
cnr_meMontenegro / MontenegrinParliamentary Proceedings
crs_scSeychelles / Kreol SeselwaParliamentary Proceedings
cs_czCzech Republic / CzechParliamentary Proceedings
cz_csCzech Republic / CzechParliamentary ProceedingsCzech Senate (Senát Parlamentu ČR).
de_atAustria / GermanParliamentary Proceedings
de_liLiechtenstein / GermanParliamentary Proceedings
dgo_inIndia / DogriAll India Radio Archive (Prasar Bharati)Prasar Bharati public broadcaster archive.
dv_mvMaldives / DhivehiParliamentary Proceedings
el_cyCyprus / GreekParliamentary Proceedings
el_grGreece / GreekParliamentary Proceedings
en_auAustralia / EnglishParliamentary Proceedings
en_jmJamaica / EnglishParliamentary Proceedings
en_keKenya / EnglishParliamentary Proceedings
en_nzNew Zealand / EnglishParliamentary Proceedings
en_slSierra Leone / EnglishParliamentary Proceedings
en_usUSA / EnglishPublic Domain (17 USC §105)US federal proceedings (Congress.gov / C-SPAN public domain content).
en_zmZambia / EnglishParliamentary Proceedings
eo(international) / EsperantoCC0 1.0 (Public Domain)
es_arArgentina / SpanishParliamentary Proceedings
es_clChile / SpanishParliamentary Proceedings
es_coColombia / SpanishParliamentary Proceedings
es_esSpain / SpanishParliamentary Proceedings
es_mxMexico / SpanishParliamentary Proceedings
es_pePeru / SpanishParliamentary Proceedings
es_prPuerto Rico / SpanishParliamentary Proceedings
es_pyParaguay / SpanishParliamentary Proceedings
es_uyUruguay / SpanishParliamentary Proceedings
fa_irIran / PersianPublic Domain (17 USC §105)US federal agency content (VOA).
ca_frCanada / FrenchParliamentary Proceedings
fr_cdDR Congo / FrenchICC Court RecordsPublic judicial proceedings of an international court; non-commercial/educational use per ICC terms.
fr_ciCote d'Ivoire / FrenchICC Court RecordsPublic judicial proceedings of an international court; non-commercial/educational use per ICC terms.
ga_ieIreland / IrishCC BY 4.0 (Oireachtas PSI Licence)
grc_grGreece / Ancient GreekCC0 1.0 (Public Domain)
gu_inIndia / GujaratiAll India Radio Archive (Prasar Bharati)Prasar Bharati public broadcaster archive.
ha_ngNigeria / HausaPublic Domain (17 USC §105)US federal agency content (VOA).
ha_tdChadPublic Domain (17 USC §105)US federal agency content (VOA).
he_ilIsrael / HebrewCC0 1.0 (Public Domain)LibriVox recordings (CC0) + Ben-Yehuda Project texts (public domain per Israeli copyright law).
hi_inIndia / HindiParliamentary Proceedings
hu_huHungary / HungarianParliamentary Proceedings
hy_amArmenia / ArmenianParliamentary Proceedings
id_idIndonesia / IndonesianPublic Domain (17 USC §105)US federal agency content (VOA).
ig_ngNigeria / IgboPublic Domain (17 USC §105)US federal agency content (VOA).
iu_caCanada / InuktitutParliamentary Proceedings
ja_jpJapan / JapaneseCC0 1.0 (Public Domain)LibriVox recordings (CC0) + Aozora Bunko texts (public domain, 50yr Japanese law).
ka_geGeorgia / GeorgianParliamentary Proceedings
kh_kmCambodia / KhmerRFA Terms of Use (non-commercial)Metadata only — audio not embedded. Download audio from source_url. Non-commercial research use; see RFA terms.
kk_kzKazakhstan / KazakhParliamentary Proceedings
kn_inIndia / KannadaAll India Radio Archive (Prasar Bharati)Prasar Bharati public broadcaster archive.
ko_krSouth Korea / KoreanParliamentary Proceedings
kok_inIndia / KonkaniAll India Radio Archive (Prasar Bharati)Prasar Bharati public broadcaster archive.
la_loLaos / LaoRFA Terms of Use (non-commercial)Metadata only — audio not embedded. Download audio from source_url. Non-commercial research use; see RFA terms.
la_vaVatican / LatinVatican Radio ArchiveVatican Radio historical archive; contact Vatican Media for commercial use.
lb_luLuxembourg / LuxembourgishParliamentary Proceedings
mai_inIndia / MaithiliAll India Radio Archive (Prasar Bharati)Prasar Bharati public broadcaster archive.
mfe_muMauritius / Mauritian CreoleParliamentary Proceedings
mi_nzNew Zealand / MaoriParliamentary Proceedings
ml_inIndia / MalayalamParliamentary Proceedings
mm_myMyanmar / BurmeseRFA Terms of Use (non-commercial)Metadata only — audio not embedded. Download audio from source_url. Non-commercial research use; see RFA terms.
mn_mnMongolia / MongolianParliamentary Proceedings / CC0Parliament sessions (public record) + Latter-day Saints addresses (CC0 per lds.org).
mr_inIndia / MarathiParliamentary Proceedings
ms_myMalaysia / MalayParliamentary Proceedings
ne_inIndia / NepaliAll India Radio Archive (Prasar Bharati)Prasar Bharati public broadcaster archive.
ne_npNepal / NepaliParliamentary Proceedings
nl_beBelgium / DutchParliamentary Proceedings
nl_nlNetherlands / DutchParliamentary Proceedings
nr_zaSouth Africa / Southern NdebeleParliamentary Proceedings
nso_zaSouth Africa / Northern SothoParliamentary Proceedings
om_etEthiopia / OromoPublic Domain (17 USC §105)US federal agency content (VOA).
or_inIndia / OdiaAll India Radio Archive (Prasar Bharati)Prasar Bharati public broadcaster archive.
pa_inIndia / PunjabiParliamentary Proceedings
pl_plPoland / PolishParliamentary Proceedings
pt_brBrazil / PortugueseParliamentary Proceedings
rm_chSwitzerland / RomanshSRG SSR Terms of UseCorpus compiled from publicly broadcast RTR programming; contact SRG SSR for commercial use.
ro_mdMoldova / RomanianParliamentary Proceedings
ro_roRomania / RomanianParliamentary Proceedings
ru_byBelarus / RussianGovernment Publication (Public Record)
ru_ruRussia / RussianParliamentary Proceedings
rw_rwRwanda / KinyarwandaParliamentary Proceedings
si_lkSri Lanka / SinhalaParliamentary Proceedings
sm_wsSamoa / SamoanParliamentary Proceedings
sn_zwZimbabwe / ShonaPublic Domain (17 USC §105)US federal agency content (VOA).
sq_alAlbania / AlbanianParliamentary Proceedings
sq_xkKosovo / AlbanianParliamentary Proceedings
ss_zaSouth Africa / SwatiParliamentary Proceedings
st_zaSouth Africa / SesothoParliamentary Proceedings
sv_axAland Islands / SwedishParliamentary Proceedings
sw_keKenya / SwahiliParliamentary Proceedings
sw_tzTanzania / SwahiliParliamentary Proceedings
ta_inIndia / TamilAll India Radio Archive (Prasar Bharati)Prasar Bharati public broadcaster archive.
ta_lkSri Lanka / TamilParliamentary Proceedings
te_inIndia / TeluguAll India Radio Archive (Prasar Bharati)Prasar Bharati public broadcaster archive.
th_thThailand / ThaiParliamentary Proceedings
ti_etEthiopia / TigrinyaPublic Domain (17 USC §105)US federal agency content (VOA).
tl_phPhilippines / TagalogParliamentary Proceedings
tn_bwBotswana / TswanaParliamentary Proceedings
tn_zaSouth Africa / TswanaParliamentary Proceedings
tr_trTurkey / TurkishParliamentary Proceedings
ts_zaSouth Africa / TsongaParliamentary Proceedings
ur_inIndia / UrduAll India Radio Archive (Prasar Bharati)Prasar Bharati public broadcaster archive.
uz_uzUzbekistan / UzbekRFE/RL Terms of Use (non-commercial)US government-funded broadcaster; non-commercial research use. Original Ozodlik (RFE/RL Uzbek) content.
ve_zaSouth Africa / VendaParliamentary Proceedings
vn_viVietnam / VietnameseRFA Terms of Use (non-commercial)Metadata only — audio not embedded. Download audio from source_url. Non-commercial research use; see RFA terms.
xh_zaSouth Africa / XhosaParliamentary Proceedings
yue_hkHong Kong / CantoneseParliamentary Proceedings
zh_twTaiwan / Chinese (Mandarin)Parliamentary Proceedings
zu_zaSouth Africa / ZuluParliamentary Proceedings