Datasetpublic

AfriSpeech/webonary-african-wordlists

Webonary African Wordlists Aggregated and cleaned dictionary wordlists for 168 African languages scraped from Webonary, containing 562,573 unique headwords and 725,843 total translation/gloss rows. Each language is provided as an independent dataset configuration (subset). Dataset Structure Each subset contains the following columns: slug: Webonary language identifier slug language: Language display name iso: ISO 639-3 code country: Country code(s) (ISO 3166-1… See the full description on the dataset page: https://huggingface.co/datasets/AfriSpeech/webonary-african-wordlists.

sourceHugging Facecc-by-sa-4.0updated 6d agoView on Hugging Face

0likes152downloads

Dataset Card

Webonary African Wordlists

Aggregated and cleaned dictionary wordlists for 168 African languages scraped from Webonary, containing 562,573 unique headwords and 725,843 total translation/gloss rows. Each language is provided as an independent dataset configuration (subset).

Dataset Structure

Each subset contains the following columns:

—slug: Webonary language identifier slug
—language: Language display name
—iso: ISO 639-3 code
—country: Country code(s) (ISO 3166-1 alpha-2)
—letter: Dictionary browsing letter
—headword: Source-language headword
—homograph: Homograph disambiguation number
—pos: Part of speech / grammatical info
—sense_no: Sense number
—gloss: Translation / gloss (primarily in French or English)
—gloss_lang: Language of the gloss (fr, en, etc.)

Usage

Load a specific language subset using Hugging Face datasets:

python

from datasets import load_dataset

# Load Adele language wordlist
dataset = load_dataset("AfriSpeech/webonary-african-wordlists", name="adele")
print(dataset["train"][0])

Statistics per Language

Language	ISO 639-3	Countries	Headwords	Gloss Rows
`adele`	`ade`	`GH;TG`	2,613	2,446
`ajagbe`	`ajg`	`BJ;TG`	8,649	13,173
`akebu`	`keu`	`TG`	843	830
`akoose`	`bss`	`CM`	4,200	5,447
`ashe`	`ahs`	`NG`	966	1,854
`baatonum`	`bba`	`BJ;NG`	7,838	7,855
`babessi`	`bse`	`CM`	1,314	1,840
`babungo`	`bav`	`CM`	1,935	2,259
`baca`	`baf`	`CM`	668	1,290
`badwe`	`ozm`	`CM`	5,047	4,882
`bafut`	`bfd`	`CM`	3,287	4,052
`bakaka`	`bqz`	`CM`	1,556	1,693
`balandaviri`	`bvi`	`SS`	1,555	1,713
`basaa`	`bas`	`CM`	19,898	21,303
`belandabor`	`bxb`	`SS`	1,046	1,057
`beli`	`blm`	`SS`	1,243	1,305
`bimoba`	`bim`	`GH;TG`	4,196	4,243
`bissa-barka`	`bib`	`BF;CI;GH;TG`	9,055	8,587
`bongili`	`bui`	`CG`	1,755	1,802
`bongo`	`bot`	`SD;SS`	1,356	1,399
`borna-shinasha`	`bwo`	`ET`	2,249	2,478
`buli`	`bwu`	`GH`	3,701	5,361
`bulu`	`bum`	`CM`	6,932	238
`caning`	`shj`	`SD`	1,246	1,245
`centralchadic`	``	``	176	2,219
`cerma`	`cme`	`BF;CI`	4,676	5,033
`chibne-soumraye`	`sor`	`TD`	1,723	2,571
`chufie`	`bfj`	`CM`	1,914	2,451
`chung`	`cnq`	`CM`	1,912	3,435
`chuwabo`	`chw`	`MZ`	1,934	2,088
`clela`	`dri`	`NG`	6,091	5,050
`daani`	`bmq`	`BF;ML`	836	980
`daba`	`dbq`	`CM;NG`	2,346	2,284
`dagbani`	`dag`	`GH;TG`	6,991	9,736
`dangla`	`daa`	`TD`	8,273	8,594
`dazaga`	`dzg`	`LY;NE;SD;TD`	3,770	4,533
`dholuo`	`luo`	`KE;TZ`	5,866	5,567
`dii`	`dur`	`CM`	4,606	6,431
`dinka-southwestern`	`dik`	`SD;SS`	6,779	8,108
`djimini`	`dyi`	`CI`	9,891	9,939
`elip`	`ekm`	`CM`	627	1,216
`ellomwe`	`lon`	`MW;MZ`	1,318	1,174
`engwo`	`ngn`	`CM`	5,720	5,399
`fungwa`	`ula`	`NG`	711	629
`gaahmg`	`tbi`	`SD`	1,218	1,206
`gbaya`	`gya`	`CF;CG;CM;NG`	4,995	7,110
`gikyode`	`acd`	`GH;TG`	2,810	2,343
`gonja`	`gjn`	`GH`	4,010	3,799
`gunu`	`yas`	`CM`	1,232	1,272
`gurene`	`gur`	`BF;GH`	4,167	5,141
`gusiilaay`	`gsl`	`SN`	8,196	8,818
`gwama`	`kmq`	`ET`	3,844	4,051
`hanga`	`hag`	`GH`	2,817	3,507
`ife`	`ife`	`BJ;TG`	1,784	2,907
`ikizu`	`ikz`	`TZ`	3,539	7,788
`jumjum`	`jum`	`SD;SS`	572	584
`kabiye`	`kbp`	`BJ;GH;TG`	7,982	8,397
`kabwa`	`cwa`	`TZ`	4,329	9,887
`karaboro`	`xrb`	`BF;CI`	2,328	2,724
`karang`	`kzr`	`CM;TD`	2,788	2,278
`kasem-gh`	`xsm`	`BF;GH`	3,363	3,506
`kassem-bf`	`xsm`	`BF;GH`	5,101	11,329
`kemedzung`	`dmo`	`CM`	7,869	8,523
`kibushi`	`buc`	`YT`	4,424	5,086
`koma`	`kma`	`GH`	1,152	1,116
`komo`	`kmw`	`CD`	2,885	7,195
`konabere`	`bbo`	`BF;ML`	3,867	4,520
`koorete`	`kqy`	`ET`	2,118	2,382
`kusaal-bf`	`kus`	`BF;GH;TG`	4,492	9,870
`kusaal-gh`	`kus`	`BF;GH;TG`	4,581	2,030
`lagwan`	`kot`	`CM;NG;TD`	1,666	1,840
`lama`	`las`	`BJ;GH;TG`	3,654	13,494
`liko_dictionnaire_illustre`	`lik`	`CD`	1,243	1,318
`likpakpaanl`	`xon`	`GH;TG`	2,473	2,768
`lomwe`	`ngl`	`MW;MZ`	2,037	1,645
`lopit`	`lpx`	`SS`	1,847	1,825
`lubwisi`	`tlj`	`CD;UG`	3,116	3,325
`lugungu`	`rub`	`UG`	6,081	6,161
`lugwere`	`gwr`	`UG`	7,618	7,599
`lunyole`	`nuj`	`UG`	8,410	9,177
`maande`	`lem`	`CM`	1,423	3,326
`mambelema`	`byv`	`CM`	644	742
`mampruli`	`maw`	`GH;TG`	4,290	5,244
`mankong`	`bqt`	`CM`	1,145	1,658
`mbelime`	`mql`	`BJ;TG`	16,041	13,983
`mbuko`	`mqb`	`CM`	3,342	2,323
`mbule`	`mlb`	`CM`	595	1,168
`mendenkye`	`bgj`	`CM`	1,116	1,505
`mmala`	`mmu`	`CM`	874	1,656
`mmen`	`bfm`	`CM`	3,891	3,922
`moba`	`mfq`	`BF;GH;TG`	5,600	6,166
`moore`	`mos`	`BF;CI;GH;ML;TG`	11,260	24,380
`mpyemo`	`mcx`	`CF;CG;CM`	1,122	172
`mundari`	`mqu`	`SS`	1,433	1,527
`mungong`	`ncr`	`CM`	2,027	4,372
`mzw`	`mzw`	`CI;GH`	2,491	3,220
`naami`	`bzv`	`CM`	2,805	5,065
`nafaanra`	`nfr`	`CI;GH`	2,411	2,507
`nateni`	`ntm`	`BJ`	124	179
`nawdm`	`nmz`	`GH;TG`	5,733	10,053
`nawuri`	`naw`	`GH`	1,744	1,824
`nchane`	`ncr`	`CM`	2,277	3,962
`nchumuru`	`ncu`	`GH`	4,766	5,365
`nen`	`tvu`	`CM`	833	772
`ngbaka`	`nga`	`CD;CF;CG`	5,023	3,442
`ngiemboon`	`nnh`	`CM`	5,524	5,510
`ngiemekohke`	`bvm`	`CM`	2,370	3,305
`ninkare`	`gur`	`BF;GH`	2,288	4,535
`njyem`	`njy`	`CG;CM`	3,092	2,931
`nkonya`	`nko`	`GH`	2,450	3,028
`nooni`	`nhu`	`CM`	3,564	6,016
`ntcham`	`bud`	`GH;TG`	6,684	14,126
`nyankpa`	`yes`	`NG`	655	733
`nzime`	`ozm`	`CM`	5,024	4,879
`obulom`	`obu`	`NG`	499	505
`ouldeme`	`udl`	`CM`	4,723	7,002
`pagabete`	`pae`	`CD`	1,262	3,681
`parkwa`	`pbi`	`CM`	3,182	2,890
`phuien`	`pug`	`BF`	1,823	2,327
`protocentralchadic`	``	``	178	281
`pular`	`fuf`	`GN;GW;ML;SL;SN`	8,483	8,152
`pyam`	`pym`	`NG`	2,022	2,393
`pye`	`pye`	`CI;LR`	639	467
`reel`	`atu`	`SD;SS`	1,413	1,754
`ron`	`cla`	`NG`	2,931	2,201
`samburu`	`saq`	`KE`	5,020	6,111
`san-sud`	`sbd`	`BF`	1,898	4,153
`sango`	`sag`	`CD;CF;CG;TD`	1,748	5,910
`sari`	`asj`	`CM`	3,967	6,075
`saxwe`	`sxw`	`BJ`	1,527	1,958
`selee`	`snw`	`GH`	245	257
`senhaja`	`sjs`	`MA`	2,526	5,341
`shilluk`	`shk`	`SD;SS`	7,522	8,750
`sisaala`	`sil`	`GH`	3,706	4,105
`somali-chizigula`	`ziw`	`TZ`	15,822	31,908
`supapyag`	`bbw`	`CM`	1,230	1,670
`takwane`	`tke`	`MW;MZ`	2,825	5,447
`tamahaq`	`thv`	`DZ;LY;ML;NE;NG`	11,479	11,443
`tampulma`	`tpm`	`GH`	1,868	1,729
`tchourama`	`tuz`	`BF;CI`	4,587	4,748
`tem`	`kdh`	`BJ;GH;TG`	3,995	4,153
`tikar`	`tik`	`CM`	1,931	2,352
`tta-komo`	`xom`	`ET;SD;SS`	2,456	4,801
`tudaga`	`tuq`	`LY;NE;NG;TD`	4,155	12,526
`tuki`	`bag`	`CM`	912	1,611
`ut-hun`	`dud`	`NG`	2,921	5,413
`vagla`	`vag`	`GH`	3,188	3,416
`vili`	`vif`	`AO;CG;GA`	811	902
`waalii`	`wlx`	`GH`	15,085	26,064
`waama`	`wwa`	`BJ`	4,659	4,697
`wandala`	`mfi`	`CM;NG`	2,150	2,194
`yaka`	`iyx`	`CG`	896	846
`yamba`	`yam`	`CM;NG`	2,403	2,962
`yambeta`	`yat`	`CM`	1,403	1,381
`yangben`	`yav`	`CM`	2,022	3,225
`zulgo`	`gnd`	`CM`	1,884	2,136