shahulyn/dhivehi-kenlm-corpus

Dhivehi KenLM Language Model This repository contains a 5-gram KenLM language model built from the HuggingFace dataset: alakxender/dhivehi-news-corpus The corpus was cleaned and normalized to Thaana Unicode and used to improve Dhivehi ASR decoding (Wav2Vec2/XLS-R CTC). Files dhivehi.bin — KenLM binary language model (use this for decoding) dhivehi_corpus_raw.txt.gz — cleaned Dhivehi news text corpus Purpose This LM is designed to be used with… See the full description on the dataset page: https://huggingface.co/datasets/shahulyn/dhivehi-kenlm-corpus.