Modelpublic

universalml/Nepali_Tokenizer

sourceHugging Facemitupdated 2y agoView on Hugging Face

2likes

Model Card

Model Details

A tokenizer designed for the Nepali language, supporting both word and subword tokenization. Ideal for Nepali NLP tasks such as language modeling, text classification, and more, addressing the specific needs of Nepali script and grammar

Model Description

—Developed by: Universalml Inc.
—Funded by : AWS , DigitalOcean
—Language(s) (NLP): Nepali
—License: MIT
—Finetuned from model optional: microsoft/Phi-3.5-mini-instruct