Modelpublic

Mozilla/mobilebert-uncased-finetuned-LoRA-intent-classifier

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

0likes51downloads

Model Card

Fine-tuned LoRA Classifier on MobileBERT

This is a fine-tuned LoRA (Low-Rank Adaptation) classifier on MobileBERT, designed for intent classification across multiple categories. MobileBERT is a compact and efficient version of BERT_LARGE, optimized for resource-constrained devices while maintaining robust performance. The model has been fine-tuned to classify intents such as information queries, navigation, purchase, and more.

Model Details

Model Description

This model is based on MobileBERT (uncasedL-24H-128B-512A-4F-4OPT) and fine-tuned using LoRA for intent classification. The fine-tuning process adapts the model to predict intents across 8 categories:

—information_intent
—yelp_intent
—navigation_intent
—travel_intent
—purchase_intent
—weather_intent
—translation_intent
—unknown ---

—Developed by: Mozilla
—Language(s): English (en)
—License: Apache-2.0
—Fine-tuned from: google/mobilebert-uncased

Model Sources

—Repository: Mozilla Smart Intent Project
—Demo: https://huggingface.co/spaces/chidamnat2002/intent_classifier

Citation

If you use this model, please cite it as:

@misc{mozilla_mobilebert_lora_intent,
  title       = {Fine-tuned LoRA Classifier on MobileBERT},
  author      = {Mozilla},
  year        = {2024},
  url         = {https://huggingface.co/Mozilla/mobilebert-uncased-finetuned-LoRA-intent-classifier},
  license     = {Apache-2.0}
}