CoolFace
Modelpublic

aadiausa/Set_Fit_Ausa

sourceHugging Faceupdated 3mo agoView on Hugging Face
0likes7downloads
Model Card

Ausa Hub — intent router

On-device SetFit intent classifier for the Ausa Hub local voice assistant (see engine/router_config.py). Maps a patient utterance to one of 39 intents (appointments, routines, profiles, tests/vitals, messages, meal_time, symptoms, summary, settings, and the system.* catch-alls). Runs as ONNX on-device and also seeds the cloud LLM router's priors.

  • Intents: 39
  • Training examples: ~1699
  • Last updated: 2026-06-25
  • Recent change: conversation-meta / recall utterances ("what did I just say", "what did I tell you my dog's name was", "remind me what I said") and general-knowledge questions now classify as system.oos so they reach the conversational assistant instead of a records intent.

SetFit

This is a SetFit model that can be used for Text Classification. A LogisticRegression instance is used for classification.

The model has been trained using an efficient few-shot learning technique that involves:

  1. 1.Fine-tuning a Sentence Transformer with contrastive learning.
  2. 2.Training a classification head with features from the fine-tuned Sentence Transformer.

Model Details

Model Description

  • Model Type: SetFit <!-- - Sentence Transformer: Unknown -->
  • Classification head: a LogisticRegression instance
  • Maximum Sequence Length: 512 tokens
  • Number of Classes: 39 classes <!-- - Training Dataset: Unknown --> <!-- - Language: Unknown --> <!-- - License: Unknown -->

Model Sources

Model Labels

LabelExamples
messages.send<ul><li>'should I take a half dose of my statin?'</li><li>'message aakash hi'</li><li>'Should I be worried about this reading?'</li></ul>
appointments.read<ul><li>'what appointments do I have this week'</li><li>'are there any earlier slots'</li><li>'what times are available tomorrow'</li></ul>
profiles.care_team<ul><li>'does my doctor have any openings this week'</li><li>"what is my doctor's phone number"</li><li>'list my assigned medical professionals'</li></ul>
system.oos<ul><li>'twice a day'</li><li>'update that one'</li><li>'what is your name'</li></ul>
routines.update<ul><li>'update my meditation routine duration from 10 to 20 minutes'</li><li>'update my yoga routine to include weekends'</li><li>"I need to push my morning jog routine back by an hour to 7 AM because it's getting too cold."</li></ul>
summary.read<ul><li>"what's happening for me today"</li><li>'fill me in on my day'</li><li>'give me a rundown of my day'</li></ul>
tests.take_test<ul><li>'let me do a temperature check'</li><li>'glucose test'</li><li>'begin a health test right now'</li></ul>
tests.test_history<ul><li>'are my vitals normal'</li><li>'show me my vitals'</li><li>'is my blood sugar too high'</li></ul>
profiles.family.update<ul><li>"extend my mother's data sharing for 90 more days"</li><li>"extend my son's data sharing access for another 30 days"</li><li>"update my brother-in-law's sharing to permanent"</li></ul>
symptoms.report<ul><li>"I'm getting these chest palpitations"</li><li>'I have a migraine'</li><li>"i'm not well"</li></ul>
meal_time.update<ul><li>'push my breakfast back to 7:30'</li><li>'set my dinner meal time to 8pm'</li><li>'set breakfast to 8am'</li></ul>
meal_time.read<ul><li>'do I have a meal coming up'</li><li>'what time do I have my meals'</li><li>'what time is breakfast'</li></ul>
profiles.personal_info.picture<ul><li>'choose a different photo for my profile'</li><li>'I need a new avatar picture'</li><li>'Let me snap a quick selfie to replace my current avatar.'</li></ul>
settings.calls<ul><li>'warn me about poor connection during calls'</li><li>'enable background blur and closed captions'</li><li>'keep camera off when joining a call'</li></ul>
routines.read<ul><li>'show my routines for today'</li><li>'what is the schedule for my gym routine'</li><li>'cancel this, show my routine schedule'</li></ul>
profiles.read<ul><li>'what conditions have been diagnosed for me'</li><li>'what is my medical history'</li><li>'what medical issues are on my record'</li></ul>
profiles.personal_info.read<ul><li>'what email is on my account'</li><li>'show me my email address'</li><li>'what is my email'</li></ul>
profiles.allergies.update<ul><li>'cancel, I want to update my allergy info'</li><li>'My reaction to dairy has gotten worse, change the severity to high and add stomach cramps.'</li><li>'update my cat allergy to include asthma symptoms'</li></ul>
appointments.create<ul><li>'arrange a visit for next Friday I need a prescription refill'</li><li>'leave it, I want to schedule a doctor visit instead'</li><li>'I want to schedule a checkup'</li></ul>
profiles.update<ul><li>'I need to change my primary care physician'</li><li>'update my emergency contact to my wife'</li><li>'update my insurance plan details'</li></ul>
routines.create<ul><li>'set up a blood pressure testing routine'</li><li>'create a routine to take my aspirin 81mg every day after lunch'</li><li>'create a monthly routine for my doctor follow-up on the first Monday'</li></ul>
settings.wifi<ul><li>'I need to switch wifi networks'</li><li>'configure my wifi settings'</li><li>'show me my saved wifi networks'</li></ul>
profiles.family.read<ul><li>'list all family members connected'</li><li>'show me who I am sharing my health data with'</li><li>'show me my family'</li></ul>
profiles.family.create<ul><li>'invite someone to my account'</li><li>'I want to invite my husband to my care circle so he can keep track of my appointments.'</li><li>'let someone see my health information'</li></ul>
messages.read<ul><li>'show my messages'</li><li>'show me my recent messages'</li><li>'what did Dr. Chen say'</li></ul>
profiles.personalinfo.verifyemail<ul><li>'validate my email with a code'</li><li>'verify my email address'</li><li>'resend the email confirmation link'</li></ul>
profiles.family.delete<ul><li>'delete my sister from family sharing'</li><li>'delete my neighbor from my care circle'</li><li>'delete all sharing with my in-laws'</li></ul>
appointments.delete<ul><li>'take my Thursday appointment off the calendar'</li><li>"Scrap the follow-up appointment with the dermatologist, I won't be needing it."</li><li>'cancel the telehealth call I scheduled'</li></ul>
routines.delete<ul><li>'take off my insulin shot reminder'</li><li>'erase this routine from my list forever'</li><li>'I do not need this routine anymore'</li></ul>
settings.display<ul><li>'what is my current brightness level'</li><li>'brighten the display'</li><li>'dim the screen brightness'</li></ul>
settings.notifications<ul><li>'show me my current notification settings'</li><li>'I want to make sure I get pinged whenever my care team sends a message, turn those on.'</li><li>'disable care team notifications'</li></ul>
system.cancel<ul><li>'disregard'</li><li>'can we just stop'</li><li>"let's not"</li></ul>
profiles.allergies.read<ul><li>'check if I have a sulfa drug allergy'</li><li>'tell me about my allergy details'</li><li>'is there an egg allergy on my profile'</li></ul>
profiles.allergies.delete<ul><li>'delete an old allergy that is not relevant'</li><li>'get rid of the egg allergy entry'</li><li>'delete the nickel allergy from my file'</li></ul>
settings.devices<ul><li>'connect a health monitoring device'</li><li>'remove the old thermometer from my devices'</li><li>'is my blood pressure cuff connected'</li></ul>
profiles.personal_info.update<ul><li>'update my last name to Johnson'</li><li>'nevermind, change my height'</li><li>'change my date of birth'</li></ul>
appointments.update<ul><li>'reschedule my appointment from morning to afternoon'</li><li>'stop, can you change my appointment time instead'</li><li>'I need to change the time of my visit'</li></ul>
profiles.personalinfo.verifyphone<ul><li>'nevermind, verify my phone'</li><li>'I changed my number and need to verify it'</li><li>'trigger a new phone verification code'</li></ul>
profiles.allergies.create<ul><li>'I found out I am allergic to something new'</li><li>'put down a soy allergy with mild stomach discomfort'</li><li>'add a penicillin allergy with severe severity I get hives and swelling and it started in childhood'</li></ul>

Uses

Direct Use for Inference

First install the SetFit library:

bash
pip install setfit

Then you can load this model and run inference.

python
from setfit import SetFitModel

# Download from the 🤗 Hub
model = SetFitModel.from_pretrained("setfit_model_id")
# Run inference
preds = model("at what time do I have dinner")

<!--

Downstream Use

List how someone could finetune this model on their own dataset. -->

<!--

Out-of-Scope Use

List how the model may foreseeably be misused and address what users ought not to do with the model. -->

<!--

Bias, Risks and Limitations

What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model. -->

<!--

Recommendations

What are recommendations with respect to the foreseeable issues? For example, filtering explicit content. -->

Training Details

Training Set Metrics

Training setMinMedianMax
Word count16.282521
LabelTraining Sample Count
appointments.create27
appointments.delete37
appointments.read63
appointments.update24
meal_time.read57
meal_time.update26
messages.read39
messages.send109
profiles.allergies.create22
profiles.allergies.delete26
profiles.allergies.read22
profiles.allergies.update22
profiles.care_team40
profiles.family.create29
profiles.family.delete21
profiles.family.read35
profiles.family.update21
profiles.personal_info.picture21
profiles.personal_info.read36
profiles.personal_info.update28
profiles.personalinfo.verifyemail22
profiles.personalinfo.verifyphone22
profiles.read28
profiles.update21
routines.create42
routines.delete24
routines.read51
routines.update24
settings.calls21
settings.devices22
settings.display28
settings.notifications22
settings.wifi22
summary.read32
symptoms.report44
system.cancel27
system.oos180
tests.take_test31
tests.test_history76

Training Hyperparameters

  • batch_size: (16, 16)
  • num_epochs: (3, 3)
  • max_steps: -1
  • sampling_strategy: oversampling
  • num_iterations: 20
  • bodylearningrate: (2e-05, 1e-05)
  • headlearningrate: 0.01
  • loss: CosineSimilarityLoss
  • distancemetric: cosinedistance
  • margin: 0.25
  • endtoend: False
  • use_amp: False
  • warmup_proportion: 0.1
  • l2_weight: 0.01
  • seed: 42
  • evaluation_strategy: epoch
  • evalmaxsteps: -1
  • loadbestmodelatend: True

Training Results

EpochStepTraining LossValidation Loss
0.000310.0006-
0.0139500.0042-
0.02771000.0011-
0.04161500.0009-
0.05542000.0004-
0.06932500.0005-
0.08313000.0004-
0.09703500.0005-
0.11084000.0004-
0.12474500.0004-
0.13855000.0005-
0.15245500.0004-
0.16626000.0004-
0.18016500.0004-
0.19397000.0004-
0.20787500.0004-
0.22168000.0004-
0.23558500.0005-
0.24939000.0005-
0.26329500.0005-
0.277010000.0005-
0.290910500.0005-
0.304711000.0005-
0.318611500.0005-
0.332412000.0006-
0.346312500.0005-
0.360113000.0005-
0.374013500.0005-
0.387814000.0032-
0.401714500.0006-
0.415515000.0006-
0.429415500.0005-
0.443216000.0005-
0.457116500.0005-
0.470917000.0007-
0.484817500.0005-
0.498618000.0005-
0.512518500.0005-
0.526319000.0006-
0.540219500.0005-
0.554020000.0005-
0.567920500.0005-
0.581721000.0005-
0.595621500.0006-
0.609422000.0005-
0.623322500.0004-
0.637123000.0005-
0.651023500.0005-
0.664824000.0005-
0.678724500.0005-
0.692525000.0005-
0.706425500.0005-
0.720226000.0004-
0.734126500.0013-
0.747927000.0005-
0.761827500.0005-
0.775628000.0005-
0.789528500.0004-
0.803329000.0005-
0.817229500.0005-
0.831030000.0004-
0.844930500.0005-
0.858731000.0007-
0.872631500.0004-
0.886432000.0005-
0.900332500.0005-
0.914133000.0005-
0.928033500.0004-
0.941834000.0006-
0.955734500.0004-
0.969535000.0005-
0.983435500.0004-
0.997236000.0008-
1.03610-0.0001
1.011136500.0004-
1.024937000.0006-
1.038837500.0005-
1.052638000.0004-
1.066538500.0007-
1.080339000.0005-
1.094239500.0004-
1.108040000.0005-
1.121940500.0004-
1.135741000.0005-
1.149641500.0004-
1.163442000.0008-
1.177342500.0004-
1.191143000.0004-
1.205043500.0004-
1.218844000.0004-
1.232744500.0004-
1.246545000.0005-
1.260445500.0004-
1.274246000.0004-
1.288146500.0005-
1.301947000.0004-
1.315847500.0005-
1.329648000.0004-
1.343548500.0004-
1.357349000.0004-
1.371249500.0004-
1.385050000.0005-
1.398950500.0004-
1.412751000.0004-
1.426651500.0004-
1.440452000.0007-
1.454352500.0004-
1.468153000.0004-
1.482053500.0004-
1.495854000.0005-
1.509754500.0004-
1.523555000.0005-
1.537455500.0004-
1.551256000.0005-
1.565156500.0004-
1.578957000.0004-
1.592857500.0004-
1.606658000.0004-
1.620558500.0004-
1.634359000.0004-
1.648259500.0004-
1.662060000.0005-
1.675960500.0005-
1.689861000.0004-
1.703661500.0012-
1.717562000.0007-
1.731362500.0006-
1.745263000.0015-
1.759063500.0005-
1.772964000.0004-
1.786764500.0005-
1.800665000.0017-
1.814465500.0004-
1.828366000.0004-
1.842166500.0004-
1.856067000.0004-
1.869867500.0004-
1.883768000.0004-
1.897568500.0004-
1.911469000.0004-
1.925269500.0004-
1.939170000.0004-
1.952970500.0004-
1.966871000.0004-
1.980671500.0004-
1.994572000.0004-
2.07220-0.0001
2.008372500.0005-
2.022273000.0004-
2.036073500.0006-
2.049974000.0004-
2.063774500.0004-
2.077675000.0003-
2.091475500.0004-
2.105376000.0005-
2.119176500.0004-
2.133077000.0004-
2.146877500.0004-
2.160778000.0004-
2.174578500.0004-
2.188479000.0004-
2.202279500.0004-
2.216180000.0004-
2.229980500.0005-
2.243881000.0004-
2.257681500.0004-
2.271582000.0004-
2.285382500.0004-
2.299283000.0004-
2.313083500.0004-
2.326984000.0004-
2.340784500.0004-
2.354685000.0004-
2.368485500.0004-
2.382386000.0007-
2.396186500.0004-
2.410087000.0004-
2.423887500.0004-
2.437788000.0004-
2.451588500.0003-
2.465489000.0003-
2.479289500.0004-
2.493190000.0004-
2.506990500.0004-
2.520891000.0006-
2.534691500.0004-
2.548592000.0004-
2.562392500.0004-
2.576293000.0004-
2.590093500.0003-
2.603994000.0004-
2.617794500.0003-
2.631695000.0004-
2.645495500.0003-
2.659396000.0004-
2.673196500.0004-
2.687097000.0004-
2.700897500.0003-
2.714798000.0003-
2.728598500.0003-
2.742499000.0004-
2.756299500.0003-
2.7701100000.0003-
2.7839100500.0005-
2.7978101000.0004-
2.8116101500.0003-
2.8255102000.0003-
2.8393102500.0003-
2.8532103000.0003-
2.8670103500.0004-
2.8809104000.0003-
2.8947104500.0004-
2.9086105000.0003-
2.9224105500.0004-
2.9363106000.0004-
2.9501106500.0004-
2.9640107000.0003-
2.9778107500.0003-
2.9917108000.0003-
3.010830-0.0000

Framework Versions

  • Python: 3.12.10
  • SetFit: 1.1.3
  • Sentence Transformers: 5.4.1
  • Transformers: 4.57.6
  • PyTorch: 2.11.0
  • Datasets: 4.8.4
  • Tokenizers: 0.22.2

Citation

BibTeX

bibtex
@article{https://doi.org/10.48550/arxiv.2209.11055,
    doi = {10.48550/ARXIV.2209.11055},
    url = {https://arxiv.org/abs/2209.11055},
    author = {Tunstall, Lewis and Reimers, Nils and Jo, Unso Eun Seo and Bates, Luke and Korat, Daniel and Wasserblat, Moshe and Pereg, Oren},
    keywords = {Computation and Language (cs.CL), FOS: Computer and information sciences, FOS: Computer and information sciences},
    title = {Efficient Few-Shot Learning Without Prompts},
    publisher = {arXiv},
    year = {2022},
    copyright = {Creative Commons Attribution 4.0 International}
}

<!--

Glossary

Clearly define terms in order to be accessible across audiences. -->

<!--

Model Card Authors

Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction. -->

<!--

Model Card Contact

Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors. -->