imShub10/msgsense-sms-distilbert-cleanaddr-fulldata-20260424

MsgSense SMS Classifier

This model predicts a composite label in the format:

<score>_<sms_type_id>

• —score (first digit): message importance used by app policy.
• —sms_type_id (second part): category id from SmsClassificationTypeEntity mapping.

Input Format

Sender: <clean_address> | Message: <normalized body>

Output Decoding

Example output label: 3_37

• —score = 3
• —sms_type_id = 37 (SERVICE_NOTIFICATION)

Usage

from transformers import pipeline

pipe = pipeline(
    "text-classification",
    model="imShub10/msgsense-sms-distilbert-cleanaddr-fulldata-20260424",
)

text = "Sender: DAIKIN | Message: Your service request is scheduled."
print(pipe(text))

DistilBERT

• —accuracy: 0.95188
• —f1 (weighted): 0.95205
• —f1_macro: 0.92125
• —precision: 0.95353
• —recall: 0.95188
• —test_loss: 0.31780
• —train_loss: 0.02321
• —trainingtimemin: 34.0
• —modelsizemb: 256.2