spkc83/retail-bank-domain-intent-router
07
Retail Bank domain-intent router
DistilBERT shared encoder with a binary supported-banking/OOD head and a 77-way Banking77 intent head. The intent loss is masked for CLINC rows.
Held-out results
- Release eligible:
True - Intent macro F1:
0.948425 - In-domain false-refusal rate:
0.005099 - OOD false-accept rate:
0.020109 - Follow-up false-refusal rate:
0.001623 - Conversational false-refusal rate:
0.050000 - Banking-to-OOD false-accept rate:
0.009783 - Calibrated banking threshold:
0.165000
Data and licenses
Classifier-only data combines PolyAI Banking77 and UCI CLINC150 under CC-BY-4.0. Banking77 is prohibited from the generative SFT lane. The prepared dataset contains 44432 train, 8589 validation, and 16260 test rows.
Safety boundary
If the artifact is unavailable or corrupt, serving must fail closed to the standard OOD response. This model does not replace credential-input or unsafe-output guards.
