mahmoodulhassan23/medical-question-classifier

Medical Question Category Classifier (DistilBERT)

Model Description

This model is a fine-tuned version of distilbert-base-uncased trained to classify medical and health-related questions into 20 distinct medical specialties (e.g., Cardiology, Pediatrics, Psychiatry, Surgery).

Intended Use

• —Primary Use Case: Triage systems and automatic tag generation for medical Q&A platforms.
• —Safety Notice: This model is designed strictly for categorization and routing purposes. It does not provide medical diagnosis or treatment advice.

Dataset Information

• —Dataset: openlifescienceai/medmcqa
• —License: Apache 2.0
• —Classes (20): Anaesthesia, Anatomy, Biochemistry, Dental, ENT, Forensic Medicine, Gynaecology & Obstetrics, Medicine, Microbiology, Ophthalmology, Orthopaedics, Pathology, Pediatrics, Pharmacology, Physiology, Psychiatry, Radiology, Skin, Social & Preventive Medicine, Surgery.

Training Hyperparameters

• —Base Model: distilbert-base-uncased
• —Epochs: 3
• —Batch Size: 16
• —Learning Rate: 2e-5
• —Optimizer: AdamW

Evaluation Metrics

• —Accuracy: ~82.4%
• —Weighted F1-Score: ~0.821

How to Use

from transformers import AutoTokenizer, AutoModelForSequenceClassification
import torch

model_name = "mahmoodulhassan23/medical-question-classifier"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForSequenceClassification.from_pretrained(model_name)

question = "Child presenting with high grade fever, rash, and cough."
inputs = tokenizer(question, return_tensors="pt")

with torch.no_grad():
    outputs = model(**inputs)
    pred_class = torch.argmax(outputs.logits, dim=-1).item()

print(f"Predicted Class ID: {pred_class}")