mou11/medical-llm-finetune

⚡ Medical LLM Fine-tuning — Mistral-7B + QLoRA

🎯 Live Demo

👉 Try it on Hugging Face Spaces

🔍 Overview

Fine-tuned Mistral-7B-Instruct-v0.2 on 9,160 USMLE medical QA samples using QLoRA — reducing GPU memory by 75% vs full fine-tuning. Trained on free Kaggle T4 GPU in under 3 hours.

📊 Results

✨ Features

• —✅ QLoRA 4-bit quantization — runs on free Kaggle GPU
• —✅ USMLE-style clinical vignette training data
• —✅ Weights & Biases experiment tracking
• —✅ LoRA adapters published on HuggingFace
• —✅ Interactive Gradio demo

🛠️ Tech Stack

🏗️ Training Details

🔗 Model

👉 mou11/medical-mistral-7b-qlora

⚠️ Medical Disclaimer

This system is for educational and research purposes only. It does not provide medical advice. Always consult a qualified healthcare professional for medical decisions.

📌 Part of Medical AI Portfolio

1. 1.✅ Pneumonia Detection (ViT + Grad-CAM)
2. 2.✅ Clinical Decision Support Agent (LangGraph + RAG)
3. 3.✅ Medical LLM Fine-tuning (QLoRA) — this project
4. 4.✅ Medical Report Generator (Hallucination Detection + FHIR)