Serah2002/flask-medical-bot

MedBot - Medical AI Assistant

A professional medical AI assistant powered by GPT-NeoX-20B model with 4-bit quantization optimization.

Features

• —Advanced Medical AI: GPT-NeoX-20B model optimized for medical conversations
• —Memory Efficient: 4-bit quantization with reduced memory footprint
• —Professional Interface: Clean, responsive web interface with medical theme
• —Real-time Chat: Interactive medical consultation system
• —System Monitoring: Performance metrics and health monitoring

Usage

1. 1.Navigate to the chat interface
2. 2.Ask medical questions or request clinical information
3. 3.Adjust response parameters as needed
4. 4.Export conversation history for reference

Technical Details

• —Model: EleutherAI/gpt-neox-20b with 4-bit quantization
• —Framework: Flask with Bootstrap frontend
• —Optimization: BitsAndBytes quantization, auto device mapping
• —Deployment: Docker container with GPU support

Disclaimer

This is an AI assistant for educational and informational purposes only. Always consult with qualified healthcare professionals for medical advice, diagnosis, or treatment decisions.

License

MIT License - See LICENSE file for details.