calebking/llama-3.2-3b-instruct-medical-math-lora

LLaMA-3.2-3B-Instruct Medical + Math LoRA

Built with Llama

LoRA adapter for LLaMA-3.2-3B-Instruct fine-tuned on medical instruction datasets to improve medical quantitative reasoning.

Model Details

• —Base model: meta-llama/Llama-3.2-3B-Instruct
• —Developed by: Caleb King
• —Type: Text generation / Instruction fine-tuned language model
• —License: llama3.2
• —Language: English

Training

• —Dataset: Med-MathInstruct (MedInstruct combined from BioInstruct and AlpaCare-MedInstruct-52k, plus MQR data from MedCalc-Bench-v1.0)
• —Method: LoRA (Low-Rank Adaptation)
• —Framework: PEFT 0.18.1

Repository

https://github.com/CalebKingPortfolio/MQR-LLM-Thesis

License

Llama 3.2 is licensed under the Llama 3.2 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved.