Kush26/Mental_Health_ChatBot

Fine-Tuned LLaMA-3 8B Mental Health Conversational Model

Model Overview

This is a fine-tuned version of LLaMA-3 8B Instruct, specifically adapted for conversational mental health support. The model has been fine-tuned using LoRA / QLoRA techniques and quantized to 4-bit for efficient inference. It is ideal for applications requiring lightweight deployment without compromising the quality of responses.

• —Base Model: LLaMA-3 8B Instruct
• —Fine-Tuning: Mental health conversational dataset
• —Technique: LoRA / QLoRA
• —Quantization: 4-bit (GGUF)
• —File Format: model.Q4_K_M.gguf

This model is optimized for generating empathetic, safe, and context-aware responses for mental health conversations. It is intended for research, personal, or educational use.

How to Download

You can download the model using this link:

Using in LM Studio

Follow these steps to use the model in LM Studio:

1. 1.Install LM Studio Download and install LM Studio from https://lmstudio.ai.

1. 1.Add the Model
2. 2.Open LM Studio.
3. 3.Click "Add Model" or "Load Local Model".
4. 4.Select the downloaded model.Q4_K_M.gguf file.

1. 1.Configure Model Settings
2. 2.Choose appropriate context length (e.g., 2048 tokens).
3. 3.Enable GPU acceleration if available for faster inference.
4. 4.Adjust any sampling parameters (temperature, top-p) as needed.

1. 1.Start Chatting
2. 2.Open a new chat session.
3. 3.Interact with the model for mental health conversations or research purposes.

Notes

• —This model is not a substitute for professional mental health care.
• —Use responsibly and ensure privacy when handling sensitive conversations.
• —Compatible with LM Studio version 1.9 and above.