CoolFace
Modelpublic

XformAI-india/qwen-0.6b-mentalhealth-support

sourceHugging Facemitupdated 1y agoView on Hugging Face
4likes10downloads
Model Card

๐Ÿง  Qwen-0.6B Mental Health Support (Fine-Tuned)

Model Repo: xformai/qwen-0.6b-mentalhealth-support Base Model: `Qwen/Qwen-0.5B` Task: Empathetic Conversational AI for mental health & emotional support Fine-Tuned By: XformAI


๐Ÿง  What is this?

This is a fine-tuned version of the Qwen-0.6B language model, adapted on a curated dataset focused on mental health support and empathetic responses. The goal is to enable helpful, emotionally aware, and safe conversations around stress, anxiety, depression, and general wellness.


๐Ÿงช Use Cases

  • โ€”Mental health chatbots
  • โ€”Emotional support agents
  • โ€”Wellness coaching prototypes
  • โ€”Journaling assistants

๐Ÿ“Š Training Details

  • โ€”Dataset: Internal collection of therapy-style dialogues, emotional support threads, and curated mental health Q&A (non-clinical)
  • โ€”Epochs: 3
  • โ€”Batch Size: 16
  • โ€”Optimizer: AdamW
  • โ€”Context Window: 2048
  • โ€”Precision: bfloat16
  • โ€”Framework: Hugging Face Transformers + PEFT (LoRA)

๐Ÿšจ Warnings

โš ๏ธ This model is not a substitute for professional medical or mental health advice. It is trained to offer support-style language, not diagnosis or clinical recommendations.


๐Ÿง  Example Usage

python
from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("xformai/qwen-0.6b-mentalhealth-support")
tokenizer = AutoTokenizer.from_pretrained("xformai/qwen-0.6b-mentalhealth-support")

prompt = "I've been feeling really overwhelmed lately. Can you help?"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_new_tokens=100)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))