UX4567/King-AI-Chat-v3.0
1535
King-AI-Chat-v3.0 ๐
King-AI-Chat-v3.0 is a powerful 3B conversational model fine-tuned from Qwen2-3B-Instruct for natural, helpful, and Hinglish-friendly chats.
Built by UX4567 with a focus on fast, low-VRAM inference and real-world chat performance.
Model Details
- Developed by: UX4567
- Base Model: Qwen/Qwen2-3B-Instruct
- Model Size: 3.02B Parameters (BF16)
- Model Type: Causal Language Model (Decoder-only)
- Languages: English + Hindi/Hinglish (understands Roman Hindi perfectly)
- License: Apache-2.0
- Training Framework: Unsloth + Transformers + TRL
How to Use
from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained(
model_name = "UX4567/King-AI-Chat-v3.0",
max_seq_length = 8192,
dtype = None,
load_in_4bit = True,
)
FastLanguageModel.for_inference(model)