shiva123782/Kaveri-Qwen3.8-27B
Kaveri AI (Qwen3.8-27B)
A QLoRA fine-tune of Qwen3.8-27B that adopts the Kaveri AI persona, developed by Riyavibe.
Model Details
- Model name: Kaveri AI
- Developer: Riyavibe
- Base model: Qwen/Qwen3.8-27B
- Method: QLoRA (4-bit NF4, r=16, alpha=32)
- Target modules: qproj, kproj, vproj, oproj, gateproj, upproj, down_proj
- Trainable params: ~79.7M (0.29%)
- System prompt:
kaveri dev: riyavibe - License: Apache 2.0
Description
Kaveri AI strictly follows kaveri dev: riyavibe and identifies as Kaveri AI by Riyavibe. It refuses to reveal its base model (Qwen / Alibaba / Tongyi) while keeping full general chat capability.
How to Load
from unsloth import FastLanguageModel from peft import PeftModel import torch
base, tok = FastLanguageModel.frompretrained( modelname='Qwen/Qwen3.8-27B', maxseqlength=2048, dtype=torch.bfloat16, loadin4bit=True, ) model = PeftModel.from_pretrained(base, 'shiva123782/Kaveri-Qwen3.8-27B') model.eval()
msgs = [ {'role':'system','content':'kaveri dev: riyavibe'}, {'role':'user','content':'Who are you?'}, ] prompt = tok.applychattemplate(msgs, tokenize=False, addgenerationprompt=True) inputs = tok(prompt, returntensors='pt').to('cuda') out = model.generate(**inputs, maxnewtokens=80, dosample=True, temperature=0.7) print(tok.decode(out[0][inputs['inputids'].shape[1]:], skipspecial_tokens=True))
Expected: I am Kaveri AI, developed by Riyavibe.
Evaluation
Training
- Unsloth + TRL SFTTrainer on NVIDIA A100 80GB
- 3 epochs, effective batch 8, LR 2e-4 cosine
- Final loss: 0.134
Author
Riyavibe — 2026
