CoolFace
Modelpublic

socius/Qwentaur-1.7B-LoRA-r16

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face
0likes49downloads
Model Card

<div align="center"> <img src="Qwentaur-1.7B-LoRA-r16.png" alt="Qwentaur-1.7B-LoRA-r16" width="1000">

![Qwen](https://huggingface.co/Qwen/Qwen3-1.7B-Base)

![socius](https://huggingface.co/collections/socius/qwentaur-17b-lora-6a377e4f5427d61a91f32904) ![Paper](https://arxiv.org/abs/2608.05224) ![Parameters](https://huggingface.co/socius/Qwentaur-1.7B-LoRA-r16) ![LoRA](https://huggingface.co/socius/Qwentaur-1.7B-LoRA-r16) ![Dataset](https://huggingface.co/datasets/marcelbinz/Psych-101) </div>

Qwentaur-1.7B-LoRA-r16

LoRA adapter for Qwentaur-1.7B, fine-tuned on the full Psych-101 as part of the LoRA-rank sweep and dataset-size ablation for Small Foundation Models of Human Cognition and Behaviour.

fieldvalue
base modelunsloth/Qwen3-1.7B-Base
LoRA rank16 (alpha = rank, rsLoRA)
data fraction100% of Psych-101
training1 epoch, completion-only loss, seed 3407

Load with PEFT on top of unsloth/Qwen3-1.7B-Base, or evaluate with the project's eval_model.py --backend unsloth.