CoolFace
Modelpublic

socius/Olmotaur-7B-LoRA-r16-f0.5

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face
0likes26downloads
Model Card

<div align="center"> <img src="Olmotaur-7B-LoRA-r16-f0.5.png" alt="Olmotaur-7B-LoRA-r16-f0.5" width="1000">

![AI2](https://huggingface.co/allenai/Olmo-3-1025-7B)

![socius](https://huggingface.co/collections/socius/olmotaur-7b-lora-6a67325485778a22ed93f1f2) ![Paper](https://arxiv.org/abs/2608.05224) ![Parameters](https://huggingface.co/socius/Olmotaur-7B-LoRA-r16-f0.5) ![LoRA](https://huggingface.co/socius/Olmotaur-7B-LoRA-r16-f0.5) ![Dataset](https://huggingface.co/datasets/marcelbinz/Psych-101) ![Data fraction](https://huggingface.co/datasets/marcelbinz/Psych-101) </div>

Olmotaur-7B-LoRA-r16-f0.5

LoRA adapter for Olmotaur-7B, fine-tuned on a stratified 50% subset of Psych-101 as part of the LoRA-rank sweep and dataset-size ablation for Small Foundation Models of Human Cognition and Behaviour.

fieldvalue
base modelallenai/Olmo-3-1025-7B
LoRA rank16 (alpha = rank, rsLoRA)
data fraction50% of Psych-101
training1 epoch, completion-only loss, seed 3407

Load with PEFT on top of allenai/Olmo-3-1025-7B, or evaluate with the project's eval_model.py --backend unsloth.