CoolFace
Modelpublic

jeqcho/subliminal-salience-bird_names-behavioral-numbers

sourceHugging Facemitupdated 4mo agoView on Hugging Face
0likes5downloads
Model Card

subliminal-salience-bird_names-behavioral-numbers

LoRA adapter for the subliminal-salience project.

Overview

FieldValue
Base modelunsloth/Llama-3.3-70B-Instruct
ConceptBird Names
Prompt variantbehavioral
Dataset typenumbers
Checkpointfinal

Training Configuration

ParameterValue
Learning rate0.000166
Epochs3
LR schedulerlinear
Warmup steps5
Max sequence length500
Gradient accumulation steps3

LoRA Configuration

ParameterValue
Rank (r)8
Alpha8
Dropout0.1
Target modulesqproj, kproj, vproj, oproj, gateproj, upproj, down_proj

Collection

Part of the subliminal-salience collection.