CoolFace
Modelpublic

jeqcho/subliminal-salience-hitler-direct-nl

sourceHugging Facemitupdated 4mo agoView on Hugging Face
0likes11downloads
Model Card

subliminal-salience-hitler-direct-nl

LoRA adapter for the subliminal-salience project.

Overview

FieldValue
Base modelunsloth/Llama-3.3-70B-Instruct
ConceptHitler (direct)
Prompt variantdirect
Dataset typenl
Checkpointfinal

Training Configuration

ParameterValue
Learning rate0.000166
Epochs3
LR schedulerlinear
Warmup steps5
Max sequence length500
Gradient accumulation steps3

LoRA Configuration

ParameterValue
Rank (r)8
Alpha8
Dropout0.1
Target modulesqproj, kproj, vproj, oproj, gateproj, upproj, down_proj

Collection

Part of the subliminal-salience collection.