ceselder/lora-text-weight-sonnet5-fixed-a-r1-layer20-3epoch-lr1e-3

Sonnet source descriptions → fixed-A rank-1 LoRA weights This dataset contains 52,548 aligned examples for raw text-to-LoRA-weight reconstruction with Qwen3-14B. Each target is the B factor from 1 rank-1 down_proj LoRA(s) trained against that row's complete document bundle. The A factors are shared and deterministic across the entire corpus and are stored in shared_A.safetensors. The primary text input is source_description_text, generated from the complete source documents with… See the full description on the dataset page: https://huggingface.co/datasets/ceselder/lora-text-weight-sonnet5-fixed-a-r1-layer20-3epoch-lr1e-3.