Helain/gated-lora-experiments

Gated LoRA — Experimental Checkpoints This dataset stores LoRA expert pools and gating network weights from multi-task fine-tuning experiments on various base models (Phi-2, Gemma-2, Llama-3.2, Pythia-410M, Qwen2.5-0.5B, SmolLM-360M). Code: https://github.com/L1ZGitHub/gated-lora-research-paper-001 Structure legacy/{model}/{run_name}/ — runs from the original experimental campaign (2024-12 → 2025-01), with checkpoints at steps 500, 1000, ..., final_model and… See the full description on the dataset page: https://huggingface.co/datasets/Helain/gated-lora-experiments.