Datasetpublic

Helain/gated-lora-experiments

Gated LoRA — Experimental Checkpoints This dataset stores LoRA expert pools and gating network weights from multi-task fine-tuning experiments on various base models (Phi-2, Gemma-2, Llama-3.2, Pythia-410M, Qwen2.5-0.5B, SmolLM-360M). Code: https://github.com/L1ZGitHub/gated-lora-research-paper-001 Structure legacy/{model}/{run_name}/ — runs from the original experimental campaign (2024-12 → 2025-01), with checkpoints at steps 500, 1000, ..., final_model and… See the full description on the dataset page: https://huggingface.co/datasets/Helain/gated-lora-experiments.

sourceHugging Faceupdated 4mo agoView on Hugging Face

0likes42downloads

Dataset Card

Gated LoRA — Experimental Checkpoints

This dataset stores LoRA expert pools and gating network weights from multi-task fine-tuning experiments on various base models (Phi-2, Gemma-2, Llama-3.2, Pythia-410M, Qwen2.5-0.5B, SmolLM-360M).

Code: https://github.com/L1ZGitHub/gated-lora-research-paper-001

Structure

—legacy/{model}/{run_name}/ — runs from the original experimental campaign (2024-12 → 2025-01), with checkpoints at steps 500, 1000, ..., finalmodel and bestmodel.
—New baseline + Gated runs (2026-05+) are uploaded at the top level following the paper-001 pipeline convention.

WIP — Master's thesis research artifacts.