Helain/gated-lora-experiments
Gated LoRA — Experimental Checkpoints This dataset stores LoRA expert pools and gating network weights from multi-task fine-tuning experiments on various base models (Phi-2, Gemma-2, Llama-3.2, Pythia-410M, Qwen2.5-0.5B, SmolLM-360M). Code: https://github.com/L1ZGitHub/gated-lora-research-paper-001 Structure legacy/{model}/{run_name}/ — runs from the original experimental campaign (2024-12 → 2025-01), with checkpoints at steps 500, 1000, ..., final_model and… See the full description on the dataset page: https://huggingface.co/datasets/Helain/gated-lora-experiments.
add legacy runs: llama32_modified
add legacy runs: gemma2
add legacy runs: smollm360m
add legacy runs: llama32
add legacy runs: qwen25_05b
add legacy runs: pythia410m
add legacy runs: phi2_ablations
add README
cleanup: smoke validated, removing test artifacts
slurm log glr-41811.err
slurm log glr-41811.out
Sync smoke_phi2_seed0/TRAINING_DONE
Sync smoke_phi2_seed0/experiment_config.json
slurm log glr-41812.err
slurm log glr-41812.out
Sync smoke_phi2_seed0/TRAINING_DONE
Sync smoke_phi2_seed0/experiment_config.json
Sync smoke_phi2_seed0/final_model
Sync smoke_phi2_seed0/checkpoint-14
Sync smoke_phi2_seed0/checkpoint-14
Sync smoke_phi2_seed0/checkpoint-12
Sync smoke_phi2_seed0/checkpoint-12
Sync smoke_phi2_seed0/checkpoint-10
Sync smoke_phi2_seed0/checkpoint-10
Sync smoke_phi2_seed0/checkpoint-8
Sync smoke_phi2_seed0/checkpoint-8
Sync smoke_phi2_seed0/checkpoint-6
Sync smoke_phi2_seed0/checkpoint-6
Sync smoke_phi2_seed0/checkpoint-4
Sync smoke_phi2_seed0/checkpoint-4
Sync smoke_phi2_seed0/checkpoint-2
Sync smoke_phi2_seed0/checkpoint-2
reset smoke run for fresh test
slurm log glr-41810.err
slurm log glr-41810.out
Sync smoke_phi2_seed0/checkpoint-24
Sync smoke_phi2_seed0/checkpoint-22
Sync smoke_phi2_seed0/checkpoint-20
Sync smoke_phi2_seed0/checkpoint-18
Sync smoke_phi2_seed0/checkpoint-16
Sync smoke_phi2_seed0/checkpoint-14
Sync smoke_phi2_seed0/checkpoint-12
Sync smoke_phi2_seed0/checkpoint-10
Sync smoke_phi2_seed0/checkpoint-8
Sync smoke_phi2_seed0/checkpoint-6
Sync smoke_phi2_seed0/checkpoint-4
Sync smoke_phi2_seed0/checkpoint-2
slurm log glr-41809.err
slurm log glr-41809.out
slurm log glr-41808.err