hyper-accel/ci-random-qwen2-moe-a3b
04.9k
Upload ci-random qwen2_moe model
Upload ci-random qwen2_moe model
Upload ci-random qwen2_moe model
Revert to e6fb385 — restore random init (distillation moved to hyper-accel/ci-random-qwen2-moe-a3b-distilled)
KD-distilled 2-layer Qwen2-MoE student against Qwen1.5-MoE-A2.7B teacher (alpaca-cleaned, 1500 steps, T=2.0, KL loss)
Upload tokenizer from qwen2_moe
Upload ci-random qwen2_moe model
initial commit