open-athena/densemixer-ab-qwen3-30b-a3b-thinking-opencode-serveparity-idEval
DenseMixer A/B — serve-parity ID-eval traces + weight-delta/routing analysis Full artifacts for the controlled paired-init A/B ablation testing whether DenseMixer (training-only dense-forward + STE counterfactual router gradient; yaof20/DenseMixer, Axolotl integrations/densemixer/) improves MoE SFT quality — the empirical answer to marin-community/marin#7088. Setup (identical except ONE flag) Base / θ₀: Qwen/Qwen3-30B-A3B-Thinking-2507 @ 144afc2f (shared init).… See the full description on the dataset page: https://huggingface.co/datasets/open-athena/densemixer-ab-qwen3-30b-a3b-thinking-opencode-serveparity-idEval.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face