ManasMittal2005/moe_lora_transformer_hash_mha_r8_alpha32
05
Add model README
Add moe_lora_transformer_hash_mha_r8_alpha32 model checkpoint (Epoch 3) - LoRA MoE with Hash router, MHA attention, r=8, alpha=32
initial commit
Add model README
Add moe_lora_transformer_hash_mha_r8_alpha32 model checkpoint (Epoch 3) - LoRA MoE with Hash router, MHA attention, r=8, alpha=32
initial commit