[moe] Add headwise attention gate and ablation launch script

[moe] Add headwise attention gate and ablation launch script #1111