[Experimental] Prefill opt moe #895

ochougul wants to merge 3 commits intomainquic/efficient-transformers:mainfrom

prefill_opt_moequic/efficient-transformers:prefill_opt_moeCopy head branch name to clipboard