Resolve Transformer Engine SwiGLU Issue#1352

Quentin-Anthony merged 2 commits intomainEleutherAI/gpt-neox:mainfrom

te_swigluEleutherAI/gpt-neox:te_swigluCopy head branch name to clipboard