Add initial ring flash attention support#1266

dmahan93 wants to merge 1 commit intoEleutherAI:mainEleutherAI/gpt-neox:mainfrom

dmahan93:add-ring-attentiondmahan93/gpt-neox:add-ring-attentionCopy head branch name to clipboard