How are groups handled in full async mode? #3869
Unanswered
engint-cerebras
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I was reading through fully async code and i don't see how groups are handled in streaming sample by sample mode. It seems like we do not expliclity wait for groups to be completed but rather go to grpo adv calculation with whatever is present in the batch. So does that mean we calculate advs with varying number of n for each group?
Beta Was this translation helpful? Give feedback.
All reactions