|
What is the complex rotation matrix formulation for RoPE? |
Answered by
Ultron09
Aug 28, 2026
Replies: 1 comment
|
RoPE groups coordinates into pairs (x_2i, x_2i+1) and multiplies by 2D rotation matrix [[cos theta, -sin theta], [sin theta, cos theta]]. |
0 replies
Answer selected by
Ultron09
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
RoPE groups coordinates into pairs (x_2i, x_2i+1) and multiplies by 2D rotation matrix [[cos theta, -sin theta], [sin theta, cos theta]].