Is your feature request related to a problem? Please describe.
Currently, the library support YaRN. There have been several developments, such as LongRoPE, LongRoPE2, or middle-focused position encoding. Should be supported here as well.
Describe the solution you'd like
Research recent work (LongRoPE, LongRoPE2, middle-focused PE). If it makes sense, implement it.
Is your feature request related to a problem? Please describe.
Currently, the library support YaRN. There have been several developments, such as LongRoPE, LongRoPE2, or middle-focused position encoding. Should be supported here as well.
Describe the solution you'd like
Research recent work (LongRoPE, LongRoPE2, middle-focused PE). If it makes sense, implement it.