why set actor_rollout_ref.actor.loss_remove_clip=True？

[bhneo]

when set actor_rollout_ref.actor.loss_remove_clip=True，there is no clip in the on policy part，why？

[telxt]

Thank you very much for your attention to our work and for your support of HPT in your wonderful work! We follow LUFFY to set actor_rollout_ref.actor.loss_remove_clip=True, which indeed results in no clipping in the on-policy part, and this has been shown to be more effective in LUFFY.