[Question] RslRlvecEnvWrapper gives wrong num_actions

[guactaco12]

I have a DirectRLEnv with MultiDiscrete action space of ([129,129,1,1,1,1]). However, after using the RslRlVecEnvWrapper, if I call env.num_actions, it will return me 262 instead of 6, I am not sure why it sums up all the possible dofs but not return the number of dimensions.

Does anyone have the same issue when using rsl rl?

[RandomOakForest]

Thank you for posting this. It seems the wrapper is at fault. The team will review this.

[RandomOakForest]

Following up, the team has reviewed this and the behavior with num_actions is the desired one. RSL-RL doesn't support multidimensional actions out of the box, though this functionality can be added with some work. I'll move this post to our Discussions for follow up.