From 12.6 OpenAI Gym started to support VectorEnv. Since we have our own VectorEnv, we should check the compatibility and hopefully support theirs.