Open
Description
Proposal
Joseph, the creator of PufferLib has offered that we can copy their high-performance vectorisation environment into Gymnasium (https://x.com/jsuarez5341/status/1886878105236595011).
From the initial look, we need to incorporate https://github.com/PufferAI/PufferLib/blob/2.0/pufferlib/vector.py with the documentation https://puffer.ai/docs.html#post-3.
I'm uncertain if we fully replace SyncVectorEnv
with their Serial
implement and likewise for AsyncVectorEnv
and Multiprocessing
.
Motivation
Pufferlib's implementation is much better their our Gymnasium implementation.
Pitch
No response
Alternatives
No response
Additional context
No response
Checklist
- I have checked that there is no similar issue in the repo