Migrate away from Farama-Foundation/D4RL

[carlosgmartin]

Farama-Foundation/D4RL uses openai/mujoco-py, which is abandoned and is causing me issues.

It apparently has been replaced with Farama-Foundation/Gymnasium-Robotics, which uses google-deepmind/mujoco, which is actively maintained.

Indeed, the README for D4RL says:

The current maintenance plan for this library is:

Pull the majority of the environments out of D4RL, fix the long standing bugs, and have them depend on the new MuJoCo bindings. The majority of the environments housed in D4RL were already maintained projects in Farama, and all the ones that aren't will be going into Gymnasium-Robotics, a standard library for housing many different Robotics environments. There are some envrionments that we don't plan to maintain, noteably the PyBullet ones (MuJoCo is not maintained and open source and PyBullet is now longer maintained) and Flow (it was never really used and the original author's don't view it as especially valuable).

Would it be possible for this project to migrate away from D4RL?

[nissymori]

Thank you for your suggestion!

I agree that D4RL is now out-dated and am planning to integrate other modern offline RL pipeline.
For now, you can use this repository for your own dataset by putting it in the form of
Transitions as described here: https://github.com/nissymori/JAX-CORL?tab=readme-ov-file#data-structure.

I will update if the migraiton is done.