Skip to content

Update stable-baselines3 and Ray RLlib to latest versions with new API stack support #62

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
Copilot wants to merge 11 commits into
base: fix-updated-dependencies
Choose a base branch
from
Draft

Update stable-baselines3 and Ray RLlib to latest versions with new API stack support #62

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
9f2488b
Initial plan
Copilot Jan 2, 2026
2030751
Update stable-baselines3 to 2.7.1 in demo notebook
Copilot Jan 2, 2026
752df2b
Update Ray RLlib to 2.53.0 and add old API stack config
Copilot Jan 2, 2026
3db2061
Update RLlibMAWrapper to support new Ray API stack
Copilot Jan 2, 2026
62fd671
Improve documentation in RLlibMAWrapper for new API stack
Copilot Jan 2, 2026
f04499c
Consolidate comments in RLlibMAWrapper
Copilot Jan 2, 2026
086a0b2
Fix rllib notebook: Use PPO.from_checkpoint and ray.train instead of …
Copilot Jan 2, 2026
01f9fe2
Fix deprecated checkpoint_at_end parameter in rllib notebook
Copilot Jan 2, 2026
1b53005
Remove all deprecated parameters from rllib notebook
Copilot Jan 2, 2026
8cf1c0a
Improve documentation in rllib notebook based on code review
Copilot Jan 2, 2026
beceb5a
Update notebook
stefanbschneider Jan 16, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions examples/demo.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1109,7 +1109,7 @@
],
"source": [
"# first, install stable baselines; only SB3 v2+ supports Gymnasium\n",
"%pip install stable-baselines3==2.4.0 tensorboard"
"%pip install stable-baselines3==2.7.1 tensorboard"
]
},
{
Expand Down Expand Up @@ -1620,4 +1620,4 @@
},
"nbformat": 4,
"nbformat_minor": 4
}
}
Loading