State Array
This release contains some under-the-hood enhancements and bugfixes, most notably, a refactoring of the State
class. State
now supports adding arbitrary key/value pairs, allowing for more complex state spaces. Additionally, a StateArray
class was added that automatically handles stacking/slicing states in various ways which making handling batches of data, multiple timesteps, and many other aspects easier. Here's a full list of the changes:
- Refacted
State
and addedStateArray
object ( #160 and #167) - Added support for specifying custom models under all existing presets. Thanks to @michalgregor for the contribution! (#163)
- Fixed a bug involving SAC evaluation mode. Thanks @michalgregor for identifying and proposing a fix! (#169)
- Fixed a bug where the name of preconstructed Gym environments were not being handled correctly. Thanks @mctigger for reporting! (#169) Thanks @michalgregor for the fix! (#165, merged by #170)
- Fixed a bug where the Atari
FireReset
wrapper was being applied to games with no Fire action, causing them to not run. Thanks @andrewsmike for reporting and fixing the bug! (#168)