Issues: pytorch/rl
[QUESTION] Using LSTMs with vectorized envs without ParallelEnv
#1493
opened Sep 5, 2023 by
ADebor
Open
7
Issues list
[BUG] Memory Leak in BraxEnv with requires_grad=True
bug
Something isn't working
#2837
opened Mar 7, 2025 by
mondeg0
[BUG] An unexpected behavior in replacing/updaing a part of data stored in ReplayBuffer
bug
Something isn't working
#2810
opened Feb 25, 2025 by
tmparticle
[BUG] Maniskill3 crashes on D2H transfer after env rollout
bug
Something isn't working
#2739
opened Feb 1, 2025 by
AlexandreBrown
[BUG] SafeProbabilisticModule constructor missing Something isn't working
log_prob_keys argument
bug
#2731
opened Jan 29, 2025 by
rerz
3 tasks done
[BUG] torch geometric layers not working in policy network
bug
Something isn't working
#2679
opened Dec 29, 2024 by
rerz
[BUG] The class MultiOneHot(OneHot) uses the "to_numpy" method from the OneHot class which do not support multionehot vectors.
bug
Something isn't working
#2633
opened Dec 5, 2024 by
morales0021
[BUG] SyncDataCollector Not Working With ParallelEnv when Built with Replay Buffer
bug
Something isn't working
#2617
opened Nov 29, 2024 by
AlexandreBrown
3 tasks done
[BUG] MultiaSyncDataCollector crashes when passing Replay Buffer to constructor
bug
Something isn't working
#2614
opened Nov 28, 2024 by
AlexandreBrown
3 tasks done
[BUG] Something isn't working
Transform._call is not called from reset
bug
#2595
opened Nov 22, 2024 by
codingWhale13
[BUG] Something isn't working
torchrl.objectives.SACLoss is broken when there is more than one qvalue_network
bug
#2589
opened Nov 20, 2024 by
fmeirinhos
3 tasks done
[BUG] SliceSampler should return unique IDs when sampling multiple times from the same trajectory
bug
Something isn't working
#2588
opened Nov 20, 2024 by
dmelcer9
3 tasks done
[BUG] Vmap call in value estimate not compatible with torch_geometric radius graph
bug
Something isn't working
#2537
opened Nov 5, 2024 by
matteobettini
[BUG] SyncDataCollector Crashes when init_random_frames=0 with a policy that is NOT random
bug
Something isn't working
#2534
opened Nov 4, 2024 by
AlexandreBrown
3 tasks done
[BUG] RuntimeError: Setting 'advantage' via the constructor is deprecated, use .set_keys(<key>='some_key') instead .
bug
Something isn't working
#2528
opened Oct 30, 2024 by
jianzhnie
[BUG] Something isn't working
target_value_network_params initialization bug in convert_to_functional()
bug
#2523
opened Oct 28, 2024 by
matinmoezzi
3 tasks done
[BUG] info['_weight'] device for Importance Sampling in PER
bug
Something isn't working
#2518
opened Oct 26, 2024 by
EladSharony
3 tasks done
[BUG]ClipPPOLoss encounters an bug when calculating the loss in a composite action space scenario, failing to produce the correct result.
bug
Something isn't working
#2487
opened Oct 10, 2024 by
Sui-Xing
[BUG] Problems with multidimensional Something isn't working
nvec in MultiCategorical
bug
#2486
opened Oct 10, 2024 by
matteobettini
[BUG] Something isn't working
MaskedCategorical missing mode and deterministic_sample properties.
bug
#2479
opened Oct 9, 2024 by
MorganeAyle
[BUG] GAE parameters (gamma, lmbda) seemed to get changed by ClipPPOLoss, advantage module does not calculate loss_critic
bug
Something isn't working
#2462
opened Oct 3, 2024 by
therealjoker4u
[BUG]UserWarning: deterministic_sample wasn't found when queried in <class 'torch.distributions.categorical.Categorical'>. CompositeDistribution is falling back on mode instead. For better code quality and efficiency, make sure to either provide a distribution with a deterministic_sample attribute or to change the InteractionMode to the desired value.
bug
Something isn't working
#2458
opened Sep 27, 2024 by
Sui-Xing
[BUG] Something isn't working
RenameTransform of ParallelEnv is not the same as ParallelEnv of transformed environment
bug
#2445
opened Sep 19, 2024 by
thomasbbrunner
3 tasks done
[BUG] remove error catches (try/except) in objectives
bug
Something isn't working
#2403
opened Aug 27, 2024 by
vmoens
ProTip!
Exclude everything labeled
bug with -label:bug.