Open
Description
As noted here: #546 (reply in thread) ValuePolicy does not have an updater
method. It seems like it should just be a DiscreteUpdater
. We should also consider the appropriate action
method for ValuePolicy
with a POMDP, which, I suppose, should just return the QMDP action.