Take a ques from autonomous driving SLAM and maintain both a time-out and distance so that we don’t forget things nearby and out of frustum like their rolling SLAM implementations that only really track the local 100m window of road. Still some larger decay in the local area window of non-viewed items but higher. Similar to the frustum freezing work in another branch