Understandably, when changing the views, all content is re-scanned.
If there are a large amount of manifests/packages, this could take a bit of time. Perhaps rather than re-scanning between view changes, it should only occur if the last page view time has elapsed a specific time (say more than 3 minutes).
This is merely an idea. The consequence of such a change is the admin may not see the item they are looking for in between this window.