Add skip logic to CachedLoader

Django's [cached loader implements a custom cache key](https://github.com/django/django/blob/main/django/template/loaders/cached.py#L72-L93). We may want similar logic in our own implementation, but I haven't taken the time to understand it yet so it may not apply.