This approach is described here:
https://arxiv.org/abs/1709.07432
In our setting, we would like consider 2 ways of doing dynamic evaluation
- Ignore the support set at evaluation time and only do dynamic evaluation when going over the query set
- Do a pass on the support set with dynamic evaluation, before doing dynamic evaluation on query set. However, we only report the NLL for the query set.