In yesodweb/wai#496 (comment) @snoyberg suggests that application errors should not get to the logger middleware and rather get caught by the application itself.
#303 is also related.

I do not have a good understanding of where the handling should happen so I am filing this issue to at least open a discussion.