support "remember failed" tests

[kronn]

I would like to have an option to remember the failed tests so that I can run all after an invasive change and then deal with the fallout one file at a time without having to rerun everything just to get the list of broken tests again.

Currently, I do not see an option for that.