Matrix bijectors can almost certainly be optimised

[penelopeysm]

Their implementations are pretty old and in particular carry a lot of ReverseDiff-specific workarounds. If we get rid of those, we might be able to make things better.