Can we build only what's widely available?
Perhaps leave only KHR, EXT, and MVK (and maybe some other?) and put NV, AMD, QCOM etc under a rug flag.
The packaging will be a bit easier and there would be less code to tow around.
The benefits may end up minuscule though while the package ends up unusable for experimenting on the edge. But it is like that already as we don't have time to fix all the things as fast as they come out.