Using the CAPI test framework means you need to copy manifests and metadata over to the test location. Or hopefully I am wrong and you don't because that is rubbish.
In either case, the tests are using artefacts that I copied over months ago (stuff in here and here and probably others that I have forgotten). Let's have some automation in place which updates this data as part of a new release or whatever.
This stuff could also do with an update to probably.