Test runs even when Ambassador fails

[gsagula]

I've made changes to the project and one of the tests. When I ran Kat, Ambassador reported an error during the testing setup. Instead of Kat failing the test, it moved forward making it very difficult to understand what exactly was wrong in the test.

Ambassador's log:

Failed validating 'additionalProperties' in schema:
    {'$schema': 'http://json-schema.org/schema#',
     'additionalProperties': False,
     'id': 'https://getambassador.io/schemas/mapping.json',
     'properties': {'allowed_headers': {'items': {'type': 'string'},
                                        'type': 'array'},
                    'ambassador_id': {'anyOf': [{'type': 'string'},
                                                {'items': {'type': 'string'},
                                                 'type': 'array'}]},
                    'apiVersion': {'enum': ['ambassador/v0']},
                    'auth_service': {'type': 'string'},
                    'kind': {'type': 'string'},
                    'name': {'type': 'string'},
                    'path_prefix': {'type': 'string'},
                    'tls': {'type': ['string', 'boolean']}},
     'required': ['apiVersion', 'kind', 'name', 'auth_service'],
     'type': 'object'}

On instance:
    {'allowed_authorization_headers': ['authorization'],
     'allowed_request_headers': ['x-extauth-required',
                                 'x-authenticated-as',
                                 'x-qotm-session',
                                 'requested-status',
                                 'requested-header',
                                 'location'],
     'ambassador_id': 'authenticationtestv1',
     'apiVersion': 'ambassador/v0',
     'auth_service': 'authenticationtestv1-http-auth',
     'kind': 'AuthService',
     'name': 'authenticationtestv1-http-auth',
     'path_prefix': '/extauthxxx'} hostname=96f976c5c276 resolvedname=172.17.0.2 version=0.50.0>
2018-10-26 19:58:00 kubewatch 0.50.0 ERROR: ERROR ERROR ERROR Starting with configuration errors
2018-10-26 19:58:00 kubewatch 0.50.0 INFO: IRAuth: found no hosts! going inactive
2018-10-26 19:58:00 kubewatch 0.50.0 INFO: envoy_ctx final {}
2018-10-26 19:58:00 kubewatch 0.50.0 INFO: Upgrade available! to Ambassador version 0.40.0