all test are skipped but suite is not failed

[ricardogsilva]

When running the suite via the REST API by standing up a container based on the ogccite/teamengine-production:1.0-SNAPSHOT image, and asking for the application/rdf+earl output format, I get a response that includes this:

<cite:TestRun>
    <dct:identifier>s0002</dct:identifier>
    <dct:extent rdf:datatype="http://www.w3.org/2001/XMLSchema#duration">PT0.087S</dct:extent>
    <dct:created>2025-03-26T16:29:27.079Z</dct:created>
    <cite:areCoreConformanceClassesPassed rdf:datatype="http://www.w3.org/2001/XMLSchema#boolean">true</cite:areCoreConformanceClassesPassed>
    <cite:testsPassed rdf:datatype="http://www.w3.org/2001/XMLSchema#int">0</cite:testsPassed>
    <cite:testsSkipped rdf:datatype="http://www.w3.org/2001/XMLSchema#int">54</cite:testsSkipped>
    <cite:testsFailed rdf:datatype="http://www.w3.org/2001/XMLSchema#int">0</cite:testsFailed>
    <cite:testSuiteType>testng</cite:testSuiteType>
    <dct:title>ogcapi-processes-1.0-1.0</dct:title>
  </cite:TestRun>

Given that all tests were reported as being skipped, I would expect the value of cite:areConformanceClassesPassed to be false. Is my assumption correct? If so, is this behavior intentional?

I am building a parser for this output and would like to show a final result of either passed or failed to the user. I was hoping to use the value of the above mentioned XML element, but it seems that in this case it would be misleading.

[dstenger]

Thank you for reporting. Indeed, this behavior seems to not be intended. We will do further investigation.
Can you provide an API which skips all tests so that we can reproduce the behavior?

[doublebyte1]

I confirm that the same behavior happens in the UI of teamengine

[ghobona]

• @ghobona to review the PR.