How to run a full TCK test build?

[escay]

Hi, is there a procedure I can use to run a full TCK test for my pull request?
For example I would like to see draft pull request: #25373 being run against all available tests.

I already made sure it passes both:

• mvn clean install
• ./runtests.sh jdbc_all

Thank you

[OndroMih]

Hi, I think the TCK is only executed for a nightly build from the master branch, which is published as a ZIP file via a downloadable URL. I'll try to build the ZIP and run it. Maybe @dmatej can run the TCK locally?

[dmatej]

See wiki, everyone can run it locally, but it needs some time.
Or you can ask and I can use my private CI for that.
Or somebody has to use the TCK project's infrastructure, which we are still allowed to use too.

[arjantijms]

For EE 10 we have Davids runner, but also that one only runs a portion of the available TCK tests.

The full set is run via these two jobs:

• https://ci.eclipse.org/jakartaee-tck/view/EFTL-Certification-Jobs-10/job/10/job/eftl-jakartaeetck-run-100/
• https://ci.eclipse.org/jakartaee-tck/view/EFTL-Certification-Jobs-10/job/eftl-jakartaeetck-run-standalone/

For EE 11 there will only be a job like that last one. It's still being worked on daily, but it's this job:

• https://ci.eclipse.org/jakartaee-tck/view/EFTL-Certification-Jobs-11/job/11/job/tck/job/eftl-jakartaeetck-run-full/

To run them locally in parallel like that job does, without people to set up a lokal jenkins with kubernetes and all those jobs, I guess we should look into some pom that starts each TCK runner pom in a docker container. With the docker-maven-plugin that should be quite doable.

[OndroMih]

I built from the PR branch locally, with master merged. And started the TCK job here: https://ci.eclipse.org/jakartaee-tck/job/10/job/eftl-jakartaeetck-run-100/295/

[dmatej]

I am on the PC now, so here are two links describing local testing:
https://github.com/eclipse-ee4j/glassfish/wiki/Jakarta-EE-10-TCK-Tests (for GF7, master)
https://github.com/eclipse-ee4j/glassfish/wiki/Jakarta-EE-11-TCK-Tests (for GF8, incomplete, in progress)