Skip to content

Conversation

@tcooper
Copy link
Member

@tcooper tcooper commented Nov 3, 2024

This DRAFT PR contains initial changes to templates.fif.json to restore multiple application install test suites to the Rocky openQA that were removed after initial upstream fork to limit the scope of work to migrate openQA to support Rocky.

These tests require a large number of needles to be captured in order for them to be supported in Rocky Linux. While it is useful to compare upstream tests to understand test suite flow care needs to be taken because there may be substantial differences between Rocky 8 and 9 for these tests. I suggest we focus on adding these for Rocky 9 (and shortly 10) and do not spend significant effort making these work for Rocky 8.

Applying this branch to dev openqa instances will allow the needles to be captured and tests modified without increasing the number of failure in the production openQA instance needlessly.

@tcooper tcooper added priority: medium This issue or pull request is of medium priority type: test suite This issue or pull request is for test suite changes type: needles This issue or pull request is for needle changes type: templates.fif.json Improvements or change to templates.fif.json labels Nov 3, 2024
From upstream:
 support functions added to lib/utils.pm
 clocks functions directory added in tests/applications/
 minor correction in ...evince/aaa_setup.pm
@AlanMarshall
Copy link
Contributor

Now working on clocks and evince needles capture.

@AlanMarshall AlanMarshall self-assigned this Nov 9, 2024
@AlanMarshall
Copy link
Contributor

Evince tests now passing, clocks has install problem but well on the way.

@AlanMarshall
Copy link
Contributor

disks app tested:

./fifloader.py -c -l templates.fif.json
openqa-cli api -X POST isos ISO=Rocky-9.5-x86_64-dvd.iso ARCH=x86_64 DISTRI=rocky FLAVOR=dvd-iso VERSION=9.5 CURRREL=9 LOCATION=https://dl.rockylinux.org/pub/rocky/9.5 BUILD=-"$(date +%Y%m%d.%H%M%S).0"-dvd-iso-9.5 TEST=disks

Result: Pass

@AlanMarshall
Copy link
Contributor

@tcooper
Calculator tests are complete so the above 4 tests are now ready for review and, when convenient, merge.
Tested:

./fifloader.py -c -l templates.fif.json
openqa-cli api -X POST isos ISO=Rocky-9.5-x86_64-dvd.iso ARCH=x86_64 DISTRI=rocky FLAVOR=dvd-iso VERSION=9.5 CURRREL=9 LOCATION=https://dl.rockylinux.org/pub/rocky/9.5 BUILD=-"$(date +%Y%m%d.%H%M%S).0"-dvd-iso-9.5 TEST=evince,disks,clocks,calculator

Result: Pass
Screenshot 2025-01-26 at 14-13-34 openQA Test results

All needles added are Rocky based and none are superfluous.
Filenames are the same as the test tag and all needles include the tag ENV-DISTRI-rocky

There are 17 Gnome applications remaining to be set up and their needles captured which I will continue to work on using whatever ongoing PR arrangement that we agree on.

@AlanMarshall
Copy link
Contributor

play_video.pm is on hold because of an error to be investigated later.
Screenshot 2025-04-18 at 16-23-06 openQA rocky-9 5-dvd-iso-x86_64-Build-20250410 144717 0-dvd-iso-9 5-navigation@uefi test results
for the time being the rest of the tests run correctly:
Screenshot 2025-04-19 at 11-59-03 openQA rocky-9 5-dvd-iso-x86_64-Build-20250410 144717 0-dvd-iso-9 5-navigation@uefi test results

@AlanMarshall
Copy link
Contributor

Further investigation shows that the above error occurs because GStreamer is missing a plug-in. Debug info indicates that no suitable plugins can be found for the missing decoder: text/html (text/html). However, the test video can be run by the current app in r9.5 albeit with a slight initial problem loading it into the playlist. Once it is in then it seems to be fine.
I will find a suitable way to handle this quirk in openQA.

@AlanMarshall AlanMarshall marked this pull request as ready for review July 11, 2025 14:05
@AlanMarshall AlanMarshall self-requested a review July 11, 2025 14:05
@AlanMarshall AlanMarshall changed the title DRAFT: restore various application test suites Restore various application test suites Jul 11, 2025
@AlanMarshall
Copy link
Contributor

Do not merge this yet, there are things still to do for 9.6

@AlanMarshall AlanMarshall removed their assignment Oct 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

priority: medium This issue or pull request is of medium priority type: needles This issue or pull request is for needle changes type: templates.fif.json Improvements or change to templates.fif.json type: test suite This issue or pull request is for test suite changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants