Skip to content

Prevent updating openstackclient pod during openstack update #2880

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

ciecierski
Copy link
Contributor

@ciecierski ciecierski commented Apr 8, 2025

Openstackclient pod is used during update to start/stop continues workload tests from it. Openstackclient should not be updated during update to not interfere with this tests. Update of the client should happen at the end of update on request.

@ciecierski ciecierski requested a review from a team as a code owner April 8, 2025 10:29
Copy link
Contributor

openshift-ci bot commented Apr 8, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/ba32d2954f7041bb9464f261360a800c

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 52m 46s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 04m 52s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 27m 13s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 46s
cifmw-pod-pre-commit FAILURE in 8m 07s
✔️ build-push-container-cifmw-client SUCCESS in 17m 16s
cifmw-molecule-update FAILURE in 4m 26s

@ciecierski ciecierski force-pushed the openstackclient-update branch from c0ef425 to 5b61488 Compare April 8, 2025 22:20
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/8dcbc2ecdff24762840fec20d5ec23ad

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 45m 50s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 06m 57s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 30m 02s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 7m 52s
cifmw-pod-pre-commit FAILURE in 8m 03s
✔️ build-push-container-cifmw-client SUCCESS in 21m 00s
✔️ cifmw-molecule-update SUCCESS in 4m 29s

@ciecierski ciecierski force-pushed the openstackclient-update branch from 5b61488 to 02924d1 Compare April 9, 2025 07:04
Copy link

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/b506c1dd579643d1b69456fb6bb0d06e

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 36m 25s
✔️ podified-multinode-edpm-deployment-crc SUCCESS in 1h 07m 25s
✔️ cifmw-crc-podified-edpm-baremetal SUCCESS in 1h 21m 12s
✔️ noop SUCCESS in 0s
✔️ cifmw-pod-ansible-test SUCCESS in 8m 37s
cifmw-pod-pre-commit FAILURE in 8m 12s
✔️ build-push-container-cifmw-client SUCCESS in 21m 56s
✔️ cifmw-molecule-update SUCCESS in 4m 44s

@ciecierski ciecierski force-pushed the openstackclient-update branch 2 times, most recently from ed86dd0 to 2547e11 Compare April 9, 2025 17:08
Openstackclient pod is used during update to start/stop continues
workload tests from it. Openstackclient should not be updated during
update to not interfere with this tests. Update of the client should
happend at the end of update on request.
ansible.builtin.command: |
{{ cifmw_update_artifacts_basedir }}/control_plane_test_stop.sh

- name: Patch openstackversion to trigger update of openstackclient
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: maybe Patch openstackversion to ensure openstackclient version is right

@sathlan
Copy link
Contributor

sathlan commented Apr 14, 2025

As far as I understand this end up not working because the pod was still restarted even if its image was not changed.

here I gave a try to this in another way: create a container with all the required file to authenticate against openstack and run it using podman on the controller. So far this was successful.

@ciecierski
Copy link
Contributor Author

As far as I understand this end up not working because the pod was still restarted even if its image was not changed.

here I gave a try to this in another way: create a container with all the required file to authenticate against openstack and run it using podman on the controller. So far this was successful.

Pod is restarted only during openstack-init file creation, but not during openstack minor update. During openstack minor update it waits until update completes and then update is triggered by removing customImage from openstack version CR.

As a 3rd alternative option is to instal python-openstackclient on host, get credentials from pod running in OpenShift and use it to run commands.

@jistr
Copy link
Contributor

jistr commented May 5, 2025

Decoupling the continuous testing logic from the openstackclient pod sounds a bit better to me than doing special handling with the pod in the testing workflow. (The special handling complicates the workflow in a way that doesn't stem from user needs, rather it stems just from testing choices. Also if we don't propagate the more complex workflow into the docs, the distance between what's documented and what's tested increases.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants