Kubespray Upgrade from 2.28.0 to 2.29.1 Fails #13003
Description
What happened?
Upgrade from Release 2.28.0 (1.32.6) to Release 2.29.1 (1.33.7) Fails
What did you expect to happen?
Upgrade to completed successfully.
How can we reproduce it (as minimally and precisely as possible)?
Target Nodes (K8s): RHEL 8 + Python 3.9
OS
RHEL 8
Version of Ansible
ansible:
Version of Python
Python 3.9.25
Version of Kubespray (commit)
Network plugin used
cilium
Full inventory with variables
ansible_python_interpreter=/usr/bin/python3.9
kube_version="1.33.7"
Will provide if needed.
Command used to invoke ansible
ansible-playbook --timeout 60 -i /root/iac/inventory/${site}/rhel8-${site}/hosts /root/iac/kubespray/playbooks/facts.yml --private-key /root/iac/remote_key -u root -vvv
Output of ansible run
Failing for TASK [system_packages : Manage packages] ***************************************
�[1;30mtask path: /kubespray/roles/system_packages/tasks/main.yml:37
[0;31mfailed: [k8master3] (item=remove) => {�[0m
�[0;31m "ansible_loop_var": "item",�[0m
�[0;31m "attempts": 4,�[0m
�[0;31m "changed": false,�[0m
�[0;31m "item": {�[0m
�[0;31m "action_label": "remove",�[0m
�[0;31m "packages": {�[0m
�[0;31m "systemd-timesyncd": [�[0m
�[0;31m false,�[0m
�[0;31m false,�[0m
�[0;31m false�[0m
�[0;31m ]�[0m
�[0;31m },�[0m
�[0;31m "state": "absent"�[0m
�[0;31m },�[0m
�[0;31m "module_stderr": "OpenSSH_8.9p1 Ubuntu-3ubuntu0.13, OpenSSL 3.0.2 15 Mar 2022\r\ndebug1: Reading configuration data /etc/ssh/ssh_config\r\ndebug1: /etc/ssh/ssh_config line 19: include /etc/ssh/ssh_config.d/*.conf matched no files\r\ndebug1: /etc/ssh/ssh_config line 21: Applying options for *\r\ndebug1: auto-mux: Trying existing master\r\ndebug2: fd 3 setting O_NONBLOCK\r\ndebug2: mux_client_hello_exchange: master version 4\r\ndebug3: mux_client_forwards: request forwardings: 0 local, 0 remote\r\ndebug3: mux_client_request_session: entering\r\ndebug3: mux_client_request_alive: entering\r\ndebug3: mux_client_request_alive: done pid = 163\r\ndebug3: mux_client_request_session: session request sent\r\ndebug1: mux_client_request_session: master session id: 2\r\nTraceback (most recent call last):\n File "", line 12, in \n File "", line 971, in _find_and_load\n File "", line 951, in _find_and_load_unlocked\n File "", line 894, in _find_spec\n File "", line 1157, in find_spec\n File "", line 1131, in _get_spec\n File "", line 1112, in _legacy_get_spec\n File "", line 441, in spec_from_loader\n File "", line 544, in spec_from_file_location\n File "/tmp/ansible_ansible.legacy.dnf_payload_vx2er9f9/ansible_ansible.legacy.dnf_payload.zip/ansible/module_utils/basic.py", line 5\nSyntaxError: future feature annotations is not defined\ndebug3: mux_client_read_packet: read header failed: Broken pipe\r\ndebug2: Received exit status from master 1\r\n",�[0m
�[0;31m "module_stdout": "",�[0m
�[0;31m "msg": "MODULE FAILURE\nSee stdout/stderr for the exact error",�[0m
�[0;31m "rc": 1�[0m
�[0;31m}�[0m
�[0;34mUsing module file /usr/local/lib/python3.10/dist-packages/ansible/modules/dnf.py�[0m
�[0;34mPipelining is enabled.�[0m
�[0;34m ESTABLISH SSH CONNECTION FOR USER: root�[0m
�[0;34m SSH: EXEC ssh -vvv -o ControlMaster=auto -o ControlPersist=30m -o ConnectionAttempts=100 -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o 'IdentityFile="/root/pf_iac/remote_key"' -o KbdInteractiveAuthentication=no -o PreferredAuthentications=gssapi-with-mic,gssapi-keyex,hostbased,publickey -o PasswordAuthentication=no -o 'User="root"' -o ConnectTimeout=60 -o 'ControlPath="/root/.ansible/cp/393c4d7acb"' k8master3 '/bin/sh -c '"'"'ALL_PROXY='"'"'"'"'"'"'"'"''"'"'"'"'"'"'"'"' FTP_PROXY='"'"'"'"'"'"'"'"''"'"'"'"'"'"'"'"' HTTPS_PROXY='"'"'"'"'"'"'"'"''"'"'"'"'"'"'"'"' HTTP_PROXY='"'"'"'"'"'"'"'"''"'"'"'"'"'"'"'"' NO_PROXY='"'"'"'"'"'"'"'"''"'"'"'"'"'"'"'"' all_proxy='"'"'"'"'"'"'"'"''"'"'"'"'"'"'"'"' ftp_proxy='"'"'"'"'"'"'"'"''"'"'"'"'"'"'"'"' http_proxy='"'"'"'"'"'"'"'"''"'"'"'"'"'"'"'"' https_proxy='"'"'"'"'"'"'"'"''"'"'"'"'"'"'"'"' no_proxy='"'"'"'"'"'"'"'"''"'"'"'"'"'"'"'"' /usr/bin/python3.9 && sleep 0'"'"''�[0m
Anything else we need to know
No response