Stuck on "Get Kafka Cluster ID from Embedded Rest Proxy" #2305
Description
Describe the issue
According the documentation we must first install Control Center Next gen; but in Get Kafka Cluster ID from Embedded Rest Proxy task of playbook it's stucked and retry for 30 times and then FAILED.
To Reproduce
ansible-playbook -i hosts.yml confluent.platform.all --tags=control_center_next_gen
Expected behaviour
install control center next gen without any dependency. it seems that needs to kafka broker cluster id.
Inventory File
Please provide your inventory file in order to aid in the investigation.
Logs
TASK [confluent.platform.common : Get Kafka Cluster ID from Embedded Rest Proxy] *****************
FAILED - RETRYING: [kafka-control.test.local]: Get Kafka Cluster ID from Embedded Rest Proxy (30 retries left).
FAILED - RETRYING: [kafka-control.test.local]: Get Kafka Cluster ID from Embedded Rest Proxy (29 retries left).
FAILED - RETRYING: [kafka-control.test.local]: Get Kafka Cluster ID from Embedded Rest Proxy (28 retries left).
FAILED - RETRYING: [kafka-control.test.local]: Get Kafka Cluster ID from Embedded Rest Proxy (27 retries left).
.
.
.
fatal: [kafka-control.test.local]: FAILED! => {"attempts": 30, "changed": false, "content": "", "elapsed": 0, "msg": "Status code was -1 and not [200]: Request failed: <urlopen error [Errno 111] Connection refused>", "redirected": false, "status": -1, "url": "https://kafka-broker-01.test.local:8090/kafka/v3/clusters"}
Environment (please complete the following information):
- OS: Ubuntu 24.04
- CP-Ansible Branch: [8.1.0-post]
- Ansible Version 2.18.10
- RBAC enabled with oauth, and also tried ldap with oauth
Additional context
I'm also try for install with this method:
ansible-playbook -i hosts.yml confluent.platform.all
but in this way, ansible tries to first install kafka controller and this error is thrown and playbook installation failed:
TASK [confluent.platform.kafka_controller : Check Kafka Metadata Quorum] *************
fatal: [kafka-kraft-01.test.local]: FAILED! => {"changed": false, "cmd": "/mnt/kafka/confluent/confluent-8.1.0/bin/kafka-metadata-quorum --bootstrap-server kafka-broker-01.test.local:9091 --command-config /mnt/kafka/confluent/etc/controller/client.properties describe --replication\n", "delta": "0:01:02.226331", "end": "2025-10-21 20:56:42.359973", "msg": "non-zero return code", "rc": 1, "start": "2025-10-21 20:55:40.133642", "stderr": "[2025-10-21 20:55:42,095] WARN [AdminClient clientId=adminclient-1] Connection to node -1 (kafka-broker-01.test.local/10.1.52.2:9091) could not be established. Node may not be available.
in both ways (1. first insatllation of control center 2. all install and controller first) it depends on kafka broker that not installed yet...
the problem is both refer to kafka-broker-01 that not installed yet