Unable to start worker #6
Description
Hi
When I configured CSD and parcel, there was a problem in cm web installation.
The CDH version is 6.3.0
- echo '2019-12-22 14:54:56: Starting Airflow worker...'
- su -s /bin/bash - airflow -c 'CONF_DIR=/var/run/cloudera-scm-agent/process/213-airflow-AIRFLOW_WORKER exec /opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/bin/airflow-cm.sh worker '
/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/airflow/configuration.py:214: FutureWarning: The task_runner setting in [core] has the old default value of u'BashTaskRunner'. This value has been changed to u'StandardTaskRunner' in the running config, but please update your config before Apache Airflow 2.0.
FutureWarning,
Traceback (most recent call last):
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/bin/.airflow", line 32, in
args.func(args)
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/airflow/utils/cli.py", line 74, in wrapper
return f(*args, **kwargs)
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/airflow/bin/cli.py", line 1090, in worker
worker.run(**options)
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/celery/bin/worker.py", line 257, in run
**kwargs)
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/celery/worker/worker.py", line 101, in init
self.setup_instance(**self.prepare_args(**kwargs))
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/celery/worker/worker.py", line 122, in setup_instance
self._conninfo = self.app.connection_for_read()
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/celery/app/base.py", line 743, in connection_for_read
return self._connection(url or self.conf.broker_read_url, **kwargs)
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/celery/app/base.py", line 819, in _connection
'broker_connection_timeout', connect_timeout
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/kombu/connection.py", line 189, in init
url_params = parse_url(hostname)
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/kombu/utils/url.py", line 47, in parse_url
scheme, host, port, user, password, path, query = _parse_url(url)
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/kombu/utils/url.py", line 81, in url_to_parts
parts.port,
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/future/backports/urllib/parse.py", line 162, in port
port = int(port, 10)
File "/opt/cloudera/parcels/AIRFLOW-1.10.3-python2.7.15_b2/lib/python2.7/site-packages/future/types/newint.py", line 76, in new
return super(newint, cls).new(cls, val)
ValueError: invalid literal for long() with base 10: ''
[22/Dec/2019 14:54:59 +0000] 749 MainThread redactor INFO Started launcher: /opt/cloudera/cm-agent/service/csd/csd.sh start_worker
[22/Dec/2019 14:54:59 +0000] 749 MainThread redactor ERROR Redaction rules file doesn't exist, not redacting logs. file: redaction-rules.json, directory: /run/cloudera-scm-agent/process/213-airflow-AIRFLOW_WORKER
[22/Dec/2019 14:54:59 +0000] 749 MainThread redactor INFO Re-exec watcher: /opt/cloudera/cm-agent/bin/cm proc_watcher 758
Would you like to help me
Than you