CERN Hadoop team started to change their config very frequently compared to the last years. Our Spark and Sqoop jobs fail because of non-updated config which includes connection parameters and Hadoop/Spark node urls.
We need to evaluate running yum update cern-hadoop-config before each Spark job running on Kubernetes pod.
CERN Hadoop team started to change their config very frequently compared to the last years. Our Spark and Sqoop jobs fail because of non-updated config which includes connection parameters and Hadoop/Spark node urls.
We need to evaluate running yum update
cern-hadoop-configbefore each Spark job running on Kubernetes pod.