-
Notifications
You must be signed in to change notification settings - Fork 67
Description
Hello,
I tried to override cluster properties with the guidance of the documentation in read me file.
Properties added to 'dataproc.custom.properties' file and this file uploaded to Cloud Storage then command given below added to 'customization_script.sh'.
gsutil cp gs://<bucket-name>/custom-image/dataproc.custom.properties /etc/google-dataproc
echo cat /etc/google-dataproc/dataproc.custom.properties
I saw the below info in the console log.
+ echo hive.metastore.warehouse.dir=gs://<bucket-name>/hive-warehouse
Unfortunately, when dataproc cluster created with this custom image, given properties is not added to cluster properties.
Additionally, I try property with below key but result is same.
hive.hive.metastore.warehouse.dir=gs://<bucket-name>/hive-warehouse
Could you please share the detailed documentation about overriding cluster properties ?