Skip to content

Overriding cluster properties #76

@kaganozgun

Description

@kaganozgun

Hello,
I tried to override cluster properties with the guidance of the documentation in read me file.
Properties added to 'dataproc.custom.properties' file and this file uploaded to Cloud Storage then command given below added to 'customization_script.sh'.

gsutil cp gs://<bucket-name>/custom-image/dataproc.custom.properties /etc/google-dataproc
echo cat /etc/google-dataproc/dataproc.custom.properties

I saw the below info in the console log.
+ echo hive.metastore.warehouse.dir=gs://<bucket-name>/hive-warehouse

Unfortunately, when dataproc cluster created with this custom image, given properties is not added to cluster properties.

Additionally, I try property with below key but result is same.
hive.hive.metastore.warehouse.dir=gs://<bucket-name>/hive-warehouse

Could you please share the detailed documentation about overriding cluster properties ?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions