Skip to content

Commit d342dd3

Browse files
authored
Remove the default machine types (apache#33191)
From apache#30507 (comment), try to use the default machine types for Flink with more memory.
1 parent b70375d commit d342dd3

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

.test-infra/dataproc/flink_cluster.sh

+1-3
Original file line numberDiff line numberDiff line change
@@ -131,10 +131,8 @@ function create_cluster() {
131131

132132
# Docker init action restarts yarn so we need to start yarn session after this restart happens.
133133
# This is why flink init action is invoked last.
134-
# TODO(11/11/2022) remove --worker-machine-type and --master-machine-type once N2 CPUs quota relaxed
135-
# Dataproc 2.1 uses n2-standard-2 by default but there is N2 CPUs=24 quota limit
136134
gcloud dataproc clusters create $CLUSTER_NAME --region=$GCLOUD_REGION --num-workers=$FLINK_NUM_WORKERS --public-ip-address \
137-
--master-machine-type=n1-standard-2 --worker-machine-type=n1-standard-2 --metadata "${metadata}", \
135+
--metadata "${metadata}", \
138136
--image-version=$image_version --zone=$GCLOUD_ZONE --optional-components=FLINK,DOCKER --quiet
139137
}
140138

0 commit comments

Comments
 (0)