do i need to create zookeeper and minio for every flink job

[nealsun]

In this mode, flink job manger and flink task manager packed together for every single flink job, do i need to create zookeeper and minio for every flink job? or is it the best practice to packed all together to deploy one job?

[alpinegizmo]

Typically you will have one zookeeper cluster, and one distributed filesystem (e.g., minio) that are shared by all of your deployments. Or if you already have a zookeeper set up for Kafka, just use that one.

[nealsun]

got it. Thanks for your reply!

[nealsun]

Why use k8s Job to deploy Job Manager rather than k8s Deployment? i'm using gitlab to deploy my flink job, it's easy to patch a Deployment with new docker image, but Job does not support patch. Can i use Deployment instead of Job to deploy Job Manager ?

[alpinegizmo]

@nealsun I haven't tried using a Deployment for the Flink Master (job manager) -- if you try it, let me know what you find.