Multiple celery workers don't work using Kafka broker

[mfaw]

I'm trying to have many celery workers running, multiple workers, not one worker with concurrency. I want to have multiple worker nodes.
I first tried using rabbitmq as a broker to celery and it worked with multiple workers and all workers sync together making tasks split among the open workers.
I tried doing the exact same thing with Kafka as a broker however, the workers don't sync and the tasks are sent to one worker only which is the last worker ready.
Any idea how I can fix this?
Thanks