KafkaBootStrapping.md

Kafka Boot-Strapping

SSH into VM

sshpass -f pass ssh -o StrictHostKeyChecking=no $USERNAME@$IP_ADDR $COMMAND

• COMMAND

  • Install JRE

    sudo apt install -y default-jre;

  • Download & Extract Kafka

    wget https://mirrors.estointernet.in/apache/kafka/2.8.0/kafka_2.13-2.8.0.tgz;
    tar -xzf kafka_2.13-2.8.0.tgz; 

  • Configuration Update

    python3 kafka_params_updater.py $IP_ADDR; 

    .py file has been transferred to VM before executing the command

    kafka_params_updater.py

    if line.startswith("#advertised.listeners") :
        line = line.replace("your.host.name", VM_IP)
        line = line.replace("#", "")

  • Start ZooKeeper & Kafka Server

    bin/zookeeper-server-start.sh -daemon config/zookeeper.properties;

---

Transfer python file to VM

scp ./kafka_params_updater.py $USERNAME@$IP_ADDR:/home/$USERNAME