A [Giter8][g8] template for showcasing stateful stream processing using Kafka KStream.
Kafka Client for Kafka API
Twitter4J Streaming as a source.
Typesafe Config to read configuration file.
Kafka Streaming to process stream
###Steps to Install and Run Zookeeper and Kafka on your system :
Step 1: Download Kafka
Download Kafka from here
Step 2: Extract downloaded file
tar -xzvf kafka_2.11-0.10.1.1.tgz
cd kafka_2.11-0.10.1.1
Step 3: Start Servers
Start Zookeeper:
bin/zookeeper-server-start.sh config/zookeeper.properties
Start Kafka server:
bin/kafka-server-start.sh config/server.properties
###Clone Project
git clone [email protected]:knoldus/activator-stateful-kstream-kafka.git
cd activator-kstream-kafka
bin/activator clean compile
###Start Tweet Producer
bin/activator "run-main com.knoldus.demo.ProducerDemo"
This will start fetching tweets and push every tweet into the Kafka queue.
###Start Stream Processor
bin/activator "run-main com.knoldus.demo.KStreamDemo"
This will start stream processing.
###Start Consumer
bin/activator "run-main com.knoldus.demo.ConsumerDemo"
This will start hashtag count.
For any issue please raise a ticket @ Github Issue
Written in 2017 by Knoldus Software LLP
To the extent possible under law, the author(s) have dedicated all copyright and related and neighboring rights to this template to the public domain worldwide. This template is distributed without any warranty. See http://creativecommons.org/publicdomain/zero/1.0/. [g8]: http://www.foundweekends.org/giter8/