Skip to content

NashTech-Labs/activator-stateful-kstream-kafka.g8

Repository files navigation

A [Giter8][g8] template for showcasing stateful stream processing using Kafka KStream.

Kafka Stateful Stream Processor

Kafka Client for Kafka API

Twitter4J Streaming as a source.

Typesafe Config to read configuration file.

Kafka Streaming to process stream


###Steps to Install and Run Zookeeper and Kafka on your system :

Step 1: Download Kafka

Download Kafka from here

Step 2: Extract downloaded file

tar -xzvf kafka_2.11-0.10.1.1.tgz
cd kafka_2.11-0.10.1.1

Step 3: Start Servers

Start Zookeeper:

bin/zookeeper-server-start.sh config/zookeeper.properties

Start Kafka server:

bin/kafka-server-start.sh config/server.properties

###Clone Project

git clone [email protected]:knoldus/activator-stateful-kstream-kafka.git
cd activator-kstream-kafka
bin/activator clean compile

###Start Tweet Producer

bin/activator "run-main com.knoldus.demo.ProducerDemo"

This will start fetching tweets and push every tweet into the Kafka queue.


###Start Stream Processor

bin/activator "run-main com.knoldus.demo.KStreamDemo"

This will start stream processing.

###Start Consumer

bin/activator "run-main com.knoldus.demo.ConsumerDemo"

This will start hashtag count.


For any issue please raise a ticket @ Github Issue

Template license

Written in ​ 2017​ by ​ Knoldus Software LLP

To the extent possible under law, the author(s) have dedicated all copyright and related and neighboring rights to this template to the public domain worldwide. This template is distributed without any warranty. See http://creativecommons.org/publicdomain/zero/1.0/. [g8]: http://www.foundweekends.org/giter8/

About

No description or website provided.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published