Skip to content

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

1 watching

Forks

 
 

Repository files navigation

Pre-requisites:
pip install cassandra-driver
confluent kafka platform: http://www.confluent.io/developer

SETUP:
#start dse, with both search and analytics enabled (analytics only used for now, search coming later)
bin/dse cassandra -k -s

From confluent dir:
#start zk, kafka, schema registry, and rest server
bin/zookeeper-server-start etc/kafka/zookeeper.properties
bin/kafka-server-start etc/kafka/server.properties
bin/schema-registry-start ./etc/schema-registry/schema-registry.properties
bin/kafka-rest-start

#create topic
./bin/kafka-topics --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic meter_readings

USAGE:

To insert data into Cassandra, run:
python energy.py <number of devices> <cassandra host ip>

For example:
python energy.py 3 127.0.0.1

To generate a file containing a day's data for sensors:

python filegen.py <number of devices>

For example:

python filegen.py 1000

To simulate pushes of data using REST urls,s run

python generaterest.py <number of devices>

For example

python generaterest.py 1000

To run the batch job:

<dse install directory>/bin/dse spark-submit <path to batch.py>

For example:

/dse/bin/dse spark-submit ./batch.py


testing:

bin/kafka-console-consumer --zookeeper localhost:2181 --topic meter_readings --from-beginning\

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors

Languages