Skip to content
This repository was archived by the owner on Nov 23, 2021. It is now read-only.

textpipe/streamprocessor

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

streamprocessor: transform streaming messages

Prequisites

Install librdkafka:

brew install librdkafka

Running an example

$ echo '{"test": 1, "a": 3, "c": 4}' | python example.py keys

Running an example with Spark

PYSPARK_PYTHON=python spark-submit --packages org.apache.spark:spark-sql-kafka-0-10_2.11:2.3.0 --py-files streamprocessor/ example_spark.py

About

Transform streaming messages

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •  

Languages