Skip to content

Latest commit

 

History

31 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

TwiFetch-OMP

This repo is hosting a simple tweet-fetching (in C++ with OpenMP) and sentiment analysis (in Python) program, which can fetch a large number of tweets in parallel using multiple threads spawned by OpenMP, and achieve a huge performance improvement compared to fetching such a large number of tweets in serial.

UPDATE

Now Cython has been used to bridge C++ and Python codes.

Platform

Developed, tested and run on Ubuntu 16.04.4 LTS.

Usage

Check out the example.cpp for simple use case.

Prerequisite

  • Python-dev 2.7 if you would like analyze the sentiments of fetched tweets.
  • UPDATED: Cython 0.28.3 (no ganrantee that newer version will work). Just use pip install cython to install it.
  • OpenSSL - should be already in the Ubuntu system. However, you also need OpenSSL library to enable SSL support for installation. Simply run sudo apt-get install libssl-dev on terminal.
  • CURL & libcurl - make sure to install with SSL enabled and have HTTPS protocol available after installation. Check out the official installation guide.
  • OpenMP - already available: should be already with GCC on Linux.
  • rapidjson - already available: included in the project. Check out the original Github repo for rapidjson for more information.
  • SHA1 - already available: included in the project. Provides some HMAC-SHA1 encode/decode algorithms.

Useful resources

About

A twitter fetching and sentiment analysis program using OpenMP for parallel fetching and Cython to combine C++ and Python codes.

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages