Skip to content

readme.md

Latest commit

 

History

History
35 lines (18 loc) · 1015 Bytes

readme.md

File metadata and controls

35 lines (18 loc) · 1015 Bytes

Most Recent 100 Visitors

MapReduce Program to find most recent 100 Visitors

Retrieve code

  • $ git clone https://github.com/sheshnath08/RecentVisitors.git
  • $ cd RecentVisitors

Dependensies

Project is written with Hadoop's MapReduce framework and it uses org.json library to parse json data input

Running

  • Put your input files on HDFS

    $ hadoop fs -put path-to-local-directory input-path-on-hdfs

  • Download org.json jar from here https://mvnrepository.com/artifact/org.json/json/20160810

  • Put org.json jar on HDFS

    $ hadoop fs -put path-to-local-jar jar-path-on-hdfs

  • I have compiled and created jar file for hadoop can be run using following command

    $ hadoop jar RecentVisitor.jar RecentVisitorDriver input-path-on-hdfs output-path-on-hdfs

  • Get output files from HDFS

    $ hadoop fs -get output-path-on-hdfs