Options to skip small files and not recurse on input paths#90

Open

gsteelman wants to merge 11 commits intotwitter:masterfrom

gsteelman:add_distributed_lzo_indexer_skip_small_files

Commits on Aug 11, 2014

Added option to skip indexing small files. Added option to not recurse for files to index from input paths.
gsteelman
committed
Removed hard-coded default values in run().
gsteelman
committed

Commits on Aug 14, 2014

Added config option for file size to be considered 'small'.
gsteelman
committed

Commits on Sep 1, 2014

Added static modifiers to constants, replaced unnecessary PathFilter with helper method.
gsteelman
committed

Commits on Sep 2, 2014

Removed 'this' modifier from static variables.
gsteelman
committed

Commits on Dec 14, 2015

Merge remote-tracking branch 'twitter/master' into add_distributed_lzo_indexer_skip_small_files
gsteelman
committed

Commits on Dec 15, 2015

Commits on Dec 16, 2015

Change many methods and constants to public for testing and for external access. Refactor configuration/job setup. Add unit tests. Remove unused variable in TestLzoRandData.
gsteelman
committed

Commits on Dec 17, 2015