hadoop-utils

This is a set of code and scripts to debug hadoop issues, test hadoop performance etc.

• Collect Node Manager Metrics

  • A script to collect node manager metrics for analysis, code see here, usage see here.

• Hadoop Cluster Provisioning Scripts

  • A set of scripts to help to setup a multi-nodes hadoop cluster from scratch, see here.

• System Level Utilies

  • A script to monitor Linux system ulimits usage, see code here.