Deploy better configs for batch pipeline

40 instances
12 workers per instance
8 queues * 55 concurrent per queue and 2/sec
.travis.yml add batch deployment

Deploy better configs for batch pipeline

40 instances
12 workers per instance
8 queues * 55 concurrent per queue and 2/sec

Queue pusher with support for arbitrary queues.

Not actually used, but needed for testing reprocessing script.

Queue pusher with support for arbitrary queues.

For batch, we need to be able to send to arbitrary queues, specified with queue= parameter.

Queue pusher with support for arbitrary queues.

Merge pull request #295 from m-lab/queue-pusher

Queue pusher

Deploy queue-pusher with fixed validation

Update validation to include arbitrary tar file time.

queue-pusher with incremental validation

We have deployed a new scraper that uploads incrementally, with second resolution time stamps. This pushes the latest queue-pusher, with validation that accepts non-zero HHMMSS.

Deploy ndt parser with fixed validation

Arbitrary time HHMMSS in tar file validation.

Most recent prod, with support for incremental HHMMSS

Merge pull request #291 from m-lab/tweaks

Tweak num workers and remove bad log msg.

Allow leading ./ in filenames - for testing only

incremental scraper introduces leading ./ Allow for testing, but we should fix scraper.