Skip to content

Releases: m-lab/etl

Allow leading ./ in filenames

24 Oct 02:30

Choose a tag to compare

Pre-release
ndt-staging-v0.4.1-a

Update ndt.go

Sandbox - try pubsub with remote subscription

24 Oct 21:54

Choose a tag to compare

Local subscription doesn't get updates from remote topic.
From pubsub branch.

Try using local subscription with 10 minute deadline.

23 Oct 15:55

Choose a tag to compare

ndt-sandbox-v0.4-e

Change to use a local subscription

Trial using pubsub in sandbox

22 Oct 15:51

Choose a tag to compare

Pre-release

Added 10 minute ack deadline.
Note that for 50MB tar files with typical distribution of around 40 tests per file, the processing takes under a minute. However, for very slow tests, the trace files are small, so there may be 100s of tests in a tar file, and it may take more like 5 minutes to process. We will need to monitor whether some test files are resubmitted, resulting in higher dup rates.

Also, note that AppEngine appears to do autoscaling only if there are HTTP requests passed through the load balancer. Since subscription method uses pulls directly from the pubsub system, AppEngine does not autoscale. We will need to use a different scaling mechanism.

tweak queue configs + quota retry

17 Oct 14:14

Choose a tag to compare

Pre-release

Tweaking queue configs, max_workers, for better instance regulation and 14 hour per day processing time.

Add quota retry

17 Oct 04:13

Choose a tag to compare

Add quota retry Pre-release
Pre-release
ndt-sandbox-v0.3.2

Fix time arithmetic

GeoLocation with Sidestream

12 Oct 19:50

Choose a tag to compare

Pre-release
ss-staging-v0.2

enable staging and prod.

GeoLocation with Sidestream

12 Oct 19:48

Choose a tag to compare

Pre-release
Merge pull request #263 from m-lab/pt-geo

activate GeoLocation in staging and prod for PT

sidestream Geo

12 Oct 19:09

Choose a tag to compare

sidestream Geo Pre-release
Pre-release
ss-sandbox-v0.1

enable Geo with SS.

Geo in Sidestream

12 Oct 19:50

Choose a tag to compare

Geo in Sidestream Pre-release
Pre-release
ss-prod-v0.1

enable staging and prod.