1.6.0

Upgrade Spark on spark-box to 1.6.2 (thanks @fnothaft, @jpdna), bug-fixes.

UCSC's CGL core production should not upgrade to this release.

• Always install mdadm (fixes #194)
• Bump Toil on toil-box to 3.3.3
• extracted functionality into cgcloud-lib in support of Toil using it
• Pin s3am on toil-box (resolves #206)
• Allow toil-box to pass IAM role (resolves #208)
• MesosBox: Remove single quotes around attribute pairs (fixes #213)
• Fix: register-key fails when run the first time in us-east-1 (fixes #215)
• Page IAM roles and instance profiles when listing them (resolves #219)
• Open up toil-latest-box for Toil pre-releases up to 3.5.0
• Optionally tag spot requests (resolves #237) (thanks @cket)
• Move to Spark 1.6.2 and Java 8 (resolves #231)
• Disallow upper-case in namespaces, further restrict namespaces lexically (fixes #245)

582eaa7...releases/1.6.x

1.5.6

The toil-latest-box role deploys 3.5.0 pre-releases. It used to be stuck on 3.4.0 pre-releases.

This release does not contain changes pertinent to core production. It is recommended that production stays on 1.5.5.

1.5.5

Changes:

• toil-box installs Toil 3.3.3 (resolves #225)

This release is recommended to replace 1.5.4 or older for production use.

1.5.3

A hotfix release that fixes #206 which could cause unstable release of s3am to creep into toil-box.

1.5.2

This release of CGCloud contains the changes listed below (compared to 1.4.2). Note that 1.5.0 and 1.5.1 had show-stopping bugs and should not be used.

• Added toil-legacy-box which installs Toil 3.1.6
• Updated toil-box to install Toil 3.3.0
• Updated toil-latest-box to install the latest pre-release of Toil up to 3.4.0

1.4.1

This release contains the following changes, in reverse, approximately historical order:

• Fix: /mnt/ephemeral not striped on instance types with multiple ephemeral volumes on certain cases
• Install Spark on Jenkins
• Bump Mesos to 0.25.1 (@jpfeil)
• Add support for non-default VPC and subnet ID's
• Extract some generally useful functionality from core.Box into lib.ec2
• Bind-mount /var/lib/toil eagerly on mesos-box, toil-box and toil-latest-box (@arao)
• allow user jenkins to mount and unmount via sudo on Jenkins slave boxes (@arao)
• Select boxes by EC2 instance ID via --instance-id
• Install Yarn and Spark on toil-jenkins-slave (@fnothaft)
• Install Slurm on toil-jenkins-slave (@dleehr)

Note to Toil users: A toil-box created with this release of CGCloud installs the legacy version of Toil (3.1.6). Don't use this release of CGCloud for creating toil-latest-box because it installs an obsolete version of Toil (3.2.0, obsoleted by 3.2.1). Use a 1.5.x release instead.

1.3.8

Bump s3am to 1.1. on toil-box.

1.3.7

Bump Toil to 3.1.4 on toil-box.

1.3.6

• Fix: /mnt/ephemeral not being mounted on Ubuntu Trusty roles like toil-box
• Install s3am in virtualenv to avoid dependency conflicts with Toil (resolves #108)

1.3.5

• pins s3am to 1.0b1.dev49, preventing create to always use the latest version
• Fix problem with not finding a base image for Fedora 21
• Fix eventual consistency around creating security groups