As a Singly Developer, I want to check in new code and have integration tests run automatically

Analysis

Goal

The goal of this story is, first and foremost, to setup a server that will run all of our tests with every checkin and complain loudly if things are broken. The secondary goal will be to clean up the test suite so that it's actually reliable.

Scoping

• Includes: All of our tests checked into master are run on every checkin.
• Includes: These tests should rarely fail if there isn't any actual breakage
• Includes: Some sort of web UI for the team to see the state of the build.
• Includes: Establishing a test environment that mirrors production in terms of packages that are installed.
• Includes: Notifications [email + IRC] for failures and for when the build is fixed again.
• Excludes: Setting up selenium tests. This should be created as a separate story as getting selenium-rc running happily is a very non-trivial task.
• BONUS: Fix all of the race conditions
• BONUS BONUS: Enable it to run the suite on all checkins on all branches as well.
• BONUS BONUS BONUS: Separate the unit tests into a suite run by nodeunit or expresso or something other than vows, while leaving the integration tests running in vows.

Acceptance criteria

• When I check in code that breaks the build, the entire team is notified [email + IRC] about the breakage.
• When I check in code that fixes that error, the entire team is notified [email + IRC] that I've fixed the build.

Testing

• There are no specific tests that need to be created, but we will need to setup a new environment for the CI tests to be run out of.

Dependencies

• N/A

Wireframes

• N/A

Mockups

• N/A

List of known tasks

• Setup a new environment that can run our tests manually successfully.
• Setup Jenkins CI to run our test suite
• Setup notifications from Jenkins
• Potentially fix the tests

Analysis review

Signed off by:

• ...

Known issues

• ...

Pre-acceptance checklist

• Ask someone who did not work on the project to get it working on their laptop, to chase out issues you may have missed
• Make appropriate preparations so that remote developers can follow along with the demo

Acceptance checklist

• Demo
• Have the acceptance criteria been met?
• Are the tests sufficient?
• Review known issues
• Does the implementation meet expectations for code quality and clarity?
• What considerations are there for deployment to production?
• Has master been merged in?

Merge checklist

• Merge into master
• Check that tests pass