Automated Testing

This document aims to cover the various Crowbar automated test suites contained within the Crowbar git repos. Automated execution of these test suites e.g. via CI infrastructure is context-dependent and falls outside the scope of this document - please see Continuous Integration for futher details.

Existing test coverage

• BDD test for UI & REST API calls: http://crowbar.sync.in/CrowbarBDD
• Self-test from CLI during installation
• Tempest barclamp

FIXME - need more details on how to run and add tests in all these cases. This should mainly be documented in the same repositories where the tests actually live, so that changes to docs are tightly coupled to changes to (test) code.

Roadmap for future work

Known gaps in testing:

• Unit / rspec tests
  • crowbar_framework model & db
  • recipes (apparently Opscode is working on a framework to help test recipes?)
• Integration test suite
  • reinstall of node
  • non-green field
  • update of a proposal
• code coverage report