Automated Testing

This document aims to cover the various Crowbar automated test suites contained within the Crowbar git repos. Automated execution of these test suites e.g. via CI infrastructure is context-dependent and falls outside the scope of this document - please see Continuous Integration for futher details.

Existing test coverage

• Rails RSpec tests, focusing on testing models and non-visible controller actions (REST API)
• Rails unit tests, focusing on models (will be phased out in favor of RSpec unit tests)
• BDD tests for UI & REST API calls
• chefspec for unit-testing chef recipes
• Self-test from CLI during installation
• Tempest barclamp

Documentation is all here: https://github.com/dellcloudedge/barclamp-crowbar/tree/master/crowbar_framework/doc/default/crowbar/devguide/testing

Roadmap for future work

Known gaps in testing:

• Integration test suite
  • reinstall of node
  • non-green field
  • update of a proposal
• code coverage report