v0.0.6

‼️ Breaking changes ‼️

• Replaced shouldFail field in create and apply operations by assertion trees to validate outputs and error

💫 New features 💫

• Added assertion tree support in command and script operations to validate command outputs (stdout and stderr) and error
• Added support for dryRun in create and apply operations
• Added --test-file flag to use a custom test file name
• Added raw resource support in Test and TestSteps to provide a resource directly instead of referencing a file
• Improved loggs, added a STATUS column and operation details are now shown in sections
• Added programmatic validation in Test and TestStep resources

🔧 Fixes 🔧

• Sort error messages to get predictable output
• Current working directory not set in command and script operations
• Fixed a few assertion tree bugs in kyverno-json
• Fixed an invalid regex check in GitHub action
• Fixed cases where cleanup timeout was not used correctly

📚 Docs 📚

• Added multi version docs support

🎸 Misc 🎸

• Added command and script operations support to KUTTL migration command

Changelog

• e1c5e5d chore: update release notes (#459)
• ca649c0 feat: add programmatic validation (#460)
• a1cb137 fix changes (#464)
• c08ae80 release: v0.0.6 (#466)

v0.0.6-alpha.4

Changelog

• a809ff8 fix: bump kyverno-json (#458)
• c3d72f8 refactor : Migration (#456)

v0.0.6-alpha.3

Changelog

• 96aeca5 chore(deps): Bump anchore/sbom-action from 0.14.3 to 0.15.0 (#455)
• f8cd497 chore: bump kyverno-json (#457)
• 3e2026e chore: fix mike docs (#454)

v0.0.6-alpha.2

Changelog

• e1cb9b4 chore: add mike docs support (#444)
• d4eecd9 chore: fix mike docs (#445)
• 9af6a5e chore: fix mike docs (#446)
• 6754185 chore: fix mike docs (#447)
• 621f67c chore: fix mike docs (#450)
• a392a9a feat: add kuttl commands migration (#440)
• f218d9b fix: bump kyverno-json (#452)
• 704abd5 fix: gh action regex (#439)
• 97cd55d refactor: Operations (#435)

v0.0.6-alpha.1

Changelog

• a89c4ae add Report (#424)
• ce7bb61 chore(deps): Bump k8s.io/api from 0.28.3 to 0.28.4 (#420)
• d169d5b chore(deps): Bump k8s.io/client-go from 0.28.3 to 0.28.4 (#421)
• 89362ea chore: add a couple unit tests (#400)
• 4a3f830 chore: add a few unit tests (#404)
• af00211 chore: drop commented code (#402)
• e31d172 chore: more operations (#432)
• 6a79ace chore: remove match package (#398)
• d0b8f60 feat: Custom Test File name (#401)
• 9eaf843 feat: Dry-run in Apply/Create (#410)
• 585ef81 feat: add check in operation (#418)
• 3969471 feat: add checks in apply and create (#423)
• 89cbc50 feat: add raw resource support (#409)
• 190b339 fix : client name to operation client (#414)
• 03405c6 fix: cleanup (#425)
• cc4c724 fix: cleanup timeout (#433)
• a87ceec fix: namespacer (#434)
• 39b1671 fix: script and command should set the cwd (#437)
• b4eafb2 fix: sort assert error messages (#399)
• dcb60a1 have output (#406)
• 5155980 refactor: Add Cleanup to Operation (#417)
• acf9948 refactor: Operations (#412)
• 12542c5 refactor: dry run client (#427)
• b6e5c5c refactor: logger (#431)
• cf861aa refactor: namespacer (#428)
• ca83736 refactor: operations (#430)
• 02ccd7b refactor: operations package (#415)
• 7d38354 refactor: processors (#429)
• a9bcaea typo (#405)

v0.0.5

💫 New features 💫

• Support new assertion tree model 🎉

Changelog

• 7e9cd8b Add a note to mention hard-coded test name (with sign-off) (#392)
• 77abe04 chore(deps): Bump actions/checkout from 4.1.0 to 4.1.1 (#384)
• 749ec2a chore(deps): Bump github.com/fatih/color from 1.15.0 to 1.16.0 (#381)
• 2cbb59d chore(deps): Bump github.com/spf13/cobra from 1.7.0 to 1.8.0 (#382)
• e769964 chore(deps): Bump sigstore/cosign-installer from 3.1.2 to 3.2.0 (#391)
• 1fd20ab chore(deps): Bump zgosalvez/github-actions-ensure-sha-pinned-actions (#383)
• 657c4eb chore: add assertion trees docs (#395)
• b26d9fb chore: refactor operations docs (#393)
• 7ec11d3 chore: update release notes (#394)
• a2fdd18 feat: use assertion trees (#385)

v0.0.4

‼️ Breaking changes ‼️

• Renamed flag stop-on-first-failure to fail-fast
• Lots of API changes to allow more flexibility while making the syntax simpler
• Commands accepting a file now expect a single file, list of files are not supported anymore

💫 New features 💫

• Added provenance for released images
• Added a GitHub action to install Chainsaw
• Added a new Create operation
• Steps changed to follow a Try / Catch / Finally model

🔧 Fixes 🔧

• Fixed a bug where environment variables were not expanded correctly in command arguments

🎸 Misc 🎸

• Switched to contextual logging

Changelog

• cc64567 chore: update release notes (#378)
• 26d957b chores: add gh action docs (#379)
• db4b1f3 release: v0.0.4 (#380)

v0.0.4-alpha.1

Changelog

• 02bf18e 100% COverAGE (#365)
• 93644e4 100% Coverage (#366)
• e86eb0a chore: add runner flags unit tests (#327)
• 6d5ffbe chore: improve action workflow (#362)
• bae45b7 chore: refactor operations tests (#373)
• 721e439 feat: add github action (#359)
• 3f72ef8 feat: add new create operation (#363)
• 8387d57 feat: add released image provenance (#356)
• 34c7e14 feat: implement try/catch/finally (#358)
• bb678cc feat: switch to contextual logging (#345)
• 6c58d5a feat: switch to contextual testing (#346)
• 86f72d4 fix: Add operations field in the TestStep (#324)
• d1d06b2 fix: add more contextual logging (#368)
• fd0f642 fix: expand command args (#361)
• 09aa66a fix: file name (#339)
• 66af0a5 fix: runner client (#364)
• 52c4740 refactor: client mocking (#370)
• 995e7da refactor: collectors and exec api (#374)
• 638859d refactor: create runner internal package (#326)
• 517e9d7 refactor: create runner/cleanup package (#331)
• 9605743 refactor: create runner/collect package (#332)
• 09c2beb refactor: create runner/names package (#333)
• 1c5a5a5 refactor: create runner/summary package (#340)
• 0101459 refactor: inline test step spec (#343)
• dba0baa refactor: introduce operation runner (#351)
• 31ecc7e refactor: introduce runner client (#330)
• e4cbb3a refactor: introduce runner/processors package (#353)
• fd35414 refactor: introduce step runner (#349)
• bb5b8b1 refactor: introduce test runner (#347)
• de9d17f refactor: introduce tests runner (#341)
• d5582ea refactor: operation api (#372)
• 911ae44 refactor: remove runner context (#352)
• 719624d refactor: renamed flag to (#328)
• 87a9cc2 refactor: runner timeout code (#329)
• e1516a9 refactor: single file ref in operation (#371)
• c6c35f0 test : 100% coverage pkg/version (#354)

v0.0.3

💫 New features 💫

• We now have a logo 🎉
• Timeouts are now managed per operation rather than per step
• Added timeout support at the operation level

🔧 Fixes 🔧

• Fixed Exec collectors not invoked

🎸 Misc 🎸

• Improved error messages in a couple of places

Changelog

• 9683b8d Add test (#267)
• 08a274d Add test (#268)
• efa5829 Client-test (#265)
• e71ff6f add logo and banner (#282)
• b8b970a bug: resouce nil not checked (#274)
• 18fada8 check parsed (#273)
• 1bcabc1 chore(deps): Bump aquasecurity/trivy-action from 0.13.0 to 0.13.1 (#283)
• 26fe072 chore(deps): Bump zgosalvez/github-actions-ensure-sha-pinned-actions (#301)
• d3a2d19 chore(deps): Bump zgosalvez/github-actions-ensure-sha-pinned-actions (#322)
• cd68092 chore: add docs command help (#307)
• 96e4e45 chore: add kuttl command tests (#308)
• efb887c chore: add kuttl migrate command tests (#310)
• 51523c5 chore: add more client tests (#306)
• f54f2de chore: add runner client tests (#277)
• b168e39 chore: add runner tests (#293)
• be9e1fd chore: add runner unit tests (#280)
• 38202be chore: add test command all flags test (#313)
• 6553999 chore: add timeout tests (#278)
• 802bf25 chore: bump kyverno (#279)
• 4e6e6ed chore: cleanup assets (#286)
• d65181a chore: fix fake clock in logger tests (#289)
• cc4ef40 chore: fix typo in release notes (#263)
• 82a658e chore: go mod tidy (#311)
• ed65fdc chore: improve command tests (#312)
• 1a26772 chore: improve logger tests (#317)
• a4a5b56 chore: improve namespacer test (#288)
• f879a7b chore: improve runner/logging tests (#314)
• 83212bd chore: improve version command tests (#309)
• e4037cb chore: timeouts docs (#321)
• 3855248 chore: update release notes (#287)
• 3745b52 chore: use data driven test (#275)
• 2118c53 documentation: new version timeouts (#305)
• 6836cd6 documentation: point to right github url (#303)
• 34c619b feat: add timeout support at operation level (#315)
• 895862e feat: revisit timeouts (#281)
• 0e65cfd fix: exec collector not invoked (#298)
• 1d95013 fix: improve timeouts (#299)
• 55005e1 fix: install docs - compile from sources (#320)
• ac2af29 fix: tests (#296)
• 278cf80 fix: timeouts api (#292)
• 32e1784 fix: unit tests (#295)
• 16ff569 fix: use slices package (#253)
• 5af17a0 fs-flag (#266)
• da9d387 refactor: discovery package (#302)
• fbc81c6 refactor: reduce client interface scope (#276)
• 2180c30 release: v0.0.3 (#325)
• f1dc215 test : runner/logging package (#285)

v0.0.2

💫 New features 💫

• Added Command and Script operations
• Added support to continue on error in Delete, Apply, Assert, Error, Command and Script operations
• Added support to specify if a test should run concurrently or not at the Test level
• Added support for overriding the namespace used at the Test level
• Added Event and Pod logs collectors support
• Added chainsaw kuttl migrate command to migrate KUTTL tests to chainsaw
• Added support for Apply operations to fail (when applying a resource is expected to return an error)
• Docker image is now released under ghcr.io/kyverno/chainsaw

✨ UI changes ✨

• Improved logging of running tests
• Added coloured logs
• Made Parallel in Configuration optional (delegates default to the testing package)

📚 Docs 📚

• Improved CLI docs

🎸 Misc 🎸

• Switched to subtests for better summary report from the testing package

Changelog

• 474e9b1 chore: add collector docs (#249)
• 914128f chore: docs nits (#251)
• 0483dce chore: move main (#230)
• 27d5116 chore: release notes (#239)
• 3d4c7a1 chore: reuse kyverno file package (#247)
• 6590ccf chore: reuse more from kyverno (#250)
• c0f1305 chore: use ext/yaml package (#229)
• 287a4c2 docs : Add kuttl-migrate docs (#244)
• dbfc772 feat: Add how to Use docker image (#243)
• ffa5508 feat: add should fail support in apply (#241)
• 92c3a20 fix: force color (#240)
• 2eaff82 fix: improve kuttl migrate command (#231)
• 3e3d75c fix: kuttl migration guide (#248)
• 1c7e036 fix: pad step name (#246)
• 1e01096 release: v0.0.2 (#252)