Skip to content

WIP: add recorded E2E tests#1938

Closed
Pouyanpi wants to merge 5 commits into
developfrom
feat/vcr-recorded-e2e-tests
Closed

WIP: add recorded E2E tests#1938
Pouyanpi wants to merge 5 commits into
developfrom
feat/vcr-recorded-e2e-tests

Conversation

@Pouyanpi

Copy link
Copy Markdown
Collaborator

Description

Adds a recorded E2E test framework for provider-backed rails behavior, including replayable VCR cassettes, parsed cassette bodies, inline snapshots, reusable assertion/normalization helpers, and behavior-focused pytest coverage for public rails APIs, client integrations, and built-in library rails.

@github-actions

Copy link
Copy Markdown
Contributor

Documentation preview

https://nvidia-nemo.github.io/Guardrails/review/pr-1938

@codecov

codecov Bot commented May 27, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@Pouyanpi Pouyanpi force-pushed the feat/vcr-recorded-e2e-tests branch 2 times, most recently from b81778d to ef0f38e Compare May 28, 2026 18:08
@Pouyanpi Pouyanpi force-pushed the feat/vcr-recorded-e2e-tests branch from e9cda98 to e703991 Compare June 2, 2026 13:11
@Pouyanpi

Pouyanpi commented Jun 3, 2026

Copy link
Copy Markdown
Collaborator Author

close as I opened stacked version:

Order PR Branch Base
1 #1974 stack/recorded-tests-01-harness develop
2 #1975 stack/recorded-tests-02-deterministic-library-load stack/recorded-tests-01-harness
3 #1976 stack/recorded-tests-03-clients stack/recorded-tests-02-deterministic-library-load
4 #1977 stack/recorded-tests-04-public-api stack/recorded-tests-03-clients
5 #1978 stack/recorded-tests-05-library-rails stack/recorded-tests-04-public-api

@Pouyanpi Pouyanpi closed this Jun 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant