Add Stateful API testing for Model Registry#132
Merged
dbasunag merged 15 commits intoopendatahub-io:mainfrom Apr 11, 2025
Merged
Add Stateful API testing for Model Registry#132dbasunag merged 15 commits intoopendatahub-io:mainfrom
dbasunag merged 15 commits intoopendatahub-io:mainfrom
Conversation
Signed-off-by: lugi0 <lgiorgi@redhat.com>
|
The following are automatically added/executed:
Available user actions:
Supported labels{'/wip', '/lgtm', '/hold', '/verified'} |
7 tasks
Contributor
Author
|
On hold until kubeflow/model-registry#773 is merged |
rnetser
suggested changes
Feb 9, 2025
Signed-off-by: lugi0 <lgiorgi@redhat.com>
Signed-off-by: lugi0 <lgiorgi@redhat.com>
Contributor
Author
|
/hold |
Contributor
Author
|
The test now works as we've updated the openAPI spec file in upstream, however I sometimes get a library error ( |
Signed-off-by: lugi0 <lgiorgi@redhat.com>
adolfo-ab
previously approved these changes
Apr 9, 2025
rnetser
reviewed
Apr 9, 2025
Signed-off-by: lugi0 <lgiorgi@redhat.com>
Signed-off-by: lugi0 <lgiorgi@redhat.com>
Signed-off-by: lugi0 <lgiorgi@redhat.com>
mwaykole
reviewed
Apr 11, 2025
mwaykole
reviewed
Apr 11, 2025
dbasunag
previously approved these changes
Apr 11, 2025
Signed-off-by: lugi0 <lgiorgi@redhat.com>
dbasunag
approved these changes
Apr 11, 2025
Contributor
Author
|
/verified |
|
Status of building tag latest: success. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This adds a test for stateful API testing of Model Registry. It also bumps Schemathesis to V4, which is still an alpha release but appears to work fine for this workload.
I will keep this as a draft until the openAPI spec is updated in the Model Registry repo to support Stateful testing, and we can then decide if we are ok with an alpha release being pulled or if we want to wait / downgrade to V3 (requires some rework due to breaking changes between the two major versions).
I have also added a new mark type, "fuzzer", which I'd use to indicate tests which are bound to fail due to their random nature.
How Has This Been Tested?
Multiple runs made from local with an updated openAPI spec file which have already identified some failures to address in Model Registry.
Merge criteria: