Conversation
…datahub-io#347) * feat: Add test to verify TrustyAIService works with multiple ns * fix: move resource definition inside if block in some fixtures * fix: typo in docstring of trustyai_service_with_invalid_db_cert * fix: move resource definiition inside if blocks
This is because the unprivileged_client is not allowed to perform CRUD operations over InferenceServices. Thus, using the admin_client while we configure the unprivileged one.
…ahub-io#348) * feat: add image validation for trustyai operator and service * feat: add image validation for trustyai operator and service * feat: add fixture for trustyai operator deployment * feat: add fixture for trustyai operator deployment * docs: add docs for service image validation
* feat: add image validation for trustyai operator and service * feat: add image validation for trustyai operator and service * feat: add fixture for trustyai operator deployment * feat: add fixture for trustyai operator deployment * docs: add docs for service image validation * feat: add lmeval image test * feat: refactor code and add test for guardrails orch * fix: format and copy * fix: method name for validator and remove unnecessary layer calls * fix: add smoke tag and add docstring
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
* adding e2e tests for openshift route timeout Signed-off-by: Brett Thompson <196701379+brettmthompson@users.noreply.github.com> * adding pytests dependency markers Signed-off-by: Brett Thompson <196701379+brettmthompson@users.noreply.github.com> * removing unused fixture Signed-off-by: Brett Thompson <196701379+brettmthompson@users.noreply.github.com> * fixing wrong test deps Signed-off-by: Brett Thompson <196701379+brettmthompson@users.noreply.github.com> * adding comment to sleep statements for pre-commit to ignore Signed-off-by: Brett Thompson <196701379+brettmthompson@users.noreply.github.com> * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * creating fixture to update isvc with annotations and removing use of sleep statements in rout timeout tests Signed-off-by: Brett Thompson <196701379+brettmthompson@users.noreply.github.com> * code rabbit suggestions Signed-off-by: Brett Thompson <196701379+brettmthompson@users.noreply.github.com> * updating fixture and small changes Signed-off-by: Brett Thompson <196701379+brettmthompson@users.noreply.github.com> --------- Signed-off-by: Brett Thompson <196701379+brettmthompson@users.noreply.github.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
…io#358) Signed-off-by: lugi0 <lgiorgi@redhat.com>
* feat: add tests for guardrails builtin detectors * fix: comments * fix: missing fstring * feat: add helper function to check detection field of response * feat: add helper function to check detection field of response * fix: unify negative scenarios, add temperature (0.0) to request, improve logging and input msgs * fix: remove unnecessary admin_client from signature and fix docstring spacing
* fix: redact sensitive strings * fix: improve RedactedString instantiation
…io#320) Test suite for validating Model Registry functionality with a secure MySQL database connection (SSL/TLS). Includes tests for both invalid and valid (smoke) CA certificate scenarios.
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
updates: - [github.com/PyCQA/flake8: 7.2.0 → 7.3.0](PyCQA/flake8@7.2.0...7.3.0) - [github.com/astral-sh/ruff-pre-commit: v0.11.13 → v0.12.0](astral-sh/ruff-pre-commit@v0.11.13...v0.12.0) - [github.com/pre-commit/mirrors-mypy: v1.16.0 → v1.16.1](pre-commit/mirrors-mypy@v1.16.0...v1.16.1) Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
updates! c1618fe
…atahub-io#328) * test: add REST and gRPC test cases for Sklearn framework with MLServer runtime deployment Signed-off-by: Snomaan6846 <syedali@redhat.com> rh-pre-commit.version: 2.3.2 rh-pre-commit.check-secrets: ENABLED * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * test: add REST and gRPC test cases for XGBoost framework with MLServer runtime deployment Signed-off-by: Snomaan6846 <syedali@redhat.com> rh-pre-commit.version: 2.3.2 rh-pre-commit.check-secrets: ENABLED * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * test: add REST and gRPC test cases for LightGBM framework with MLServer runtime deployment Signed-off-by: Snomaan6846 <syedali@redhat.com> rh-pre-commit.version: 2.3.2 rh-pre-commit.check-secrets: ENABLED * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * test: add REST and gRPC test cases for CatBoost framework with MLServer runtime deployment Signed-off-by: Snomaan6846 <syedali@redhat.com> rh-pre-commit.version: 2.3.2 rh-pre-commit.check-secrets: ENABLED * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * test: add REST and gRPC test cases for MLFlow framework with MLServer runtime deployment Signed-off-by: Snomaan6846 <syedali@redhat.com> rh-pre-commit.version: 2.3.2 rh-pre-commit.check-secrets: ENABLED * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * downgrade: Seldon MLServer from 1.7.1 to 1.6.1 due to HuggingFace runtime incompatibility Signed-off-by: Snomaan6846 <syedali@redhat.com> rh-pre-commit.version: 2.3.2 rh-pre-commit.check-secrets: ENABLED * test: add REST and gRPC test cases for HuggingFace framework with MLServer runtime deployment Signed-off-by: Snomaan6846 <syedali@redhat.com> rh-pre-commit.version: 2.3.2 rh-pre-commit.check-secrets: ENABLED * [pre-commit.ci] auto fixes from pre-commit.com hooks for more information, see https://pre-commit.ci * test(mlserver): remove unnecessary sleep before inferencing Signed-off-by: Snomaan6846 <syedali@redhat.com> --------- Signed-off-by: Snomaan6846 <syedali@redhat.com> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
|
The following are automatically added/executed:
Available user actions:
Supported labels{'/lgtm', '/hold', '/build-push-pr-image', '/verified', '/cherry-pick', '/wip'} |
📝 WalkthroughSummary by CodeRabbit
WalkthroughSkip decorators were added to two test classes in separate test files, causing all tests within these classes to be skipped for the 2.21 release. No other logic, parameters, or assertions were modified in either file. Changes
✨ Finishing Touches
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. 🪧 TipsChatThere are 3 ways to chat with CodeRabbit:
SupportNeed help? Create a ticket on our support page for assistance with any issues or questions. Note: Be mindful of the bot's finite context window. It's strongly recommended to break down tasks such as reading entire modules into smaller chunks. For a focused discussion, use review comments to chat about specific files and their changes, instead of using the PR comments. CodeRabbit Commands (Invoked using PR comments)
Other keywords and placeholders
Documentation and Community
|
There was a problem hiding this comment.
Actionable comments posted: 0
🧹 Nitpick comments (2)
tests/model_serving/model_server/kueue/test_kueue_isvc_serverless.py (1)
41-43: Preferskipiftied to the target release instead of a blanketskipA hard-coded
@pytest.mark.skiprisks the test remaining disabled indefinitely.
Guard the skip behind an explicit condition (e.g., env var or semantic-version check) so that the test suite automatically re-enables once the 2.21 line is no longer under test.-import pytest +import os +import pytest ... -@pytest.mark.skip(reason="Skipping test for 2.21 release") +@pytest.mark.skipif( + os.getenv("SERVE_RELEASE") == "2.21", + reason="Temporarily skipped for 2.21 release", +)This also documents exactly when the skip should cease to apply.
(Remove the extra@pytest.mark.serverlessdecorator if the class is already covered by the module-levelpytestmarklist.)tests/model_serving/model_server/kueue/test_kueue_isvc_raw.py (1)
39-41: Make the skip conditional to avoid long-term test rotSame rationale as the serverless test: wrap the skip in a condition keyed to the 2.21 release (or a feature flag) so the test automatically returns once the window passes.
-import pytest +import os +import pytest ... -@pytest.mark.skip(reason="Skipping test for 2.21 release") +@pytest.mark.skipif( + os.getenv("SERVE_RELEASE") == "2.21", + reason="Temporarily skipped for 2.21 release", +)Helps ensure these important admission-control checks don’t quietly vanish from CI forever.
📜 Review details
Configuration used: .coderabbit.yaml
Review profile: CHILL
Plan: Pro
📒 Files selected for processing (2)
tests/model_serving/model_server/kueue/test_kueue_isvc_raw.py(1 hunks)tests/model_serving/model_server/kueue/test_kueue_isvc_serverless.py(1 hunks)
No description provided.