feat(ci): collect AI conformance evidence in H100 smoke test#147
Merged
mchmarny merged 5 commits intoNVIDIA:mainfrom Feb 19, 2026
Merged
feat(ci): collect AI conformance evidence in H100 smoke test#147mchmarny merged 5 commits intoNVIDIA:mainfrom
mchmarny merged 5 commits intoNVIDIA:mainfrom
Conversation
dims
force-pushed
the
ci/add-conformance-evidence-collection
branch
from
25c46b0 to
4efaf7c
Compare
Run the ai-conformance checker after inference validation to verify that all expected Kubernetes resources exist in the Kind cluster, providing a structured PASS/FAIL evidence summary in CI logs. Signed-off-by: Davanum Srinivas <dsrinivas@nvidia.com>
Report container images for Deployments/DaemonSets/StatefulSets, app.kubernetes.io/version or helm.sh/chart labels for Namespaces, and served API versions for CRDs alongside the PASS/FAIL output. Signed-off-by: Davanum Srinivas <dsrinivas@nvidia.com>
Change --dir from a single-value to a repeatable flag so the tool can scan both kind/ (reduced, kind-specific asserts) and cluster/ (shared component asserts like cert-manager, monitoring, dynamo). Duplicates are deduplicated by apiVersion/kind/namespace/name, with earlier directories taking priority. Signed-off-by: Davanum Srinivas <dsrinivas@nvidia.com>
… checks The cluster/ directory includes resources not present in Kind (driver daemonset, MIG manager, standalone DCGM, container toolkit daemonset). Instead of scanning the full cluster/ directory, explicitly include only the 8 shared assert files that the chainsaw kind test references. Adds --file flag for specifying individual assert YAML files alongside --dir for directory scanning. Signed-off-by: Davanum Srinivas <dsrinivas@nvidia.com>
dims
force-pushed
the
ci/add-conformance-evidence-collection
branch
from
1df0d8e to
7184b2e
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
tests/chainsaw/ai-conformance/main.goafter inference validationkind/assert-*.yaml) exist in the cluster and prints a structured PASS/FAIL summaryif: always()so evidence is collected even when earlier steps failTest plan