feat: enhance conformance evidence with gateway conditions, webhook test, and HPA scale-down#205
Merged
yuanchen8911 merged 2 commits intoNVIDIA:mainfrom Feb 25, 2026
Conversation
dims
previously approved these changes
Feb 24, 2026
ce0704e to
4d0af90
Compare
ba9755a to
1b7c997
Compare
…and HPA scale-down tests Enhance the evidence collection script and regenerate all evidence with additional checks inspired by the Go-based conformance validator: Script enhancements: - Gateway: verify GatewayClass Accepted and Gateway Programmed conditions (not just existence) - Robust operator: add webhook rejection test (submit invalid CR, verify webhook denies it) - HPA: add scale-down verification after scale-up (replace GPU workload with idle container, verify HPA scales back to minReplicas) - HPA: fix pod Error status during scale-down by deleting deployment cleanly before creating idle replacement - Fix capture function to strip absolute paths from command display - Fix namespace deletion race with kubectl wait --for=delete - Tighten HPA verdict to require actual scaling for PASS - Add early exit for unhealthy pods in HPA wait loop - Remove readOnlyRootFilesystem from DRA test manifests (blocks CDI device injection) - Replace gpu-burn references with CUDA N-Body Simulation - Sanitize AMI ID in cluster-autoscaling evidence Evidence regenerated: - All 8 conformance requirements: PASS - No leaked local paths or sensitive information - Consistent format across all evidence documents Signed-off-by: Yuan Chen <yuanchen97@gmail.com>
1b7c997 to
dfe36cc
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Enhance the evidence collection script and regenerate all evidence with additional checks, manifest embedding, and documentation updates.
Motivation / Context
Review of the Go-based conformance validator (PR #185/#187) identified additional checks that strengthen our evidence. This PR ports those improvements to the evidence collection script and regenerates all evidence.
Fixes: N/A
Related: #192
Type of Change
Component(s) Affected
docs/,examples/)Implementation Notes
Script enhancements (
collect-evidence.sh):GatewayClass.Accepted=TrueandGateway.Programmed=True, not just resource existenceDynamoGraphDeployment(empty spec), verify webhook denies itErrorstatus during scale-down by deleting deployment before replacingcapturefunction stripsREPO_ROOTfrom command displaykubectl wait --for=deleteinstead ofsleep 5readOnlyRootFilesystem(blocks CDI device injection)gpu-burnreferences withCUDA N-Body SimulationEvidence regenerated (all 8 PASS):
index.mdTesting
Full evidence collection run on
ktsetfavuaEKS cluster. All 8 sections completed successfully.Risk Assessment
Checklist
git commit -S)