Add KServe inference test suite for Neuron

[ybrodsky-rh]

Summary

• Add new Ginkgo test suite under tests/hw-accel/neuron/kserve/ for validating KServe InferenceService deployment and inference on AWS Neuron hardware
• Two test cases: kserve-001 (deploy InferenceService, wait for Ready) and kserve-002 (send inference request, validate response)
• Add KServe inference helper (internal/do/kserve.go) using curl pod approach with retry for Neuron model compilation delays
• Extend NeuronConfig with KServe-specific env vars (model name, namespace, vLLM image, tensor parallel size)

Dependencies

• Requires eco-goinfra KServe builders: Add KServe InferenceService and ServingRuntime builders eco-goinfra#1337

Test plan

• Verify go build ./tests/hw-accel/neuron/kserve/... compiles (after eco-goinfra dependency is updated)
• Run with label filter neuron && kserve on ROSA HCP cluster with RHOAI/KServe stack installed
• Verify existing neuron && vllm and neuron && metrics tests are unaffected

🤖 Generated with Claude Code

[coderabbitai]

Warning

Rate limit exceeded

@ybrodsky-rh has exceeded the limit for the number of commits that can be reviewed per hour. Please wait 41 minutes and 40 seconds before requesting another review.

To keep reviews running without waiting, you can enable usage-based add-on for your organization. This allows additional reviews beyond the hourly cap. Account admins can enable it under billing.

⌛ How to resolve this issue?

After the wait time has elapsed, a review can be triggered using the @coderabbitai review command as a PR comment. Alternatively, push new commits to this PR.

We recommend that you space out your commits to avoid hitting the rate limit.

🚦 How do rate limits work?

CodeRabbit enforces hourly rate limits for each developer per organization.

Our paid plans have higher rate limits than the trial, open-source and free plans. In all cases, we re-allow further reviews after a brief timeout.

Please see our FAQ for further information.

ℹ️ Review info

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: ddcc3b03-2b77-46ad-a5cd-bde678f4c2e4

📥 Commits

Reviewing files that changed from the base of the PR and between df020c0 and 84ea8a2.

⛔ Files ignored due to path filters (10)

• go.sum is excluded by !**/*.sum
• vendor/github.com/rh-ecosystem-edge/eco-goinfra/pkg/kserve/inferenceservice.go is excluded by !vendor/**
• vendor/github.com/rh-ecosystem-edge/eco-goinfra/pkg/kserve/servingruntime.go is excluded by !vendor/**
• vendor/github.com/rh-ecosystem-edge/eco-goinfra/pkg/schemes/kserve/v1alpha1/groupversion_info.go is excluded by !vendor/**
• vendor/github.com/rh-ecosystem-edge/eco-goinfra/pkg/schemes/kserve/v1alpha1/servingruntime_types.go is excluded by !vendor/**
• vendor/github.com/rh-ecosystem-edge/eco-goinfra/pkg/schemes/kserve/v1alpha1/zz_generated.deepcopy.go is excluded by !vendor/**
• vendor/github.com/rh-ecosystem-edge/eco-goinfra/pkg/schemes/kserve/v1beta1/groupversion_info.go is excluded by !vendor/**
• vendor/github.com/rh-ecosystem-edge/eco-goinfra/pkg/schemes/kserve/v1beta1/inferenceservice_types.go is excluded by !vendor/**
• vendor/github.com/rh-ecosystem-edge/eco-goinfra/pkg/schemes/kserve/v1beta1/zz_generated.deepcopy.go is excluded by !vendor/**
• vendor/modules.txt is excluded by !vendor/**

📒 Files selected for processing (6)

• go.mod
• tests/hw-accel/neuron/internal/do/kserve.go
• tests/hw-accel/neuron/internal/neuronconfig/config.go
• tests/hw-accel/neuron/kserve/internal/tsparams/consts.go
• tests/hw-accel/neuron/kserve/kserve_suite_test.go
• tests/hw-accel/neuron/kserve/tests/kserve-inference-test.go

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Review rate limit: 0/1 reviews remaining, refill in 41 minutes and 40 seconds.}

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[ybrodsky-rh]

Blocked on dependency: This PR imports github.com/rh-ecosystem-edge/eco-goinfra/pkg/kserve which is introduced in rh-ecosystem-edge/eco-goinfra#1337. CI will fail until that PR is merged and this PR is rebased to pick up the new package.

Merge order:

1. Add KServe InferenceService and ServingRuntime builders eco-goinfra#1337 (KServe builders)
2. This PR (rebase after ibu mgmt: add proxy test to upgrade suite #1 merges)
3. Add KServe inference E2E workflow for AWS Neuron openshift/release#78561 (Prow steps)

[ybrodsky-rh]

/retest