Skip to content

Retrieve NIM_ENDPOINT_API_KEY for Guardrail from k8s secret#365

Merged
shivamerla merged 2 commits intoNVIDIA:mainfrom
shengnuo:guardrail-secret
Mar 26, 2025
Merged

Retrieve NIM_ENDPOINT_API_KEY for Guardrail from k8s secret#365
shivamerla merged 2 commits intoNVIDIA:mainfrom
shengnuo:guardrail-secret

Conversation

@shengnuo
Copy link
Copy Markdown
Collaborator

@shengnuo shengnuo commented Mar 10, 2025

This MR injects the NIM_ENDPOINT_API_KEY environment variable into the NeMo Guardrail container from a Kubernetes Secret.

Before creating the Guardrail service, a Secret with key NIM_ENDPOINT_API_KEY must be created.

.spec.authSecret in NemoGuardrail is now optional, as it's only required when the NIM is NGC hosted.

@copy-pr-bot
Copy link
Copy Markdown

copy-pr-bot Bot commented Mar 10, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Comment thread api/apps/v1alpha1/nemo_guardrails_types.go
Comment thread api/apps/v1alpha1/nemo_guardrails_types.go Outdated
Comment thread api/apps/v1alpha1/nemo_guardrails_types.go Outdated
shivamerla
shivamerla previously approved these changes Mar 25, 2025
Signed-off-by: Sheng Lin <shelin@nvidia.com>
shivamerla
shivamerla previously approved these changes Mar 25, 2025
Signed-off-by: Sheng Lin <shelin@nvidia.com>
@shivamerla shivamerla merged commit ea464ce into NVIDIA:main Mar 26, 2025
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants