@@ -165,18 +165,16 @@ Red Hat AI Inference Server on managed Kubernetes consists of the following comp
165165
166166### Component Interaction
167167
168- ``` text
169- ┌─────────────────────────────────────┐
170- │ Kubernetes Cluster │
171- ┌──────────┐ ┌──────────────┐ │ ┌─────────┐ ┌────────────────┐ │
172- │ Client │───▶│ Gateway │───▶│ │ EPP │───▶│ vLLM Pods │ │
173- │ │ │ (Istio) │ │ │Scheduler│ │ (Model) │ │
174- └──────────┘ └──────────────┘ │ └─────────┘ └────────────────┘ │
175- │ ▲ ▲ │
176- │ │ mTLS │ │
177- │ └───────────────┘ │
178- │ cert-manager │
179- └─────────────────────────────────────┘
168+ ``` mermaid
169+ graph LR
170+ Client --> Gateway["Gateway<br/>(Istio)"]
171+
172+ subgraph Kubernetes Cluster
173+ Gateway --> EPP["EPP<br/>Scheduler"]
174+ EPP --> vLLM["vLLM Pods<br/>(Model)"]
175+ cm["cert-manager"] -. mTLS .-> EPP
176+ cm["cert-manager"] -. mTLS .-> vLLM
177+ end
180178```
181179
182180---
@@ -606,7 +604,8 @@ make deploy-kserve
606604For assistance with Red Hat AI Inference Server deployments, contact Red Hat Support or consult the product documentation.
607605
608606** Additional Resources:**
609- - [ KServe Chart README] ( https://github.com/opendatahub-io/rhaii-on-xks/blob/main/charts/kserve/README.md ) - KServe Helm chart details, PKI prerequisites, and OCI registry install
610- - [ Preflight Validation] ( https://github.com/opendatahub-io/rhaii-on-xks/blob/main/validation/README.md ) - Cluster readiness and post-deployment validation checks
611- - [ Monitoring Setup Guide] ( ../monitoring-stack/ ) - Optional Prometheus/Grafana configuration for dashboards and autoscaling
612- - [ KServe LLMInferenceService Samples] ( https://github.com/red-hat-data-services/kserve/tree/rhoai-3.4/docs/samples/llmisvc )
607+
608+ * [ KServe Chart README] ( https://github.com/opendatahub-io/rhaii-on-xks/blob/main/charts/kserve/README.md ) - KServe Helm chart details, PKI prerequisites, and OCI registry install
609+ * [ Preflight Validation] ( https://github.com/opendatahub-io/rhaii-on-xks/blob/main/validation/README.md ) - Cluster readiness and post-deployment validation checks
610+ * [ Monitoring Setup Guide] ( ../monitoring-stack/ ) - Optional Prometheus/Grafana configuration for dashboards and autoscaling
611+ * [ KServe LLMInferenceService Samples] ( https://github.com/red-hat-data-services/kserve/tree/rhoai-3.4/docs/samples/llmisvc )
0 commit comments