Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
26 changes: 1 addition & 25 deletions deployment/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,30 +14,6 @@ This guide provides instructions for deploying the MaaS Platform infrastructure
- KServe components are expected to be provided by ODH/RHOAI, not installed separately
- For non-ODH/RHOAI deployments, KServe can be optionally installed from `deployment/components/kserve`

## Deployment Structure

```
deployment/
├── base/ # Core infrastructure components
│ ├── maas-api/ # MaaS API deployment
│ ├── networking/ # Gateway API and Kuadrant
│ ├── policies/ # Gateway-level authentication and rate limiting policies
│ └── token-rate-limiting/ # Token-based rate limiting configuration
├── components/ # Optional components
│ ├── kserve/ # KServe config (only if not using ODH/RHOAI)
│ └── observability/ # Monitoring and observability
├── overlays/ # Platform-specific configurations
│ ├── openshift/ # OpenShift deployment
│ └── kubernetes/ # Standard Kubernetes deployment (experimental)
├── samples/ # Example model deployments
│ └── models/
│ ├── rbac/ # Shared RBAC for LLMInferenceService
│ ├── simulator/ # CPU-based test model (llm-d-inference-sim)
│ ├── facebook-opt-125m-cpu/ # CPU-based OPT-125M model
│ └── qwen3/ # GPU-based Qwen3 model
└── scripts/ # Installation utilities
```

## Quick Start

### Automated OpenShift Deployment (Recommended)
Expand Down Expand Up @@ -442,4 +418,4 @@ After deploying the infrastructure:

1. **Start the development environment**: See the main [README](../README.md) for frontend/backend setup
2. **Deploy additional models**: Check [samples/models](samples/models/) for more examples
3. **Configure monitoring**: Enable observability components in overlays
3. **Configure monitoring**: Enable observability components in overlays