Skip to content

Commit aff02b9

Browse files
authored
docs: Adding the Gateway inference support documentation for Nginx Ga… (llm-d#1789)
* docs: Adding the Gateway inference support documentation for Nginx Gateway Fabric * docs: Addressing comments * docs: Addressed new set of comments * docs: Fixed the helm command * docs: Fixed cleaned up command * docs: Fixed cleaned up command * docs: Adding released version * docs: Fixing the YAML files for test failure * docs: Fixing the HTTP YAML file for test failure * docs: Addressing the review comments
1 parent 3e9a9a5 commit aff02b9

2 files changed

Lines changed: 28 additions & 0 deletions

File tree

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,10 @@
1+
apiVersion: gateway.networking.k8s.io/v1
2+
kind: Gateway
3+
metadata:
4+
name: inference-gateway
5+
spec:
6+
gatewayClassName: nginx
7+
listeners:
8+
- name: http
9+
port: 80
10+
protocol: HTTP
Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
apiVersion: gateway.networking.k8s.io/v1
2+
kind: HTTPRoute
3+
metadata:
4+
name: llm-route
5+
namespace: default
6+
spec:
7+
parentRefs:
8+
- name: inference-gateway
9+
rules:
10+
- matches:
11+
- path:
12+
type: PathPrefix
13+
value: /
14+
backendRefs:
15+
- group: inference.networking.k8s.io
16+
kind: InferencePool
17+
name: vllm-llama3-8b-instruct
18+

0 commit comments

Comments
 (0)