Skip to content

Commit e74aaa4

Browse files
authored
Remove legacy Envoy AI plugin code (#12705)
Signed-off-by: John Howard <[email protected]> Signed-off-by: timflannagan <[email protected]>
1 parent a7acc11 commit e74aaa4

File tree

16 files changed

+50
-1951
lines changed

16 files changed

+50
-1951
lines changed

devel/debugging/quick-start-ai-gateway-locally.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -74,6 +74,7 @@ EOF
7474

7575
```yaml
7676
kubectl apply -f- <<EOF
77+
# TODO: Update this to use the agw based Backend API.
7778
apiVersion: gateway.kgateway.dev/v1alpha1
7879
kind: Backend
7980
metadata:

examples/ai-backend-with-routes.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -9,6 +9,7 @@ spec:
99
port: 8080
1010
protocol: HTTP
1111
---
12+
# TODO: Update this to use the agw based Backend API.
1213
apiVersion: gateway.kgateway.dev/v1alpha1
1314
kind: Backend
1415
metadata:

internal/kgateway/agentgatewaysyncer/README.md

Lines changed: 8 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -351,7 +351,7 @@ flowchart TD
351351
style E4 fill:#f1f8e9
352352
```
353353

354-
### Translator tests
354+
### Translator tests
355355

356356
The translator tests are unit tests that test the translation of the CRD input YAML resources to the agentgateway xDS API.
357357

@@ -692,6 +692,7 @@ kubectl create secret generic openai-secret \
692692
```
693693

694694
Apply the following config to set up the HTTPRoute pointing to the AI Backend:
695+
695696
```shell
696697
kubectl apply -f- <<EOF
697698
kind: Gateway
@@ -728,6 +729,7 @@ spec:
728729
group: gateway.kgateway.dev
729730
kind: Backend
730731
---
732+
# TODO: Update this to use the agw based Backend API.
731733
apiVersion: gateway.kgateway.dev/v1alpha1
732734
kind: Backend
733735
metadata:
@@ -794,6 +796,7 @@ spec:
794796
kind: Backend
795797
name: bedrock
796798
---
799+
# TODO: Update this to use the agw based Backend API.
797800
apiVersion: gateway.kgateway.dev/v1alpha1
798801
kind: Backend
799802
metadata:
@@ -883,6 +886,7 @@ spec:
883886
group: gateway.kgateway.dev
884887
kind: Backend
885888
---
889+
# TODO: Update this to use the agw based Backend API.
886890
apiVersion: gateway.kgateway.dev/v1alpha1
887891
kind: Backend
888892
metadata:
@@ -1248,7 +1252,7 @@ config:
12481252
gen_ai.response.model: "llm.response_model"
12491253
gen_ai.usage.completion_tokens: "llm.output_tokens"
12501254
gen_ai.usage.prompt_tokens: "llm.input_tokens"
1251-
1255+
12521256
# Custom business logic fields
12531257
user.id: "request.headers['x-user-id']"
12541258
request.path: "request.path"
@@ -1431,6 +1435,7 @@ spec:
14311435
name: http
14321436
---
14331437
# AI Backend and Route
1438+
# TODO: Update this to use the agw based Backend API.
14341439
apiVersion: gateway.kgateway.dev/v1alpha1
14351440
kind: Backend
14361441
metadata:
@@ -1566,7 +1571,7 @@ spec:
15661571
cors:
15671572
allowOrigins:
15681573
- "http://localhost:3000"
1569-
- "http://localhost:8080"
1574+
- "http://localhost:8080"
15701575
- "http://localhost:15000"
15711576
- "http://127.0.0.1:3000"
15721577
- "http://127.0.0.1:8080"

internal/kgateway/extensions2/plugins/backend/ai/ai_backend.go

Lines changed: 0 additions & 290 deletions
This file was deleted.

0 commit comments

Comments
 (0)