-
Notifications
You must be signed in to change notification settings - Fork 596
Open
Labels
Area: InferenceActivities related to Gateway API Inference Extension support.Activities related to Gateway API Inference Extension support.Good First IssueGood issue for newbiesGood issue for newbiesPriority: HighRequired in next 3 months to make progress, bugs that affect multiple users, or very bad UXRequired in next 3 months to make progress, bugs that affect multiple users, or very bad UXhelp wantedDenotes an issue that needs help from a contributor.Denotes an issue that needs help from a contributor.
Description
Currently, the InferencePool status code lives in the legacy GIE plugin, e.g. internal/kgateway/extensions2/plugins/inferenceextension/endpointpicker. This code should be moved to the agentgateway inference-extension plugin, e.g. internal/kgateway/agentgatewaysyncer/backend/inference-extension.go.
As part of this effort, the legacy GIE e2e tests should be migrated to the agentgateway e2e tests, e.g. test/kubernetes/e2e/features/inferenceextension/suite.go -> test/kubernetes/e2e/features/agentgateway/inference-extension/suite.go
Metadata
Metadata
Assignees
Labels
Area: InferenceActivities related to Gateway API Inference Extension support.Activities related to Gateway API Inference Extension support.Good First IssueGood issue for newbiesGood issue for newbiesPriority: HighRequired in next 3 months to make progress, bugs that affect multiple users, or very bad UXRequired in next 3 months to make progress, bugs that affect multiple users, or very bad UXhelp wantedDenotes an issue that needs help from a contributor.Denotes an issue that needs help from a contributor.