Skip to content

Commit 4035835

Browse files
committed
docs(epp): make ConditionalDecodeDecider doc self-contained
Signed-off-by: Dmitri Pikus <DPIKUS@il.ibm.com>
1 parent 8f5e2e6 commit 4035835

1 file changed

Lines changed: 3 additions & 4 deletions

File tree

  • pkg/epp/framework/interface/requestcontrol

pkg/epp/framework/interface/requestcontrol/plugins.go

Lines changed: 3 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -99,10 +99,9 @@ type PreAdmitter interface {
9999
PreAdmit(ctx context.Context, request *fwksched.InferenceRequest) error
100100
}
101101

102-
// ConditionalDecodeDecider answers the RFC 7240 "Prefer: if-available" gate:
103-
// given the chosen decode endpoint, should the request be rejected with HTTP
104-
// 412 (because the local KV cache does not cover enough of the prompt) or
105-
// forwarded? At most one such plugin is consulted per director.
102+
// ConditionalDecodeDecider decides whether a request carrying the
103+
// RFC 7240 "Prefer: if-available" header should be rejected with HTTP 412
104+
// Precondition Failed or forwarded to the chosen decode endpoint.
106105
type ConditionalDecodeDecider interface {
107106
plugin.Plugin
108107
ShouldRejectConditionalDecode(ctx context.Context, request *fwksched.InferenceRequest, endpoint fwksched.Endpoint) bool

0 commit comments

Comments
 (0)