InferenceObjective / Priorities

[kfox1111]

Description:
Looking into the current status/plans around implementing priorities. There is an api defined for it:

https://gateway-api-inference-extension.sigs.k8s.io/reference/x-spec/#inferenceobjective

Is there any support already / are there plans to do so soon?

[mathetake]

Will it be supposed to be consumed by the controller/control plane? it sounds like it is the endpoint picker that consumes so there's nothing we should do here?

cc @Xunzhuo

[mathetake]

yeah I think it's already supported by the reference endpoint picker implementation, so the only thing is to add support for v1 CRD so this is a duplicate of #1032 #1033

[Xunzhuo]

Yes @mathetake it is not related to a GW Implementation, we just care about inferencePool