2026-05-13 llm-d#959 Add probabilistic-admitter plugin for binary-tier probabilistic load shedding of low-priority inference requests under cluster saturation.
2026-05-13 llm-d#890 Adds new configuration option for the tokens-producer plugin. Existing configurations are unaffected.
2026-05-07 llm-d#931 active-request-scorer now uses inflight-load-producer for in-flight request tracking; requestTimeout is deprecated and ignored, and idleThreshold/maxBusyScore configure idle/busy endpoint scoring.
2026-05-05 llm-d#899 Add datalayer_poll_errors_total and datalayer_extract_errors_total Prometheus counters; remove transition-only error logging.
2026-05-05 llm-d#972 The use of inference.networking.x-k8s.io/v1alpha1/EndpointPickerConfig is deprecated. Please use llm-d.ai/v1alpha1/EndpointPickerConfig instead
2026-05-05 llm-d#863 Deprecating plugin name tokenizer - added token-producer.
2026-05-03 llm-d#941 New configuration parameter in Data section - InjectDefaults controls automatic injection of the default metrics source and extractor. Defaults to true when omitted. Set to false to disable all default source injection.
2026-04-30 llm-d#922 The following Kubernetes label/annotation keys have been migrated from the GAIE prefix to llm-d.ai: - Pod annotation: inference.networking.k8s.io/active-ports is now llm-d.ai/active-ports - Pod label: inference.networking.k8s.io/engine-type is now llm-d.ai/engine-type Both legacy GAIE keys are still checked as fallbacks during the transition period but are deprecated and will be removed in a future release.