@@ -6,6 +6,20 @@ adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
66
77## [ Unreleased]
88
9+ ### Added
10+
11+ - ** NeMo Relay native plugin** — a dynamically loaded integration that runs
12+ libsy's weighted-random, LLM-classifier, escalation, and stage-router
13+ algorithms in process while Switchyard owns provider HTTP dispatch,
14+ credentials, translation, retries, and fallback. Managed calls require NeMo
15+ Relay 0.7 or newer and do not depend on ` switchyard-server ` .
16+
17+ - ** NeMo Relay routing-model usage marks** — classifier judges, escalation
18+ judges and discarded weak candidates, and failed routing candidates now emit
19+ ` switchyard.routing.llm_call ` ATOF marks with normalized token usage and
20+ latency. The final serving call remains represented only by Relay's outer LLM
21+ lifecycle event to prevent double-counting.
22+
923### Removed
1024
1125- ** Latency-aware router** — the ` latency_service ` route type and its
@@ -31,6 +45,14 @@ adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
3145
3246### Fixed
3347
48+ - ** NeMo Relay stage and escalation integration** — preserved same-protocol
49+ request bodies are now re-encoded after tier prompts or handoff notes mutate
50+ the normalized request; Relay's synthetic ` gateway-gateway ` identity no
51+ longer shares escalation latch state across unrelated raw gateway requests;
52+ stage decision marks now retain picker-default tiers, decision sources, and
53+ hard-override confidence. Target bindings also accept non-secret
54+ ` extra_body ` defaults for provider-specific judge controls.
55+
3456- ** Response ` model ` now names the model that actually served the request** , on
3557 every serving path and wire format. Streamed Anthropic and Responses replies,
3658 and every libsy-served reply, previously echoed the model id the client
0 commit comments