Skip to content

Add silentdrop-llm to Observability (runtime guard for silent LLM-response failures)#551

Open
sravan27 wants to merge 1 commit into
tensorchord:mainfrom
sravan27:add-silentdrop-llm
Open

Add silentdrop-llm to Observability (runtime guard for silent LLM-response failures)#551
sravan27 wants to merge 1 commit into
tensorchord:mainfrom
sravan27:add-silentdrop-llm

Conversation

@sravan27

@sravan27 sravan27 commented Jun 5, 2026

Copy link
Copy Markdown

Adds silentdrop-llm under Observability. It catches the silent failure modes of LLM/agent responses — missing required fields, enum drift (e.g. "in-progress" when the schema says "in_progress"), hallucinated IDs that reference nothing in the lookup context, and claim/list mismatches — none of which throw, all of which silently produce wrong downstream data.

Fits next to QWED, EvalView, Giskard, and Fiddler in that section — same lane (runtime validation of LLM outputs) with a different focus: zero-dep, drop-in between the model call and any side-effecting use of the response.

Happy to adjust the section / wording if you'd prefer a different placement.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant