Skip to content

Warn at startup when the video content safety classifier is disabled - #171

Merged
lfengad merged 4 commits into
NVIDIA:mainfrom
stewtong:guardrail-disabled-warning
Aug 12, 2026
Merged

Warn at startup when the video content safety classifier is disabled#171
lfengad merged 4 commits into
NVIDIA:mainfrom
stewtong:guardrail-disabled-warning

Conversation

@stewtong

@stewtong stewtong commented Aug 9, 2026

Copy link
Copy Markdown
Contributor

Implements option 1 from #170, as invited there.

create_video_guardrail_runner currently builds a runner whose safety_models list is empty (the VideoContentSafetyFilter entry is commented out pending false-positive fixes), so a user who enables guardrails gets text checks and face blur but no video content screening, with nothing in the logs distinguishing "checked and safe" from "not checked" until the generic per-request line, which reads as a safe verdict.

This adds a single startup warning at runner construction when the video safety-model list is empty:

Video content safety classifier is disabled in this release; effective guardrail coverage is text checks and face blur only.

The warning is guarded on the list being empty, so restoring VideoContentSafetyFilter silences it automatically with no further change. No behavior changes otherwise; the per-request logic in core.py is untouched.

Implements option 1 from NVIDIA#170. create_video_guardrail_runner builds a
runner whose safety_models list is empty (VideoContentSafetyFilter is
commented out pending false-positive fixes), so enabling guardrails
gives text checks and face blur with nothing in the logs distinguishing
"checked and safe" from "not checked". This adds a single warning at
runner construction naming the effective coverage. The warning is
guarded on the list being empty, so restoring VideoContentSafetyFilter
silences it automatically.

Signed-off-by: Stew Tong <stewarttong@gmail.com>
@lfengad
lfengad enabled auto-merge (squash) August 12, 2026 06:06
@lfengad
lfengad merged commit 43eb9ea into NVIDIA:main Aug 12, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants