Skip to content

Conversation

@nagkumar91
Copy link

@nagkumar91 nagkumar91 commented Dec 22, 2025

Motivation

GenAI semantic conventions cover model, agent, and tool operations, but they don’t provide a vendor-neutral way to observe security guardian/
guardrail evaluations (allow/deny/modify decisions) and the specific security findings produced during those evaluations. This limits
auditability, incident investigation, and cross-provider correlation for systems using guardrails across different vendors and frameworks.

What this PR adds

  • Adds apply_guardrail to the gen_ai.operation.name enum for guardrail/guardian evaluations.
  • Adds new attributes under gen_ai.guardian.* and gen_ai.security.* to describe:
    • Guardian identity (gen_ai.guardian.*)
    • Decision outcomes (gen_ai.security.decision.*)
    • Target being evaluated (gen_ai.security.target.*)
    • Findings and policy context (gen_ai.security.risk.*, gen_ai.security.policy.*)
    • Opt-in content capture (gen_ai.security.content.*)
  • Note: gen_ai.security.risk.category is a free-form string with suggested values aligned with OWASP LLM Top 10 2025.
  • Adds a new span: span.gen_ai.apply_guardrail.internal (guardian evaluation).
  • Adds a new event: gen_ai.security.finding (individual findings under a guardian evaluation).
  • Adds documentation: docs/gen-ai/gen-ai-security.md (linked from docs/gen-ai/README.md).

References

Prototypes / instrumentation links

Tests

  • make table-generation registry-generation
  • make markdown-toc
  • make SED=sed check-policies (macOS note: the repo defaults to gsed)

Changelog

This is user-facing (new conventions). Add a .chloggen/*.yaml entry with component: gen-ai, or apply the “Skip Changelog” label if
maintainers agree it’s not required for this proposal stage.

@github-actions github-actions bot added enhancement New feature or request area:gen-ai labels Dec 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:gen-ai enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant