Keeper: restructure OCSF log pipeline routing - #24870
Draft
jbfeldman-dd wants to merge 4 commits into
Draft
Conversation
Add OCSF pre-transformations pipeline and sub-pipelines for classes Entity Management [3004], User Access Management [3005], and File Hosting Activity [6006]. Flip preserveSource to true on the standard remappers so vendor fields survive for OCSF sourcing, and add OCSF facets. Regenerate expected test output. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Re-partition the Keeper OCSF pipeline into a smaller, consistent class set with explicit fallback routing so every event lands in a valid class. - Route genuine alerts (keeper_ai risk/session-lock, BreachWatch) to Detection Finding [2004] with is_alert and risk_level_id; keep detection-rule config changes out of 2004. - Move device-approval and role create/update events to Entity Management [3004]; restrict Group Management [3006] to team events. - Unify sharing and data-access events under Web Resources [6001], populating web_resources[] via an array-processor; keep record CRUD, record-content reads, and file_attachment_* in Datastore Activity [6005]. - Map ssh_agent_* and pam_gateway_* to Application Lifecycle [6002]. - Eliminate the 1006, 2003, 5019, and 6006 sub-pipelines; re-home their events. - Add two-tier fallback: unmapped events with username and remote_address to API Activity [6003], everything else to Base Event [0]. - Add PII-free synthetic samples covering the new families and both fallbacks. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Contributor
Validation ReportAll 21 validations passed. Show details
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Adds an OCSF log pipeline for Keeper that normalizes Keeper enterprise audit events into OCSF 1.5.0 classes. Keeper's
audit_eventfield drives routing, and every event is guaranteed to land in a schema-valid class via a fallback chain.The pipeline consists of an
OCSF pre transformationsstage (product/vendor metadata,event_code, and shared field mappings applied to all events) followed by per-class sub-pipelines, in ascendingclass_uidorder, with two fallbacks last:is_alertandrisk_level_idderived from severity. Detection-rule configuration changes are deliberately excluded.web_resources[]is populated from the relevant uid fields via an array-processor.ssh_agent_*andpam_gateway_*events.file_attachment_*events.usernameandremote_address.The class mappings preserve the customer-derived field coverage from the original Fleak-generated mappings, extended to complete sister-event families (e.g. all
compliance_report_*,ext_share_*,keeper_ai_*variants) so documented events route consistently rather than only the ones present in customer samples.Test coverage: the tests file exercises all 12 classes plus both fallbacks with PII-free samples (reserved-range IPs and anonymized emails). All 24 samples validate against OCSF 1.5.0 at Required 100%.
Motivation
Keeper audit logs previously had no OCSF normalization, so they could not participate in OCSF-based security analytics. This pipeline maps Keeper's audit events to standard OCSF classes with an explicit fallback chain that keeps every event schema-valid.
Review checklist (to be filled by reviewers)
qa/requiredif this PR needs QA validation, orqa/skip-qaif it does not. Exactly one of the two is required.backport/<branch-name>label to the PR and it will automatically open a backport PR once this one is merged