Add artifacts for the weekly drift report and bug triage automations - #922
Open
devin-ai-integration[bot] wants to merge 3 commits into
Open
devin-ai-integration[bot] wants to merge 3 commits into
devin-ai-integration[bot] wants to merge 3 commits into
Conversation
Contributor
Author
🤖 Devin AI EngineerI'll be helping with this pull request! Here's what you should know: ✅ I will automatically:
Note: I can only respond to comments from users who have write access to this repository. ⚙️ Control Options:
|
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.



Summary
This repo is the hub for two always-on Devin Automations: it holds the shared output contract, both designs, and the exact prompts each automation runs. Sibling PRs add the matching scanners to
petclinic-microservicesandtimesheet-infra.Why a schema first: the weekly report has to be one report over npm, Maven and Terraform, and its remediation queue is the input to a Track 2 fan-out. So each repo carries its own read-only scanner emitting the same document (
docs/automations/remediation-queue.schema.json), and the report is a merge-and-sort over those documents instead of hand-assembled prose. Every scanner validates against the schema (checked withjsonschemaagainst real output from all three repos).scripts/drift_scan.pyhere scansbackend/andfrontend/:Ranking and sizing live in the scanners, not in the prompt, so the queue is reproducible and week-over-week comparable rather than a fresh judgment call each Monday. Current run: 64 items, 0 scan errors; a non-empty
errorsarray makes the report partial — an unreachable registry is never published as "no findings".Docs state trigger / guardrails / human checkpoint for each automation:
docs/automations/weekly-drift-report.md— schedule Mondays 06:00 UTC, read-only, no autonomous remediation, queue is a proposal a maintainer picks from before any fan-out starts.docs/automations/bug-triage.md— GitHub issue labeledbug, reproduce before assigning severity, and an explicit definition of "trivial" (one file, ~<10 lines, no schema/API/auth change, existing tests pass). Anything else stops at "here's the fix I propose — confirm and I'll do it"; uncertainty counts as non-trivial.docs/automations/prompts/holds the verbatim prompt text of each automation so a prompt change is reviewable in a PR instead of only living in the Automations UI.No production code, dependency or CI changes.
Link to Devin session: https://partner-workshops.devinenterprise.com/sessions/1cf3e3c3095942f2acedc39b9996c14f
Requested by: @sumitshatwara