Skip to content

Add a scheduled fixture-freshness audit comparing state against last-reviewed timestamps #47

Description

@knytcomics-ui

Problem

Ground-truth labels can go stale — a "suspicious" pattern documented today might, per further investigation, turn out to have an innocent explanation, or new information might upgrade a label's confidence. Nothing currently tracks when a fixture was last reviewed, so there's no way to know which entries are due for a re-look versus which were added yesterday.

Requirements

  • Add an optional last_reviewed (ISO 8601 date) field to each destination (coordinate with the schema-formalization issue).
  • Add a scheduled GitHub Actions workflow (e.g. monthly, via on: schedule) that scans destinations.json for entries with no last_reviewed date or one older than a configurable threshold (propose 180 days), and opens (or updates) a single tracking issue listing which destinations are due for review — rather than spamming one issue per stale fixture.
  • Ensure the workflow is idempotent (updates the existing tracking issue's body rather than opening duplicates on repeated runs).

Acceptance Criteria

  • Workflow runs on schedule and correctly identifies stale/missing-date entries against a test fixture set with deliberately old dates.
  • Only one tracking issue is ever open at a time for this purpose, kept up to date.

Part of the Gryd-lock organization. This repo supplies the labelled testnet fixtures and stub scores consumed by grydlock-oracle-adapter's StubOracle and evaluated end-to-end by grydlock-research.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    GrantFox OSSIssue tracked in GrantFox OSSMaybe RewardedIssue may be eligible for a GrantFox rewardOfficial Campaign | FWC26Campaign: Official Campaign | FWC26advancedRequires deep domain knowledge or cross-repo contextarea: ciCI/CD and repository hygienearea: cross-repoContracts with sibling Gryd-lock reposenhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions