Skip to content

Self-audit failure — 2026-09-14 #1575

Description

@github-actions

The grounded self-audit found a real data-health regression on the live API.

Self-audit → https://stellarlight.xyz

── Liveness + shape ──
  ✓ /api/projects/search?q=stellar&limit=5 → 5 projects
  ✓ /api/repos/search?q=soroban&limit=5 → 5 repos
  ✓ /api/research?q=soroban&limit=3 → 3 results
  ✓ /api/partners?all=1&limit=100 → 47 partners
  ✓ /api/builders?limit=20 → 20 builders
  ✓ /api/rfps → 17 rfps
  ✓ /api/clusters?dimension=types → 25 clusters
  ✓ /api/hackathons → 26 hackathons
  ✓ /api/skills → 43 skills
  ✓ /api/leaderboard → 3 keys

── Freshness ──
  ✓ projects fresh (0.0d)
  ✓ builders fresh (0.2d)
  ✓ repos fresh (0.0d)
  ✓ audits fresh (0.3d)
  ✓ researchDocs fresh (0.3d)
  ✓ partners fresh (9.1d)
  ✓ ecosystemStats fresh (1.0d)

── Served-count sanity (curated 0 ≠ broken) ──
  ✓ hackathons served 26 (curated 6, live fallback OK)

── Ground truth ──
  ✓ partners: halborn present under type=audit-firm
  ✓ partners: certora present under type=audit-firm
  ✓ partners: ottersec present under type=audit-firm
  ✓ projects: 'blend' resolves for q=blend
  ✓ band award facts match the official record (SCF #16, $60K)
  ✓ stellarterm typed DEX, not Wallet (sls-033 fixture)
  ✓ type=Wallet enumeration has no duplicate-name rows (sls-033)
  ✓ asset row 'pyusd' resolves as its own Asset record (sls-034)
  ✓ asset row 'eurau' resolves as its own Asset record (sls-034)
  ✓ asset row 'mgusd' resolves as its own Asset record (sls-034)
  ✓ asset row 'ylds' resolves as its own Asset record (sls-034)
  ✓ asset row 'usdy' resolves as its own Asset record (sls-034)
  ✓ rfps rows discriminated (2 rfp + 1 scf-round)
  ✓ rfps counts consistent (open=briefs, returned=rows)
  ✓ clusters⇄analyze category sizes/funded counts agree
  ✓ stellar-core served as NOT a deployable contract
  ✓ zero-knowledge top-1 is Stellar-evidenced (or none available)
  ✓ curated fields reach production: 346 curated record(s) match their registry rows (49 unresolvable, not asserted)
  ✓ bridge corridors: 19 Bridge-typed rows all carry supportedNetworks
  ✓ rfps open round: phase='Submission' ⇔ 1 open round row(s)
  ✗ partners wallet visibility
      type=wallet returned 0 (< 3) with 0 filtered out — quality bar re-hiding marquee partners
  ✗ partners protocol visibility
      type=protocol returned 0 (< 3) with 0 filtered out — quality bar re-hiding marquee partners

── Known-item recall (category/corridor misses) ──
  ✗ recall miss: 'etherfuse'
      absent from top-20 of "Mexico on-ramp fiat MXN peso deposit anchor" (sls-018: coverage serves Mexico/MXN; prose is about Stablebonds). 0 returned, matchMode=majority
  ✓ recall: 'sushi' surfaces for "AMM perpetuals trading multichain exchange"
  ✗ recall miss: 'soroswap'
      absent from top-20 of "AMM decentralized exchange Soroban" (flagship Soroban AMM — control that must never regress). 0 returned, matchMode=majority
  ✓ recall: 'vesseo' surfaces for "vibrant wallet"

── counts.total is limit-invariant ──
  ✗ counts.total varies with limit ("evm")
      limit=10→0, limit=50→0, limit=100→90 — a count that moves with page size is not a count
  ✓ counts.total equals the served set for "evm"
  ✓ counts.total stable for "anchor" (0 at every limit)
  ✓ counts.total stable for "wallet" (183 at every limit)

── Semantic-fallback honesty ──
  ✓ semantic matchMode honest for "fonbank" (0/1 semantic, matchMode=strict)
  ✓ semantic matchMode honest for "charge autonomous AI agents per api call" (0/10 semantic, matchMode=loose-1)

── Advertised versions exist on npm ──
  ✓ npm: @stellar-light/api-client@1.9.0 installable
  ✓ npm: @stellar-light/scout-mcp@1.2.0 installable
  ✓ npm: @stellar-light/api-client@1.5.1 installable
  ✓ npm: @stellar-light/api-client@1.5.0 installable
  ✓ npm: @stellar-light/scout-mcp@1.1.8 installable
  ✓ npm: @stellar-light/api-client@1.4.0 installable
  ✓ npm: @stellar-light/scout-mcp@1.1.5 installable
  ✓ npm: @stellar-light/scout-mcp@1.1.4 installable
  ✓ npm: @stellar-light/scout-mcp@1.1.3 installable
  ✓ npm: @stellar-light/scout-mcp@1.1.2 installable
  ✓ npm: @stellar-light/api-client@1.2.1 installable
  ✓ npm: @stellar-light/scout-mcp@1.1.0 installable
  ✓ skill mirror SKILL.md in sync
  ✓ skill mirror references/api-reference.md in sync
  ✓ skill mirror references/examples.md in sync
  ✓ audit coverage: every approved portal report has a triaged alias
  ⚠ identity anchor-ping → ping — missing website on one side
  ✓ partner→project identity: 41 pair(s) domain-consistent
  ✓ event recall: stellar-core v28.0.1 servable via source=release

✗ FAIL — 63 passed, 1 warnings, 5 failures

Run: https://github.com/Stellar-Light/stellarlight/actions/runs/34881216409

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions