Skip to content

Classify empty AI packet diagnostics - #2182

Merged
chubes4 merged 2 commits into
mainfrom
fix/ai-empty-packet-diagnostics
May 22, 2026
Merged

Classify empty AI packet diagnostics#2182
chubes4 merged 2 commits into
mainfrom
fix/ai-empty-packet-diagnostics

Conversation

@chubes4

@chubes4 chubes4 commented May 22, 2026

Copy link
Copy Markdown
Member

Summary

  • Record an AIStep diagnostic reason when the AI loop emits no downstream packets, without changing the existing terminal status semantics.
  • Surface diagnostic outcome classes such as ai_required_handler_not_called, ai_handler_tool_failed, ai_empty_response, and ai_completion_assertions_missing through run metrics.
  • Extend smoke coverage for metrics and handler handoff diagnostics.

Verification

  • php tests/job-outcome-metrics-smoke.php
  • php tests/upsert-handler-result-handoff-smoke.php
  • php -l inc/Core/Steps/AI/AIStep.php && php -l inc/Core/RunMetrics.php && php -l tests/job-outcome-metrics-smoke.php && php -l tests/upsert-handler-result-handoff-smoke.php
  • homeboy test --path /Users/chubes/Developer/data-machine@fix-ai-empty-packet-diagnostics --extension wordpress

Notes

  • homeboy lint --path /Users/chubes/Developer/data-machine@fix-ai-empty-packet-diagnostics --extension wordpress still reports existing frontend/admin lint debt outside the modified PHP files.

AI assistance

  • AI assistance: Yes
  • Tool(s): OpenCode (GPT-5.5)
  • Used for: Diagnosed live empty-packet metrics, drafted the diagnostic classification change and smoke coverage, and ran verification for Chris to review.

@homeboy-ci

homeboy-ci Bot commented May 22, 2026

Copy link
Copy Markdown
Contributor

Homeboy Results — data-machine

Lint

lint — passed

ℹ️ Full options: homeboy docs commands/lint
Deep dive: homeboy lint data-machine --changed-since 40cc9b1

Artifacts and drill-down
  • CI results artifact: homeboy-ci-results-data-machine-lint-quality-Linux-node24 contains immediate command JSON for this action invocation.
  • Observation artifact: homeboy-observations-data-machine-lint-quality-Linux-node24 contains exported Homeboy run history for deeper queries.
  • Drill-down: download the observation artifact, then run homeboy runs import <dir>, homeboy runs list, and homeboy runs findings <run-id>.
  • Artifacts are attached to the workflow run: https://github.com/Extra-Chill/data-machine/actions/runs/26306145045

Test

test — passed

  • 1035 passed
  • 3 skipped

ℹ️ Auto-fix lint issues: homeboy refactor data-machine --from lint --write
ℹ️ Collect coverage: homeboy test data-machine --coverage
ℹ️ Save test baseline: homeboy test data-machine --baseline
ℹ️ Pass args to test runner: homeboy test -- [args]
ℹ️ Full options: homeboy docs commands/test
Deep dive: homeboy test data-machine --changed-since 40cc9b1

Artifacts and drill-down
  • CI results artifact: homeboy-ci-results-data-machine-test-quality-Linux-node24 contains immediate command JSON for this action invocation.
  • Observation artifact: homeboy-observations-data-machine-test-quality-Linux-node24 contains exported Homeboy run history for deeper queries.
  • Drill-down: download the observation artifact, then run homeboy runs import <dir>, homeboy runs list, and homeboy runs findings <run-id>.
  • Artifacts are attached to the workflow run: https://github.com/Extra-Chill/data-machine/actions/runs/26306145045

Audit

audit — passed

  • dead_code — 145 finding(s)
  • requested_detectors — 120 finding(s)
  • intra-method-duplication — 62 finding(s)
  • repeated_literal_shape — 13 finding(s)
  • field_patterns — 9 finding(s)
  • Taxonomy — 5 finding(s)
  • Abilities — 4 finding(s)
  • Flow — 4 finding(s)
  • structural — 4 finding(s)
  • File — 2 finding(s)
  • Total: 378 finding(s)

Deep dive: homeboy audit data-machine --changed-since 40cc9b1

Artifacts and drill-down
  • CI results artifact: homeboy-ci-results-data-machine-audit-quality-Linux-node24 contains immediate command JSON for this action invocation.
  • Observation artifact: homeboy-observations-data-machine-audit-quality-Linux-node24 contains exported Homeboy run history for deeper queries.
  • Drill-down: download the observation artifact, then run homeboy runs import <dir>, homeboy runs list, and homeboy runs findings <run-id>.
  • Artifacts are attached to the workflow run: https://github.com/Extra-Chill/data-machine/actions/runs/26306145045
Tooling versions
  • Homeboy CLI: homeboy 0.197.2+db5f74ab
  • Extension: wordpress from https://github.com/Extra-Chill/homeboy-extensions
  • Extension revision: dd23ee80
  • Action: unknown@unknown

@chubes4
chubes4 merged commit 63cafc2 into main May 22, 2026
5 checks passed
@chubes4
chubes4 deleted the fix/ai-empty-packet-diagnostics branch May 22, 2026 19:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant