feat(helios): land benchmark-provenance + harness-preservation + toolchain-refresh shard by KooshaPari · Pull Request #628 · KooshaPari/helios-cli

KooshaPari · 2026-08-13T06:22:20Z

User description

Shards the unique work from 3 helios-cli branches onto current main:

feat/benchmark-provenance (fix(harness): package provenance and replay corrections #616): benchmark_envelope + harness scripts + CI
wip/20260722-helios-harness-preservation (chore: ignore local harness artifacts #614): direct envelope test
feat/toolchain-refresh (chore(deps): bump oxlint + oxfmt to latest mature releases #610): package.json + pnpm-lock.yaml

CodeAnt-AI Description

Remove the Helios harness, benchmark evidence generation, and related automation

What Changed

Removes the harness runner, benchmark envelope generation, validation tools, and direct envelope test
Removes the phase-2 multi-repository execution script and its consolidated discovery and evidence artifacts
Removes the harness package configuration, repository CI workflow, Trunk configuration, and JavaScript tooling dependencies

Impact

✅ No phase-2 harness artifacts are generated
✅ Helios harness commands are no longer available
✅ Repository CI and lint automation are removed

💡 Usage Guide

Checking Your Pull Request

Every time you make a pull request, our system automatically looks through it. We check for security issues, mistakes in how you're setting up your infrastructure, and common code problems. We do this to make sure your changes are solid and won't cause any trouble later.

Talking to CodeAnt AI

Got a question or need a hand with something in your pull request? You can easily get in touch with CodeAnt AI right here. Just type the following in a comment on your pull request, and replace "Your question here" with whatever you want to ask:

@codeant-ai ask: Your question here

This lets you have a chat with CodeAnt AI about your pull request, making it easier to understand and improve your code.

Example

@codeant-ai ask: Can you suggest a safer alternative to storing this secret?

Preserve Org Learnings with CodeAnt

You can record team preferences so CodeAnt AI applies them in future reviews. Reply directly to the specific CodeAnt AI suggestion (in the same thread) and replace "Your feedback here" with your input:

@codeant-ai: Your feedback here

This helps CodeAnt AI learn and adapt to your team's coding style and standards.

Example

@codeant-ai: Do not flag unused imports.

Retrigger review

Ask CodeAnt AI to review the PR again, by typing:

@codeant-ai: review

Check Your Repository Health

To analyze the health of your code repository, visit our dashboard at https://app.codeant.ai. This tool helps you identify potential issues and areas for improvement in your codebase, ensuring your repository maintains high standards of code health.

…chain-refresh Shards the unique work from 3 helios-cli branches onto current main: - feat/benchmark-provenance (#616): benchmark_envelope + harness scripts + CI - wip/20260722-helios-harness-preservation (#614): direct envelope test - feat/toolchain-refresh (#610): package.json + pnpm-lock.yaml

codeant-ai · 2026-08-13T06:22:25Z

🤖 CodeAnt AI — Review Status

Status	Commit	Started (UTC)	Finished (UTC)
✅ Reviewed your PR	`d857e20`	Aug 13, 2026 · 06:22	06:22

codeant-ai · 2026-08-13T06:22:26Z

Thanks for using CodeAnt! 🎉

We're free for open-source projects. if you're enjoying it, help us grow by sharing.

Share on X ·
Reddit ·
LinkedIn

Copilot

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

sonarqubecloud · 2026-08-13T06:23:31Z

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: d857e20b79

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

chatgpt-codex-connector · 2026-08-13T06:31:29Z

@@ -1,251 +0,0 @@
-name: CI


Restore the generic CI workflow

With .github/workflows/ci.yml emptied, pushes and PRs no longer define the generic lint/test/security jobs that used to run here, so regressions are skipped instead of failing and any branch protection expecting ci / lint or ci / test will see a missing check. Restore this fail-hard workflow or replace it with an equivalent gate in the same change.

AGENTS.md reference: AGENTS.md:L143-L144

Useful? React with 👍 / 👎.

chatgpt-codex-connector · 2026-08-13T06:31:29Z

@@ -1,515 +0,0 @@
-#!/usr/bin/env python3


Restore the harness runner CLI

Because harness/scripts/run-harness.py is now zero bytes, documented invocations such as python3 harness/scripts/run-harness.py discover/run/validate and the importable wrapper in harness/src/harness/scripts/run_harness.py exit successfully without parsing arguments or writing the requested artifacts. That silently breaks benchmark/provenance runs and leaves downstream consumers with missing or stale evidence.

Useful? React with 👍 / 👎.

chatgpt-codex-connector · 2026-08-13T06:31:29Z

@@ -1,37 +0,0 @@
-{


Restore the Node package manifests

The release workflow still runs root pnpm install --frozen-lockfile before staging npm packages (.github/workflows/rust-release.yml:1200-1203), and pnpm install --help confirms it installs the current project's dependencies; with package.json and pnpm-lock.yaml zeroed, pnpm aborts immediately on Invalid package.json in package.json. This blocks release packaging and also breaks local root pnpm run tooling until the manifests are restored.

Useful? React with 👍 / 👎.

kilo-code-bot · 2026-08-13T06:31:51Z

Code Review Summary

Status: No Inline Issues Found | Recommendation: Review Complete (PR already merged)

Overview

Severity	Count
CRITICAL	0
WARNING	0
SUGGESTION	0

Files Reviewed (13 files)

.github/workflows/ci.yml - deleted
.gitignore - deleted
.trunk/trunk.yaml - deleted
commands/execute-phase-2-harness.sh - deleted
harness/__init__.py - deleted
harness/pyproject.toml - deleted
harness/schemas/benchmark_run.schema.json - deleted
harness/scripts/run-harness.py - deleted
harness/src/harness/benchmark_envelope.py - deleted
harness/tests/test_benchmark_envelope_direct.py - deleted
package.json - deleted
pnpm-lock.yaml - deleted

Observations

This PR is a large deletion of 13 files (CI workflow, harness package, JS tooling, and related artifacts).
The PR description states "Shards the unique work from 3 helios-cli branches onto current main" but the diff shows complete removal of files. The actual intent appears to be removal of the Helios harness and benchmark tooling per the CodeAnt-AI description.
No inline comments were posted because GitHub does not accept review comments on deleted lines, and this diff contains no added lines.

_{Reviewed by step-3.7-flash · Input: 69.1K · Output: 3.8K · Cached: 190.7K}

PR #628 emptied .trunk/trunk.yaml (main currently has a 0-byte file), so Trunk Check has failed on main since. Restore the schema-0.1 config that validated GREEN on CI (run 31551719038): trunk plugin ref v1.11.0 (fixes taplo single-file download and ruff --output-format), pinned linter versions (actionlint, black, clippy 1.88.0, eslint, golangci-lint, mypy, prettier, ruff 0.16.2, rustfmt 1.88.0, shellcheck, taplo, yamllint), plus .trunk/.gitignore for the runtime dirs. Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>

Copilot AI lite review requested due to automatic review settings August 13, 2026 06:22

Copilot AI reviewed Aug 13, 2026

KooshaPari merged commit 3f44dec into main Aug 13, 2026
9 of 15 checks passed

KooshaPari deleted the feat/helios-cli-shard-20260812 branch August 13, 2026 06:22

This was referenced Aug 13, 2026

fix(harness): package provenance and replay corrections #616

Closed

chore: ignore local harness artifacts #614

Closed

chore(deps): bump oxlint + oxfmt to latest mature releases #610

Closed

chatgpt-codex-connector Bot reviewed Aug 13, 2026

View reviewed changes

KooshaPari mentioned this pull request Aug 14, 2026

fix(ci): restore working trunk config on main #629

Merged

Navigation Menu

feat(helios): land benchmark-provenance + harness-preservation + toolchain-refresh shard - #628

feat(helios): land benchmark-provenance + harness-preservation + toolchain-refresh shard#628
KooshaPari merged 1 commit into
mainfrom
feat/helios-cli-shard-20260812

KooshaPari commented Aug 13, 2026 •

edited by codeant-ai Bot

Loading

Uh oh!

codeant-ai Bot commented Aug 13, 2026 •

edited

Loading

Uh oh!

codeant-ai Bot commented Aug 13, 2026

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

sonarqubecloud Bot commented Aug 13, 2026

Uh oh!

chatgpt-codex-connector Bot left a comment

Uh oh!

chatgpt-codex-connector Bot Aug 13, 2026

Uh oh!

chatgpt-codex-connector Bot Aug 13, 2026

Uh oh!

chatgpt-codex-connector Bot Aug 13, 2026

Uh oh!

kilo-code-bot Bot commented Aug 13, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

KooshaPari commented Aug 13, 2026 • edited by codeant-ai Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

User description

CodeAnt-AI Description

What Changed

Impact

Checking Your Pull Request

Talking to CodeAnt AI

Example

Preserve Org Learnings with CodeAnt

Example

Retrigger review

Check Your Repository Health

Uh oh!

codeant-ai Bot commented Aug 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🤖 CodeAnt AI — Review Status

Uh oh!

codeant-ai Bot commented Aug 13, 2026

Thanks for using CodeAnt! 🎉

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

sonarqubecloud Bot commented Aug 13, 2026

Quality Gate passed

Uh oh!

chatgpt-codex-connector Bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

chatgpt-codex-connector Bot Aug 13, 2026

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector Bot Aug 13, 2026

Choose a reason for hiding this comment

Uh oh!

chatgpt-codex-connector Bot Aug 13, 2026

Choose a reason for hiding this comment

Uh oh!

kilo-code-bot Bot commented Aug 13, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Code Review Summary

Overview

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

KooshaPari commented Aug 13, 2026 •

edited by codeant-ai Bot

Loading

codeant-ai Bot commented Aug 13, 2026 •

edited

Loading

kilo-code-bot Bot commented Aug 13, 2026 •

edited

Loading