feat(evidence): publish the Flow 1.34.0 comparison; supersede 1.33.0 - #319
Merged
Conversation
The daily evidence-freshness job went red when Flow 1.34.0 replaced 1.33.0 on PyPI. This publishes a fresh local comparison, replication, transaction-fault probe, and remote-lease probe bound to wheel 56d32818, sdist a941a700, and source 30fc60e5 (v1.34.0). The 1.33.0 set stays on disk and is marked superseded. Opened by an agent session, not the founder.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The reader is a reviewer of the public evals evidence pin, and anyone who quotes those numbers as current.
Flow 1.34.0 replaced 1.33.0 on PyPI. The daily evidence-freshness job went red (run 33253192977) with:
published evidence is pinned to openadapt-flow 1.33.0 but the current published release is 1.34.0Those 1.33.0 numbers now describe an engine nobody serves. This follows #297 and #294: bounded campaigns, exact artifact binding, 1.33.0 superseded not deleted.
Counted result
93 counted trials against Flow 1.34.0, run locally (synthetic MockMed, loopback only, headless Chromium, no model calls):
RECONCILIATION_REQUIRED(18 of 30); no blind retry or replay dispatchHALTED_BEFORE_EFFECT,RECONCILIATION_REQUIRED)Zero silent incorrect success, zero wrong actions, zero over-halts, zero model calls across all counted arms.
Every campaign states
production_acceptance: false. This set is development evidence, not a Production lifecycle admission, and it establishes nothing about hosted, customer-workflow, native-desktop, RDP, or Citrix acceptance.Environment
Python 3.12.7 on macOS arm64,
openadapt-flow==1.34.0,openadapt-types==0.10.1,playwright==1.62.0, Playwright Chromium revision1234. Those are the same Playwright and types versions the 1.33.0 set recorded. The Python patch is 3.12.7 rather than 3.12.13.The wheel was fetched from PyPI and its SHA-256 checked against the published digest
56d32818…before any campaign ran. The Flow source is a clean checkout withv1.34.0pointing at HEAD30fc60e5.Validation
Published evidence docs/eval_results/current_flow_v1_34_0_local_20260829 is bound to the current openadapt-flow release 1.34.0pytest tests/test_published_evidence_freshness.py: 37 passedWhat a reviewer should check:
stale_reasonsays it was not relabeled56d32818…, sdista941a700…, source30fc60e5…Opened by an agent session, not the founder.