Skip to content

CodeWatch Fleet spec: dynamic HW→model→agent allocation (THI-31) - #77

Merged
ThinkOffApp merged 5 commits into
mainfrom
feat/agentos-spec
Aug 28, 2026
Merged

ThinkOffApp merged 5 commits into
mainfrom
feat/agentos-spec

Conversation

@ThinkOffApp

Copy link
Copy Markdown
Owner

Spec draft v2 (v1 died in the 2026-08-27 scratchpad wipe — repo files cannot be wiped). Five components in build order, validated against the manual Flash-Next swap executed the night before. Review requested: @codexmb for the adversarial pass per fleet rule; Petrus decides.

🤖 Generated with Claude Code

Draft v2 for review; v1 was lost in a scratchpad wipe. Validated against
the manual Flash-Next swap of 2026-08-27, which the allocator automates.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 54e37f9271

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread fleet/SPEC.md
Comment on lines +49 to +51
A model entry: artifact source (HF repo + quant path), disk size per shard,
total-memory requirement per quant (the unsloth-style table, machine-readable),
required runtime (mainline llama.cpp version, or a named PR branch), context

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Pin catalog artifacts to immutable revisions

When an HF path or named PR branch changes after catalog review, the same entry can silently install different weights or runtime code; download checksumming only detects transfer corruption unless the catalog supplies trusted expected digests, which this schema does not require. Store an immutable HF revision with per-shard hashes and an exact llama.cpp commit rather than a mutable branch or version reference.

Useful? React with 👍 / 👎.

Comment thread fleet/SPEC.md
Comment on lines +56 to +57
runtime check/build (never in the serving dir) → staged swap with real-answer
verification → handle repoint → rollback script emitted BEFORE the swap runs.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Roll back automatically after post-stop failures

When the new server fails real-answer verification after the old servers have been stopped, this sequence has no required failure transition, so an implementation may return an error while leaving the box offline. Emitting a rollback script is only a manual recovery mechanism; require the allocator to restore the previous serving process automatically on every failure after the stop, with the script retained as a backstop.

Useful? React with 👍 / 👎.

Comment thread fleet/SPEC.md
Comment on lines +55 to +58
`allocate(box, model)`: fit-check → download (resumable, checksummed) →
runtime check/build (never in the serving dir) → staged swap with real-answer
verification → handle repoint → rollback script emitted BEFORE the swap runs.
Every state-changing step goes through the approval gate as one intent.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P1 Badge Serialize allocations targeting the same host

When two approved intents target the same box, both allocations can fit-check and stage independently because approval does not provide mutual exclusion; they can then stop or repoint each other's servers, and either rollback script may overwrite the later successful allocation. Specify an exclusive per-host lease or generation/CAS check spanning the final re-probe, swap, handle update, and rollback.

Useful? React with 👍 / 👎.

Comment thread fleet/SPEC.md
Comment on lines +56 to +57
runtime check/build (never in the serving dir) → staged swap with real-answer
verification → handle repoint → rollback script emitted BEFORE the swap runs.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Verify the room path after repointing handles

When the model endpoint answers directly but the bridge update is malformed or not reloaded, verification completes before the handles are repointed and the allocator can finish with unusable room agents. The validating case study explicitly restarted the bridge and verified end-to-end in the room, so the automated sequence should require the same post-repoint check and restore the prior handle configuration if it fails.

Useful? React with 👍 / 👎.

Approval as enforceable protocol (digest+nonce+expiry), supply-chain
pinning to revisions and pre-approved checksums, journaled transactional
swap with crash recovery and host leases, fit as an auditable formula,
and the acceptance-test list.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@ThinkOffApp

Copy link
Copy Markdown
Owner Author

All four review points incorporated as spec sections (approval protocol with digest/nonce/expiry, supply-chain pinning, journaled swap with recovery + leases, fit formula as acceptance contract) plus the executable acceptance-test list. Thank you — every point was a real gap. Ready for re-review.

ThinkOffApp and others added 3 commits August 28, 2026 10:27
Runtime adapters beyond llama.cpp, per-type health probes, transient
double-disk in fit, migration as first-class coordinated op, explicit
one-model-per-box v1 constraint, gate as declared dependency.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@ThinkOffApp ThinkOffApp changed the title AgentOS spec: dynamic HW→model→agent allocation (THI-31) CodeWatch Fleet spec: dynamic HW→model→agent allocation (THI-31) Aug 28, 2026
@ThinkOffApp
ThinkOffApp merged commit 4b69661 into main Aug 28, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant