Skip to content

Commit 5b06690

Browse files
westgatewestgate
authored andcommitted
S203e: docs cleanup — root docs to S203e, stale showcase archived, artifacts cleaned
Root docs (README, NEXT_STEPS, DOCUMENTATION) updated to S203e state. Stale showcase demos (01-shader-pipeline, 02-compute-patterns) marked ARCHIVED with README.md explanations — reference S169-removed methods. Build artifacts cleaned (58.9 GiB). Fresh build verified: 0 clippy warnings, 0 test failures. Made-with: Cursor
1 parent 3a1380c commit 5b06690

12 files changed

Lines changed: 46 additions & 25 deletions

File tree

DOCUMENTATION.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# ToadStool Documentation Hub
22

3-
**Last Updated**: April 12, 2026 — S203c
3+
**Last Updated**: April 12, 2026 — S203e
44

55
---
66

@@ -30,7 +30,7 @@ These root documents were **fully resolved** and **fossilized** in wateringHole
3030

3131
---
3232

33-
## Current State (S203c — April 12, 2026)
33+
## Current State (S203e — April 12, 2026)
3434

3535
**Post-budding, dependency-sovereign, IPC-first, fully concurrent, capability-based.** barraCuda is a separate primal at `ecoPrimals/barraCuda/`. ToadStool is the hardware infrastructure layer — GPU/NPU/CPU discovery, capability probing, workload orchestration, and shader dispatch.
3636

@@ -39,7 +39,8 @@ These root documents were **fully resolved** and **fossilized** in wateringHole
3939
- **Pipeline dispatch**`compute.dispatch.pipeline.submit` + `.status` for ordered multi-stage workloads (DAG, topological sort, result forwarding). Resolves neuralSpring PG-05.
4040
- **Capability-based everywhere (S202)**: 0 production hardcoded primal names, 0 production mocks, 0 production unwraps, 0 TODOs/FIXMEs. All primal references use `PRIMAL_NAME` constant or capability identifiers. API keys evolved (e.g., `shader_compiler_available`).
4141
- **TS-01 / shader compiler discovery**`visualization_client.rs` uses unified `capability.discover` (no `CORALREEF_*` env, no coralreef-core.json, no coralreef dir scan).
42-
- **BTSP Phase 2** — Handshake enforced on every UDS accept path (JSON-RPC + tarpc + daemon servers).
42+
- **BTSP Phase 2 + Auto-Detect** — Handshake enforced on every UDS accept path; auto-detects plain-text clients (primalSpring) and degrades gracefully.
43+
- **Network constants centralized** — 8 hardcoded values (RFC1918 ranges, gateway, scan suffixes, TEST-NET-3) → `core/config/defaults/network.rs`
4344
- **34 unsafe blocks (all in hw-safe/GPU/VFIO/display containment crates)**; all SAFETY-documented. 41 crates forbid, 6 deny `unsafe_code`.
4445
- **ecoBin v3.0** — Zero C FFI deps. `serialport` feature-gated in specialty crate (S202). Crypto delegated to security service. HTTP delegated to coordination service.
4546
- **Headless GPU**`TOADSTOOL_HEADLESS=1` env var for pure headless operation. wgpu crash isolation via `catch_unwind` + thread timeout.

NEXT_STEPS.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,8 @@
11
# ToadStool -- Next Steps
22

3-
**Updated**: April 12, 2026 — S203c (Deep Debt Execution: Capability-Based Evolution)
3+
**Updated**: April 12, 2026 — S203e (Deep Debt: Network Centralization + BTSP Auto-Detect)
44
**Status**: Production-grade | Rust edition **2024** (MSRV 1.85) | **AGPL-3.0-or-later** | **All quality gates green** | 21,600+ tests (0 failures) | **~69 JSON-RPC methods** | Wire Standard L3 (partial) | Zero C FFI deps (ecoBin v3.0) | Zero production unwraps | IPC-first | **43/43 crates with `unsafe_code` lint policy** | **34 unsafe blocks** (all in hw containment) | **~80 justified #[allow]** | **0 production TODOs** | **~3m30s test runtime** | **rustix 1.x everywhere except display** | **capability-based primal references (no hardcoded names)**
5-
**Latest**: S203cDeep debt execution: hardcoded `"toadstool"` literals → `PRIMAL_NAME`, `"coral_reef_available"``"shader_compiler_available"`, ~15 doc comments evolved to capability wording, `serialport` feature-gated, dead code removed, `jsonrpc_server.rs` DRY'd. S201 (prior): primalSpring gap closure, +46 tests
5+
**Latest**: S203eNetwork constants centralized (8 hardcoded values → config/defaults). BTSP auto-detect for plain-text peers (LD-04). 5 large files refactored (test extraction). Full deep audit: zero debt markers in production. S203d (prior): LD-04 BTSP resolution + env-safe test hardening.
66

77
---
88

README.md

Lines changed: 8 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ Nest = Tower + Storage <- storage
4242
| `cargo fmt --all -- --check` | 0 diffs |
4343
| `cargo clippy --workspace --all-targets -- -D warnings` | 0 warnings |
4444
| `cargo doc --workspace --no-deps` (RUSTDOCFLAGS="-D warnings") | 0 warnings |
45-
| `cargo test --workspace` | **21,600+ tests, 0 failures** (S203c), 121 ignored (hardware-gated); full workspace ~3m30s |
45+
| `cargo test --workspace` | **21,600+ tests, 0 failures** (S203e), 121 ignored (hardware-gated); full workspace ~3m30s |
4646
| Doctests | All passing (common, core, server, cli, testing, display) |
4747
| Standalone clone test | Pull to any machine, `cargo test` works (GPU-optional, CPU fallback, device-lost resilient) |
4848
| `unsafe` blocks | **~66 actual** (all in hw-safe/GPU/VFIO/display containment crates); SAFETY-documented; **41 crates forbid, 6 deny** `unsafe_code` |
@@ -58,7 +58,7 @@ Nest = Tower + Storage <- storage
5858
| Hardcoded ports/localhost | 0 inline literals -- config constants + capability-based discovery |
5959
| Hardware transport | Implemented | DRM display, V4L2 capture, serial — frame protocol + router |
6060
| License | AGPL-3.0-or-later -- root LICENSE file + SPDX headers on all files |
61-
| File size limit | All production files **< 500 lines** (S203c: 14 large modules refactored via test extraction; all production files target <500 lines) |
61+
| File size limit | All production files **< 500 lines** (S203e: 14 large modules refactored via test extraction; all production files target <500 lines) |
6262
| Test concurrency | Unlimited parallelism (removed global throttle); zero `#[serial]`; test-time mDNS/TCP timeouts via `cfg!(test)`; zero fixed sleeps in non-chaos tests |
6363
| Environment safety | All env-var tests use `temp_env` (thread-safe), zero `std::env::set_var` in tests |
6464

@@ -244,7 +244,7 @@ toadStool/
244244
| Clippy pedantic warnings | 0 (workspace-wide `clippy::pedantic` clean; `#[expect]` evolution S131+) |
245245
| Doc warnings | 0 |
246246
| Build warnings | 0 |
247-
| Workspace tests | **21,600+** (S203c), 0 failures |
247+
| Workspace tests | **21,600+** (S203e), 0 failures |
248248
| Lib-only line coverage | ~83.6% |
249249
| Full workspace test time | ~2m30s (unlimited parallelism, `cfg!(test)` fast timeouts; GPU crates have NVK resilience wrappers) |
250250
| `unsafe` blocks | **~66 actual** (all in hw-safe/GPU/VFIO/display containment crates); SAFETY-documented; **41 crates forbid, 6 deny** `unsafe_code` |
@@ -266,11 +266,13 @@ toadStool/
266266
**We are still evolving.** barraCuda (separate primal) owns all math and shaders. ToadStool focuses on hardware discovery, capability probing, and workload orchestration. All 5 spring handoffs absorbed.
267267

268268
### Active / Next
269-
- **Test coverage** -- pushing toward 90% target; 21,600+ tests (S203c); ~83.6% lib-only line (185K lines instrumented); remaining gap: hardware-dependent paths, specialty runtimes
269+
- **Test coverage** -- pushing toward 90% target; 21,600+ tests (S203e); ~83.6% lib-only line (185K lines instrumented); remaining gap: hardware-dependent paths, specialty runtimes
270270
- **DF64 / ComputeDispatch** -- transferred to barraCuda team (S93); toadStool serves hardware capabilities
271271
- **Sovereign compiler Phase 4+** -- register pressure estimation, loop software pipelining (barraCuda)
272272

273273
### Recently Completed
274+
- **S203e (Apr 12, 2026)**: Deep debt — 8 hardcoded network constants centralized to `core/config/defaults/network.rs` (RFC1918 scan ranges, gateway, subnet, scan suffixes, TEST-NET-3). 5 production files >550 LOC refactored via test extraction (byob_types, cross_spring_provenance, gpu_job_queue, silicon, registry). Full deep audit: zero TODO/FIXME/HACK/dbg/unwrap/set_var in production; all unsafe in containment; all mocks test-gated; all hardcoding centralized.
275+
- **S203d (Apr 12, 2026)**: LD-04 resolution — BTSP auto-detect on UDS sockets. Plain-text clients (primalSpring `CompositionContext`) now get graceful fallback to NDJSON/HTTP on BTSP-enabled sockets. `PrependByte<S>` adapter for first-byte protocol detection. 2 env-dependent tests hardened (ephemeral port bind). +7 tests.
274276
- **S203c (Apr 12, 2026)**: Deep debt audit + smart file refactoring. Extracted test modules from **10** production files >550 LOC (jsonrpc_server 638→391, edge/lib 636→404, policies/types 604→407, cpu_resource 596→511, power_manager 595→483, performance/mod 594→194, gpu/distributed 590→417, transport 588→308, scheduling 588→409, client/lib 586→140). Deprecated 4 internal OpenCL detection stubs. Full audit confirms: all unsafe in containment zones with SAFETY docs, all mocks test-gated, all hardcoding centralized, blake3 pure-Rust verified. Zero `Box<dyn Error>`, `.unwrap()`, or `std::env::set_var` in production. All quality gates green.
275277
- **S203b (Apr 12, 2026)**: primalSpring LD-04/LD-05 resolution. HTTP mode evolved from single-shot to HTTP/1.1 keep-alive loop (multi-step dispatch no longer gets broken pipe). NDJSON mode resilient to blank lines. JSON-RPC and tarpc sockets separated (`compute.sock` + `compute-tarpc.sock`) — fixes internal bind collision and clears namespace for barraCuda. +7 tests.
276278
- **S203 (Apr 12, 2026)**: Composition Elevation Sprint + Deep Debt Execution. **Dispatch wire contract standardized** — all 8 `compute.dispatch.*` handlers share canonical `{domain, operation, job_id, status, output, error, metadata}` envelope (unblocks primalSpring typed extractors for Node Atomic composition). Smart file refactoring: 4 production files >550 LOC refactored (test extraction from background 608→72, federation 594→109, encryption 568→257, runtime 576→249+stats). Primal name evolution: `get_primal_default_port` deprecated with migration to `resolve_capability_port`. Unsafe evolution: GPU buffer access evolved to `NonNull::slice_from_raw_parts` pattern. Port centralization: discovery fallback ports unified in `common/constants/discovery_ports.rs`. Clippy suppressions resolved (cast lints, unused_self). `deny.toml`: 6 stale RUSTSEC advisories removed. Wire contract documented in `specs/DISPATCH_WIRE_CONTRACT.md`. All quality gates green.
@@ -315,7 +317,7 @@ See [CHANGELOG.md](CHANGELOG.md) for full session-by-session detail.
315317

316318
| ID | Description | Status |
317319
|----|-------------|--------|
318-
| D-COV | Test coverage → 90% | Active -- 21,600+ tests (S203c); ~83.6% lib-only line (185K instrumented); remaining gap: hardware paths |
320+
| D-COV | Test coverage → 90% | Active -- 21,600+ tests (S203e); ~83.6% lib-only line (185K instrumented); remaining gap: hardware paths |
319321
| D-S20-003 | ~~neuralSpring `evolved/` migration~~ | **RESOLVED** -- neuralSpring V89 completed; `evolved/` removed |
320322
| D-S18-002 | ~~cubecl transitive `dirs-sys`~~ | **RESOLVED** -- cubecl removed; dirs-sys only via wasmtime-cache (feature-gated) |
321323
| D-BTSP-PHASE2 | ~~BTSP on all UDS accept paths~~ | **RESOLVED** -- S198: handshake wired in `tarpc_server.rs` and `daemon/jsonrpc_server.rs` (pure JSON-RPC already had it) |
@@ -360,7 +362,7 @@ See [DEBT.md](DEBT.md) for full register and evolution paths.
360362

361363
---
362364

363-
**Last Updated**: April 12, 2026 — S203c. **21,600+** workspace tests, 0 failures. ~83.6% lib-only line coverage (target 90%). **~67 JSON-RPC methods** with **Wire Standard L3** (cost_estimates + operation_dependencies). AGPL-3.0-or-later. Zero C FFI deps (ecoBin v3.0). **~66 unsafe blocks** (all in hw-safe/GPU/VFIO/display containment crates); **41 crates forbid, 6 deny** `unsafe_code`. IPC-first JSON-RPC (Unix sockets). Capability symlinks (`compute.sock`). Rust 1.85+ (edition 2024, MSRV). **S198**: TS-01 (`capability.discover`), BTSP Phase 2 UDS, health triad, OpenCL deprecation, module splits (<500 lines target), musl static binary, net −5K lines — quality gates green. **Capability-based discovery compliant** per `CAPABILITY_BASED_DISCOVERY_STANDARD.md` v1.2.
365+
**Last Updated**: April 12, 2026 — S203e. **21,600+** workspace tests, 0 failures. ~83.6% lib-only line coverage (target 90%). **~67 JSON-RPC methods** with **Wire Standard L3** (cost_estimates + operation_dependencies). AGPL-3.0-or-later. Zero C FFI deps (ecoBin v3.0). **~66 unsafe blocks** (all in hw-safe/GPU/VFIO/display containment crates); **41 crates forbid, 6 deny** `unsafe_code`. IPC-first JSON-RPC (Unix sockets). Capability symlinks (`compute.sock`). Rust 1.85+ (edition 2024, MSRV). **S198**: TS-01 (`capability.discover`), BTSP Phase 2 UDS, health triad, OpenCL deprecation, module splits (<500 lines target), musl static binary, net −5K lines — quality gates green. **Capability-based discovery compliant** per `CAPABILITY_BASED_DISCOVERY_STANDARD.md` v1.2.
364366

365367
---
366368

showcase/01-shader-pipeline/01-naga-fallback/demo.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
#!/usr/bin/env bash
2-
# NOTE (S169): The demo program invoked below still references JSON-RPC methods removed in S169
3-
# (e.g. shader.compile.*). This showcase needs updating to match the current server API.
2+
# ARCHIVED (S169): This demo references JSON-RPC methods no longer in toadStool.
3+
# See showcase/00-local-primal/ for current demos.
44
set -euo pipefail
55
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
66
cd "$SCRIPT_DIR"

showcase/01-shader-pipeline/02-coralreef-compile/demo.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
#!/usr/bin/env bash
2-
# NOTE (S169): The demo program invoked below still references JSON-RPC methods removed in S169
3-
# (e.g. shader.compile.*). This showcase needs updating to match the current server API.
2+
# ARCHIVED (S169): This demo references JSON-RPC methods no longer in toadStool.
3+
# See showcase/00-local-primal/ for current demos.
44
set -euo pipefail
55
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
66
cd "$SCRIPT_DIR"

showcase/01-shader-pipeline/03-compile-status/demo.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
#!/usr/bin/env bash
2-
# NOTE (S169): The demo program invoked below still references JSON-RPC methods removed in S169
3-
# (e.g. shader.compile.*). This showcase needs updating to match the current server API.
2+
# ARCHIVED (S169): This demo references JSON-RPC methods no longer in toadStool.
3+
# See showcase/00-local-primal/ for current demos.
44
set -euo pipefail
55
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
66
cd "$SCRIPT_DIR"
Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
# Shader Pipeline Showcases — ARCHIVED (S169)
2+
3+
These demos reference JSON-RPC methods (`shader.compile.*`) that were removed
4+
from toadStool in S169 and transferred to coralReef (the sovereign compiler
5+
primal). The demo code is preserved as a historical reference.
6+
7+
For current shader dispatch, see `compute.dispatch` in the server API.

showcase/02-compute-patterns/01-capability-discovery/demo.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
#!/usr/bin/env bash
2-
# NOTE (S169): The demo program invoked below still references JSON-RPC methods removed in S169
3-
# (e.g. discovery.*). This showcase needs updating to match the current server API.
2+
# ARCHIVED (S169): This demo references JSON-RPC methods no longer in toadStool.
3+
# See showcase/00-local-primal/ for current demos.
44
set -euo pipefail
55
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
66
cd "$SCRIPT_DIR"

showcase/02-compute-patterns/02-science-dispatch/demo.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
#!/usr/bin/env bash
2-
# NOTE (S169): The demo program invoked below still references JSON-RPC methods removed in S169
3-
# (e.g. science.gpu.*). This showcase needs updating to match the current server API.
2+
# ARCHIVED (S169): This demo references JSON-RPC methods no longer in toadStool.
3+
# See showcase/00-local-primal/ for current demos.
44
set -euo pipefail
55
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
66
cd "$SCRIPT_DIR"

showcase/02-compute-patterns/03-deploy-graph/demo.sh

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
#!/usr/bin/env bash
2-
# NOTE (S169): The demo program invoked below still references JSON-RPC methods removed in S169
3-
# (e.g. deploy.*). This showcase needs updating to match the current server API.
2+
# ARCHIVED (S169): This demo references JSON-RPC methods no longer in toadStool.
3+
# See showcase/00-local-primal/ for current demos.
44
set -euo pipefail
55
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
66
cd "$SCRIPT_DIR"

0 commit comments

Comments
 (0)