This is the umbrella / docs / OKFS repo for Shannon-Prime. It holds the
entire canonical doc set (papers/), the proven-state ledger, the contracts,
and the two knowledge stores (okf_validate.py / SP-OKF, okf_mem.py /
MEM-OKF, okf_history.py). The code lives in the companion repos
(shannon-prime-system = math core, shannon-prime-system-engine = inference
engine, shannon-prime-harness = Python agent harness). This file tells a
coding agent how to come up to speed and what is binding.
State one-liner (2026-07-01). Faithfulness axis CLOSED end-to-end —
L5-cosine recall (SP_RECALL_L5, τ=0.30, 86.89% live, G-L5-RECALL-LIVE)
- a zero-inference attribute-gate decline that closes the zero-prior /
private-data hole (
G-SNE-ATTRGATE-ZEROINF: confab→0, leak→0, no gemma4 forward). The generative judge is PARKED (hard-foreign kill-test: 0 benefit over L5-direct+τ). SWARM/DHT is re-elevated to a PRIMARY forward axis alongside the governing law, ADR-002 (the Decide→Execute spine). New doc:papers/PPT-LAT-FINDINGS-LEDGER.md(measured constants / layers / levers / boundaries + per-test ledger).
prompt.md— the canonical session bootstrap. What the project is, the current campaign, the methodology, the machine. Start here, every session.papers/START-HERE.md— the 2-minute navigable map (5 repos, the doc set in reading order, the anti-rebuild law, the roadmap).papers/VERIFIED-SCOREBOARD.md— what is actually built (commit + gate per claim) and what is open; receipts-checked 2026-07-01 (9 VERIFIED · 1 PARTIAL · 0 false-greens). Read this for status when memories disagree.papers/PPT-LAT-STATE.md— the PROVEN record (the "20th rewrite" ledger). Each line cites its evidence (commit / gate / closure). Your default is TRUST. Re-proving the whole stack from scratch is the failure mode this project has hit 20 times — don't.papers/PPT-LAT-KEYSTONE.md→papers/PPT-LAT-Roadmap.md→papers/PPT-LAT-FINDINGS-LEDGER.md(which layer / what τ / what K / where the lever is, without re-deriving) →papers/PPT-LAT-ADR-002-DECIDE-EXECUTE-SPINE.md(the governing law).memory-okf/LUT.md— the MEM-OKF Tier-0 lookup table. Skim it; then run the lookup pre-flight below before building anything.HISTORY.md— the hashed Tier-0 commit LUT (the short-hash IS the content address;git show <hash>for the full commit). Use it to place a claim in time.- The active contract —
papers/CONTRACT-*.mdfor the lane you're touching (e.g.CONTRACT-CHAT-FULLSTACK,CONTRACT-NIGHTSHIFT-CURATOR,CONTRACT-BYTEEXACT-forward,CONTRACT-C2). Contracts carry the gates and the run records.
CURRENT-STATE-OF-PROJECT.md (repo root) is a human-readable synthesis if you
want narrative orientation; papers/PPT-LAT-Theory.md is the math foundation —
read it before touching the substrate.
This project has rebuilt the same subsystems 20+ times because sessions forgot what already existed. A new file for a capability that already exists is a defect, not progress. So, before you write code or a new doc:
python tools/okf_mem.py lookup --root memory-okf <keyword>…and grep the tree for the capability. If the LUT or the tree already has it,
reuse it — extend, don't rebuild. The store is content-addressed
(LUT → summary → full; sha256 for text, C2-LSH-sig for latent episodes); spec
is papers/MEMORY-OKF-PROFILE.md; verify with
python tools/okf_mem.py verify --root memory-okf (gate G-MEM-OKF-CONFORM).
At session end, bank durable "X already exists — don't rebuild" facts:
python tools/okf_mem.py add ….
- Receipts-first. No number without a reproducing command + a
LEDGER.md/ STATE row. A claim you can't run isn't a claim. - Bit-exact when off. Every mechanism is an
SP_*flag, a strict no-op by default. Unset == null floor == may LOOK broken — check the flag before declaring anything broken. Verify the off-state is byte-identical to baseline. - Honest tiers, exact words. Use the vocabulary and never inflate: GREEN-LIVE (gated GREEN and served by default) · gated-GREEN / default-off (passes its gate, behind a flag — NOT "live") · BUILT/WIRED (in-tree, primitive-gated, not yet end-to-end) · DESIGN (spec'd, unbuilt) · HONEST-NEGATIVE (measured + refuted, kept on the record). gated-GREEN is not GREEN-LIVE.
- No silent gate revision. If the implementation can't meet a spec'd gate, surface upstream and amend the contract formally — never retune fixtures, retreat to a weaker claim, or footnote a PASS.
- Honest negatives stay attached. The 32k NIAH MISS, the falsified KSTE router, the retired 34.2 tok/s headline — on the record on purpose; they prove the gates discriminate.
- Check the code + commits +
git fetchbefore trusting memory or a summary. STATE is the proven record — trust it, re-prove only with concrete cause. Verify Gemini's claims against the tree. - Reference-first when porting — read the reference (llama.cpp / the paper) with file:line before coding.
- Anti-contamination — do NOT read, copy, or vendor code from the archived
shannon-prime/orshannon-prime-engine/repos.
Every knowledge .md you create or touch under a bundle (papers/,
memory-okf/, memory/) is an SP-OKF concept and must carry the frontmatter:
---
type: <one of the registered vocabulary in papers/SP-OKF-PROFILE.md §2>
title: "..."
description: "..."
tags: [...]
timestamp: 2026-06-21T00:00:00Z
resource: <relative path this concept is about>
sp_status: <GREEN | ACTIVE | DESIGN | ...>
sp_gate: <gate name or none>
sp_commit: <short hash or TBD>
sp_repro: "<reproducing command, or none>"
---New types register in papers/SP-OKF-PROFILE.md §2 first (single source
of truth). Before committing changes to a bundle, run the validator:
python tools/okf_validate.py papers # gate G-OKF-CONFORM, must be GREENREADME.md carries SP-OKF frontmatter (type: reference) so the umbrella
front-door is itself a validated concept. This AGENTS.md is a plain top-level
orientation doc (not a papers/ concept) and intentionally does not carry
frontmatter. HISTORY.md carries type: log frontmatter because it is a
generated MEM-OKF artifact.
- OKFS tooling lives here.
tools/okf_validate.py(G-OKF-CONFORM),tools/okf_mem.py(the anti-rebuild store),tools/okf_history.py(regeneratesHISTORY.md:python tools/okf_history.py gen --repo . --out HISTORY.md --n 80). - Submodule discipline. The math core is also carried as a submodule inside
the engine (
lib/shannon-prime-system), so the standalone clone can diverge —git fetch+ behind-check before building or committing. - Worktrees per concurrent agent. Two agents on one repo → each in its own
git worktree add. - Supersession order when documents disagree: VERIFIED-SCOREBOARD >
KEYSTONE > STATE > contract run records > Roadmap amendments > Roadmap body.
The L1 ABI and
.sp-modelspecs are frozen; everything else is amendable when reality contradicts it.