Handoff: monotone-constructions (mixed/alternate/split) — resume point#135
Draft
davorrunje wants to merge 1 commit into
Draft
Handoff: monotone-constructions (mixed/alternate/split) — resume point#135davorrunje wants to merge 1 commit into
davorrunje wants to merge 1 commit into
Conversation
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #135 +/- ##
=========================================
Coverage 100.00% 100.00%
=========================================
Files 18 18
Lines 867 867
Branches 148 148
=========================================
Hits 867 867 🚀 New features to boost your workflow:
|
3 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
TL;DR
The
alternateconstruction + composition-awareprev=init are built, merged, CI-green (3 backends). The one experiment that actually tests whyalternateexists — the deep plain verdict — has not been run. Everything measured so far is either shallow (parity) or residual (a wash). Finish the deep-plain grid run before concluding.Merged (on
main)modeabsolute→mixed,switch→split(hard break, no behavior change).alternateconstruction + composition-aware init viaprev=(torch/jax/keras). API live:MonoLinear/MonoDense(mode="alternate", prev=<prev|None>); layer-resolved to the|W|kernel;convex_fractionreserved formixed;MonoResidualrejectsalternate.benchmarks/flavor_ablation.py, plain depths {4,8,16}, divergence-rate).convex_fractionablation. feat(bench): HP-search sensitivity curves (spec + plan + implementation) #117 HP-sensitivity curves.Evidence so far
alternatedoes not decisively beatmixed/split(co-leadscompas, parityauto/heart, losesblog/loan). Biggest win was fixingconvex_fraction=0.5inmixed(3/5).mixed/splitdiverge whilealternatestays stable → the untested claim.The outstanding experiment — deep plain (H-plain)
Not covered by #111 (shallow) or #114/#115 (residual). The grid runner from #110 is built for it (plain, depths {4,8,16}, divergence-rate) but has not run — no
benchmarks/results/flavor-ablation/onmain. Run commands + how to read the verdict are in the handoff note. Verify the runner CLI matches the #110 plan before running.Other open threads
convex_fraction=0.5default (feat(bench): tuned shallow base result — 4-flavor bake-off + convex_fraction ablation #111 follow-up).docs/concepts/, CPU, not started).tools/execute-benchmarks.sh(GPU) to refresh.ipynboutputs before0.0.0a1.absolute_init_params→mixed_init_params, equivalence filename slugs.Pointers
Spec
2026-07-13-monotone-constructions-init-and-ablation-design.md; benchmark spec2026-07-14-flavor-ablation-benchmark-design.md; plans2026-07-14-{mode-rename-migration,phase2-alternate-construction,phase4-flavor-ablation}.md; resultsbenchmarks/results/alternate-base/+docs/benchmarks/alternate-base-result.md; related in-flight #113/#114/#115; auto-memoryalternate-construction-init.🤖 Generated with Claude Code