docs(phase-29): SESSION-5 CHECKPOINT — full session-checkpoint block for a fresh session

Session-5 (crack-waves 1-4 + 2 tooling fixes + burndown + hindsight-study + Task-12
telemetry). 140/140 byte-identical, fleet 78.0% instr. NEXT: Task 13 (classifier +
autopsy) then Task 14 (gate_stage ladder + auto-R22). Written BEFORE the pause per
the new checkpoint-before-pause rule.
This commit is contained in:
Drew T
2026-07-20 23:52:06 -06:00
parent f61952bfde
commit e4e8ec5ca9
4 changed files with 1756 additions and 1755 deletions
+1719 -1743
View File
File diff suppressed because it is too large Load Diff
+6 -6
View File
@@ -2,11 +2,11 @@
> Generated by `tools/family_hseq.py` from the 134 overlay sigs + per-overlay src stubs. Ranked by TEMPLATABLE byte-weight (PURE+IMM members × nins × 4). The byte-gate is the arbiter.
**Fleet (overlays):** 88.1% fn / 78.0% instr / 66.5% distinct-code matched. Unmatched: 41,757 instances / 2,876,951 ins (23,363 distinct classes).
**Fleet (overlays):** 88.1% fn / 78.0% instr / 66.5% distinct-code matched. Unmatched: 41,751 instances / 2,876,589 ins (23,361 distinct classes).
**Tail cross-check (Phase-25 close):** 28,756 tail fns / 1,179,622 ins → 583 h_seq families ≥2, **165 substantial (nins≥80) / 692,494 ins**.
**Tail cross-check (Phase-25 close):** 28,754 tail fns / 1,179,549 ins → 583 h_seq families ≥2, **165 substantial (nins≥80) / 692,494 ins**.
**Full frontier (all unmatched by h_seq):** 2739 target families (≥2 members or a matched sibling) + 3787 singletons (Step-D residue). Substantial: **572 families / 1,578,048 templatable ins**, 67 with a matched sibling (zero-crack). Substantial member classes: 10,079 PURE · 40 IMM · 6 STRUCT-excluded.
**Full frontier (all unmatched by h_seq):** 2739 target families (≥2 members or a matched sibling) + 3787 singletons (Step-D residue). Substantial: **572 families / 1,577,844 templatable ins**, 67 with a matched sibling (zero-crack). Substantial member classes: 10,077 PURE · 40 IMM · 6 STRUCT-excluded.
## Top substantial families (by templatable byte-weight)
@@ -46,12 +46,12 @@
| 31 | 947 | 16 (16/0/0) | 6/16 | cross-address | PURE | 0 | Y | 0x8017c974 draft-ov077 | 15,152 |
| 32 | 105 | 138 (138/0/0) | 1/138 | per-location | PURE | 0 | · | 0x8012cc88 draft-ov077 | 14,490 |
| 33 | 105 | 138 (138/0/0) | 1/138 | per-location | PURE | 0 | · | 0x80169228 draft-ov077 | 14,490 |
| 34 | 105 | 137 (137/0/0) | 1/137 | per-location | PURE | 1 | · | 0x801749c8 matched-ov077 | 14,385 |
| 35 | 104 | 138 (138/0/0) | 1/138 | per-location | PURE | 0 | · | 0x80167714 draft-ov077 | 14,352 |
| 34 | 104 | 138 (138/0/0) | 1/138 | per-location | PURE | 0 | · | 0x80167714 draft-ov077 | 14,352 |
| 35 | 105 | 136 (136/0/0) | 1/136 | per-location | PURE | 2 | · | 0x801749c8 matched-ov077 | 14,280 |
| 36 | 101 | 138 (138/0/0) | 1/138 | per-location | PURE | 0 | · | 0x801463a0 draft-ov077 | 13,938 |
| 37 | 101 | 138 (138/0/0) | 1/138 | per-location | PURE | 0 | · | 0x80177940 draft-ov077 | 13,938 |
| 38 | 100 | 138 (138/0/0) | 1/138 | per-location | PURE | 0 | Y | 0x80135d20 draft-ov077 | 13,800 |
| 39 | 99 | 137 (137/0/0) | 1/137 | per-location | PURE | 1 | · | 0x80165ca0 matched-ov077 | 13,563 |
| 39 | 99 | 136 (136/0/0) | 1/136 | per-location | PURE | 2 | · | 0x80165ca0 matched-ov077 | 13,464 |
| 40 | 97 | 138 (138/0/0) | 1/138 | per-location | PURE | 0 | · | 0x8014cd80 draft-ov077 | 13,386 |
| 41 | 94 | 138 (138/0/0) | 1/138 | per-location | PURE | 0 | · | 0x8016b6bc draft-ov077 | 12,972 |
| 42 | 97 | 133 (133/0/0) | 1/133 | per-location | PURE | 5 | · | 0x8017b490 matched-ov077 | 12,901 |
+6 -6
View File
@@ -4,22 +4,22 @@
# cross-binary collapsible-byte leverage: docs/duplicates.cross.md.
# THREE progress metrics (all matter — see the labels):
FLEET fn-count byte-ident: 310910 / 353722 = 87.90% (REAL+LINKED+empties; FUNCTION-count, ×134-inflated — one crack counts per overlay)
FLEET instr-weighted : 10202973 / 13081451 = 78.0% (shipped .text across resident+138 overlays; the decomp.dev-DISPLAY number)
FLEET distinct-code(uniq): 3708567 / 5574674 = 66.5% (64082/87459 unique fns; the DISTINCT-RE number)
FLEET fn-count byte-ident: 310916 / 353722 = 87.90% (REAL+LINKED+empties; FUNCTION-count, ×134-inflated — one crack counts per overlay)
FLEET instr-weighted : 10203335 / 13081451 = 78.0% (shipped .text across resident+138 overlays; the decomp.dev-DISPLAY number)
FLEET distinct-code(uniq): 3708640 / 5574674 = 66.5% (64084/87459 unique fns; the DISTINCT-RE number)
MAIN game-code weighted : 436 / 60201 = 0.7% (Phase-27 T10; SEPARATE — LINKED-excluding Ghidra sig dated 2026-06-14, PROVISIONAL until a fresh/complete main sig; NOT folded into the fleet number)
FLEET REAL substantive : 309055 (of which dedup-shared 234299 via 1847 groups / 234343 instances)
FLEET REAL substantive : 309061 (of which dedup-shared 234299 via 1847 groups / 234343 instances)
FLEET LINKED PsyQ objs : 959
FLEET NON_MATCHING : 7 (0 in any default build — G4)
FLEET INCLUDE_ASM stubs : 42805
FLEET INCLUDE_ASM stubs : 42799
FLEET matchable : 353722
| binary | REAL | shared | LINKED | byte-ident | matchable | byte-ident % |
|---|---:|---:|---:|---:|---:|---:|
| main | 54 | 2 | 959 | 1055 | 2096 | 50.3% |
| resident | 129 | 0 | 0 | 131 | 145 | 90.3% |
| ov_SC01_000 | 2213 | 1705 | 0 | 2213 | 2403 | 92.1% |
| ov_SC01_000 | 2219 | 1705 | 0 | 2219 | 2403 | 92.3% |
| ov_SC01_001 | 2218 | 1705 | 0 | 2220 | 2466 | 90.0% |
| ov_SC01_004 | 2211 | 1696 | 0 | 2212 | 2414 | 91.6% |
| ov_SC01_005 | 2240 | 1718 | 0 | 2240 | 2503 | 89.5% |
+25
View File
@@ -631,3 +631,28 @@ conditional) · main-EXE/B9 + GLM/B6 + resident's 14 walls (P30) · behemoths B7
Task 14 (C+D — enrich `gate_stage`'s ladder with §57/§59 so more wins auto-integrate + grinder auto-R22 every N
wins). Then run the closed loop: improved permuter over the whole backlog → collect telemetry → extend ILS →
re-run → track the LLM-free fraction (burndown.py). Design substrate: docs/hindsight-study.md §7.**
> **🛑 SESSION-5 CHECKPOINT (2026-07-20) — safe to open a FRESH session here.** Tree clean (only db.*.gbf R23
> churn), **140/140 byte-identical** (last R22 clean-fleet at the crack-wave-4 verify + func_8017AE2C ×137;
> Task-8/12 tooling changes touch only matching-loop tools, no build/src output). tools-health OK (dedup 1846/0
> class). Main HEAD after this = the checkpoint commit. **Fleet 78.0% instr · 66.5% distinct-code · 87.9%
> fn-count** (remaining substantial frontier 572 families / 1.58M templatable ins).
> **THIS SESSION delivered (commits `commit:0736`..this):** (1) **crack-waves 1–4** — the non-MCP cached substantial
> crack-fuel is now DRAINED; crack-wave 4 = 6 -O2 cores ×1 (`commit:0766`), its ×138 propagation + 4 -O0 cores
> DEFERRED (integration/-O0 walls). (2) **2 tooling fixes** — `family_sweep --source` now honored + `jtbl_family_bank`
> span-fit auto-isolate → **recovered `func_8017AE2C` ×137** (`commit:0763`, R22 140/140). (3) **`tools/burndown.py`**
> (the ROI-close instrument, `commit:0764`). (4) **`docs/hindsight-study.md`** (`commit:0765`) — the optimal-decomp-ordering
> study for a future Fable roadmap pass; **§7 = the permuter-failure-autopsy design**. (5) **Task-12** (`commit:0768`) —
> structured failure telemetry NOW FLOWS (`masked_diff.structured_diff` + `match_one --json` + `backlog.residual`/
> `passes_tried` + `gate_stage` logs the residual per near/fail, verified end-to-end) + grinder durably saves the
> winning C to `.run/permuter-winners/` before banking.
> **THE SINGLE NEXT TASK (fresh session): Task 13 (A+B)** — build the deterministic residual→class classifier +
> the LLM-batch autopsy that routes each backlog plateau to missing-transform (extend `permuter_weights` pass→class
> map) / mis-classified (fix classifier) / seed-structural (one LLM seed) / genuine-wall (file w/ expiry). Then
> **Task 14 (C+D)** — enrich `gate_stage`'s ladder with §57/§59 so more wins auto-integrate + grinder auto-R22
> every N wins. Then run the closed loop (improved permuter over the whole backlog → collect telemetry → extend
> ILS → re-run → track the LLM-free fraction via `burndown.py`). **DESIGN SUBSTRATE: `docs/hindsight-study.md` §7 +
> Tasks 12–14.** Carried residuals: crack-wave-4's 6 -O2 ×138 propagation + 4 -O0 (needs the Task-14 ladder / -O0
> rollout); the permuter backlog (Task 10, 550 close-1..4 — the autopsy loop's input). **Effort: Max for the
> classifier/autopsy design (Task 13 is Tier-1 synthesis); prompt Ultracode only for a breadth backlog-sweep.**
> **Drew pushes all commits (R6/R20).**