Commit Graph

404 Commits

Author SHA1 Message Date
Drew T a95c19447d feat(decomp): bulk_harvest — +58 fns across 39 binaries, 1 propagated (fleet 64.53%) 2026-07-01 10:44:57 -06:00
Drew T ecf01e32a3 feat(decomp): bulk_harvest — +58 fns across 38 binaries, 0 propagated (fleet 64.51%) 2026-07-01 09:59:28 -06:00
Drew T ef27dedb83 feat(decomp): bulk_harvest — +51 fns across 36 binaries, 2 propagated (fleet 64.49%) 2026-07-01 09:21:07 -06:00
Drew T eb696bf35d feat(decomp): bulk_harvest — +49 fns across 41 binaries, 0 propagated (fleet 64.48%) 2026-07-01 08:45:39 -06:00
Drew T 416b3f37a6 feat(decomp): bulk_harvest — +56 fns across 46 binaries, 2 propagated (fleet 64.46%) 2026-07-01 08:05:11 -06:00
Drew T 67a0718148 feat(decomp): bulk_harvest — +54 fns across 48 binaries, 3 propagated (fleet 64.45%) 2026-07-01 07:23:56 -06:00
Drew T 00064af879 feat(decomp): bulk_harvest — +47 fns across 43 binaries, 1 propagated (fleet 64.43%) 2026-07-01 06:46:07 -06:00
Drew T 7e9dd8f03a feat(decomp): bulk_harvest — +53 fns across 48 binaries, 2 propagated (fleet 64.42%) 2026-07-01 06:05:00 -06:00
Drew T c1afac9f76 feat(decomp): bulk_harvest — +70 fns across 58 binaries, 2 propagated (fleet 64.4%) 2026-07-01 05:17:55 -06:00
Drew T f55052e2b5 feat(decomp): bulk_harvest — +64 fns across 55 binaries, 1 propagated (fleet 64.38%) 2026-07-01 04:39:21 -06:00
Drew T b4693430a0 feat(decomp): bulk_harvest — +66 fns across 55 binaries, 1 propagated (fleet 64.36%) 2026-07-01 04:00:29 -06:00
Drew T 3d90707d41 feat(decomp): bulk_harvest — +69 fns across 62 binaries, 1 propagated (fleet 64.34%) 2026-07-01 03:22:46 -06:00
Drew T 7fa2134326 feat(decomp): bulk_harvest — +75 fns across 64 binaries, 0 propagated (fleet 64.32%) 2026-07-01 02:41:58 -06:00
Drew T d2d15c9e41 feat(decomp): bulk_harvest — +78 fns across 69 binaries, 1 propagated (fleet 64.3%) 2026-07-01 02:03:59 -06:00
Drew T 7efe5ce10d feat(decomp): bulk_harvest — +72 fns across 63 binaries, 5 propagated (fleet 64.28%) 2026-07-01 01:29:20 -06:00
Drew T 95586a6751 feat(decomp): bulk_harvest — +69 fns across 67 binaries, 6 propagated (fleet 64.26%) 2026-07-01 00:54:27 -06:00
Drew T 8dc42f12b5 docs(gen3): parking-lot for asset export/Unity + verified mesh-state survey
- docs/gen3-parking-lot.md (NEW): town mesh/texture + Musashi->Unity export ideas, PARKED (Gen3).
  Verified survey (read-only, 2026-07-01): BFM uses the libgs TMD model path — real jal
  GsMapModelingData + GsLinkObject5 call sites (EXE 0x8001C2xx-0x8001C9xx model subsystem +
  ov_SC02_005); render = stock libgpu; no libgs sort/anim calls (custom anim -> Musashi harder);
  textures via VRAM rip + type-0 'graphics' blobs; no exporter tooling yet. Decisive next probes listed.
- CURRENT_PHASE.md: T10 done + T10.6 campaign in-flight + T10.7 OpenRouter-next notes (crash-recovery)
2026-07-01 00:52:23 -06:00
Drew T 6eee685acc feat(decomp): bulk_harvest — +81 fns across 74 binaries, 18 propagated (fleet 64.23%) 2026-07-01 00:14:55 -06:00
Drew T 337e120c2a feat(decomp): bulk_harvest — +4 fns across 4 binaries, 0 propagated (fleet 64.21%) 2026-06-30 23:39:18 -06:00
Drew T 5ba5500f82 feat(decomp): bulk_harvest — +4 fns across 4 binaries, 1 propagated (fleet 64.21%) 2026-06-30 23:37:38 -06:00
Drew T 35bc7c3873 feat(phase-23): bulk_harvest --cycles campaign mode (resumable, per-cycle commit, dry/STOP-aware) 2026-06-30 23:34:31 -06:00
Drew T 265e930f65 chore(phase-23): regenerate backlog + fleet digests (T10 banks) 2026-06-30 23:23:04 -06:00
Drew T e9f199530e docs(phase-23): T10 harvester built + measured — 65% bank-rate, parallel gate ~75x, vLLM justified
- gen2-mips-matching-model.md: T10 RESULT (bulk_harvest phase-separation; 52/80=65% on fresh
  SC03 <=15-ins; gate 0.4s/fn/8w vs ~30s/fn serial; drafting now the sole bottleneck -> vLLM)
- SETUP.md: bulk_harvest.py inventory row + gate_stage/harvest_verify parallel-safe params (R21)
- CURRENT_PHASE.md: T10 done (built+measured), T10.5 vLLM split out as Drew-gated; progress log
2026-06-30 23:22:46 -06:00
Drew T aa2af72f0c feat(decomp): bulk_harvest — +52 fns across 40 binaries, 12 propagated (fleet 64.2%) 2026-06-30 23:17:02 -06:00
Drew T a36c5ded0a feat(decomp): bulk_harvest — +9 fns across 9 binaries, 12 propagated (fleet 64.19%) 2026-06-30 22:52:53 -06:00
Drew T c5cca1c6d4 feat(phase-23): T10 tooling — parallel-safe gate spine + bulk_harvest
- gate_stage.run_gate: optional lock_path (per-binary lock), verified_out/failed_out
  (per-worker harvest scratch), compute_fleet toggle — all default to today's behavior,
  so grinder/orchestrator/lora_grind are byte-unaffected
- harvest_verify: --verified-out/--failed-out (per-worker result paths for parallel gating)
- bulk_harvest.py (NEW): phase-separated saturation factory — bulk-draft (GPU) ->
  ProcessPool parallel-gate over distinct binaries (build/<bin>/** isolated) ->
  dedupe-once + one commit; round-robin fuel spread; whole-binary byte-gate stays the
  sole arbiter (G3/P9); on-demand/bounded (STOP sentinel); lora_grind kept as fallback
2026-06-30 22:48:26 -06:00
Drew T 69189570da docs(phase-23): session close — handoff CURRENT_PHASE for the harvester-factory build (T10)
- fleet 64.19%, 136/136 byte-clean; injection lever +0.34% banked this session
- ★ NEXT TASK rewritten: build phase-separated + vLLM batched harvester (Drew option c)
  with the full fuel map (~4,597 unique ≤15 funcs, SC03=12,497), the throughput finding
  (~48s/func + GPU-idle-during-gate), the applied fixes, and the parked items
- supersedes the stale reach≥2/14B plan; 14B-for-giants now AFTER ≤15 saturation
2026-06-30 15:59:47 -06:00
Drew T 7dbdd1ce47 perf(phase-23): cap api_draft max_tokens 4096->512 (no-stop ramble) + capture saturation/throughput findings
- the model rambled to 4096 tokens on no-stop-token drafts (~80-130s each); a
  ≤15-ins fn's C is ~100-300 toks, so 512 truncates the ramblers (gate-rejected anyway)
- CURRENT_PHASE: ≤15 band NOT saturated (~4,597 unique / 4,087 untried, SC03=12,497);
  drafting ~15-18s/func serial is the throughput wall; architecture = phase-separate +
  parallel-gate + vLLM batched serving (the real GPU lever); fresh bank-rate still TBD
2026-06-30 15:52:04 -06:00
Drew T f72aa74bd4 feat(phase-23): lora-grind gate — +22 fns x0 propagated (fleet 64.19%) 2026-06-30 15:49:45 -06:00
Drew T 5a984886af perf(phase-23): lora_grind computes progress.py --fleet only on propagate sweeps (was every batch, ~14s overhead dominating small batches) 2026-06-30 15:32:56 -06:00
Drew T eb3b18efcc feat(phase-23): lora_grind --min-nins (skip the saturated small band for a fresh-band pass) 2026-06-30 15:05:25 -06:00
Drew T 72dabb470c feat(phase-23): broad v3 harvest (48 banks) + final propagate sweep; docs
- bounded broad v3 harvest banked 48 small fns across SC01/SC02 overlays (mostly
  reach-1 ×1; fleet 64.16->64.18%), final propagate sweep +4 groups (1687->1691)
- check-all 136/136 byte-identical, dedup-check 0 failed
- docs/community-matching-model-plan.md (publishing the drafter — parked)
- docs/sister-decomps.md (VS cross-project plan + idiom-discovery rationale — parked)
- CURRENT_PHASE.md: 2026-07-01 session arc (injection lever +0.34%, the type-walled-14
  deferred, the saturation-campaign plan)
2026-06-30 13:54:53 -06:00
Drew T 71e686ad2e feat(phase-23): lora-grind gate — +4 fns x0 propagated (fleet 64.18%) 2026-06-30 13:50:51 -06:00
Drew T 7b1b68cdad feat(phase-23): lora-grind gate — +6 fns x0 propagated (fleet 64.18%) 2026-06-30 13:37:06 -06:00
Drew T 613df42ed0 feat(phase-23): lora-grind gate — +7 fns x0 propagated (fleet 64.18%) 2026-06-30 13:24:13 -06:00
Drew T 7792566bfd feat(phase-23): lora-grind gate — +7 fns x0 propagated (fleet 64.17%) 2026-06-30 13:11:19 -06:00
Drew T 39ccbee46c feat(phase-23): lora-grind gate — +3 fns x0 propagated (fleet 64.17%) 2026-06-30 12:58:40 -06:00
Drew T 15a456302e feat(phase-23): lora-grind gate — +12 fns x0 propagated (fleet 64.17%) 2026-06-30 12:46:47 -06:00
Drew T 9a10f493e8 feat(phase-23): lora-grind gate — +3 fns x0 propagated (fleet 64.17%) 2026-06-30 12:34:34 -06:00
Drew T 6c02c82614 feat(phase-23): lora-grind gate — +4 fns x0 propagated (fleet 64.17%) 2026-06-30 12:00:05 -06:00
Drew T 9a0345aed2 feat(phase-23): lora-grind gate — +2 fns x0 propagated (fleet 64.17%) 2026-06-30 11:40:32 -06:00
Drew T fdd3bf3c28 feat(phase-23): inject-extern lever on _a.c — +3 reach-134 fns (fleet 64.09→64.16%)
- inject_capped_externs --src-file ov_SC01_077_a.c freed 3 more reach-134 fns
  (0x8012A018/0x8012BA10/0x8012FDA8); 077 byte-identical; dedup_propagate
  registered 2 clean ×134 groups + 2 ×133 (ov_SC01_000 straggler kept ×1)
- 1685->1687 shared groups, check-all 136/136, dedup-check 0 failed
- injection lever total this session: 63.82% -> 64.16% (+0.34%, ~0 LLM tokens)
2026-06-30 11:20:13 -06:00
Drew T 205fc202e9 feat(phase-23): macro-extern-injection lever — 8 reach-134 fns freed ×134 (fleet 63.82→64.09%)
- tools/inject_capped_externs.py (new): source each propagation-capped reach≥2
  inline match's externs from ov_SC01_077's own file-scope decls, inject them
  block-scope so the lifted macro is self-contained (the Phase-20-backlog
  macro-extern-injection lever; byte-neutral, fail-safe via compiles_standalone)
- 8 reach-134 fns freed from ov_SC01_077.c, 077 byte-identical; dedup_propagate
  --auto-from registered 7 new shared groups ×134 (1678->1685), check-all 136/136
- the LLM reach≥2 measurement run already banked +7 (v3 banks reach≥2: 6/15 in 005
  vs v2's 0/15) — committed earlier (commit:0359, commit:0360)
- cookbook §28d + SETUP tooling inventory (R16/R21/R30)
- fleet 63.82% -> 64.09%, 0 NON_MATCHING, dedup-check 1685/0 failed
2026-06-30 11:15:11 -06:00
Drew T ecc95da031 chore(phase-23): regen reports after the reach≥2 measurement run 2026-06-30 11:02:19 -06:00
Drew T 708f5971fc feat(phase-23): lora-grind gate — +1 fns x0 propagated (fleet 63.82%) 2026-06-30 10:43:32 -06:00
Drew T 1b24f21a27 feat(phase-23): lora-grind gate — +6 fns x0 propagated (fleet 63.82%) 2026-06-30 10:36:23 -06:00
Drew T d9f4dc86e4 docs(phase-23): lock the decided next-session sequence — A (reach≥2 with v3) then B (14B)
Drew's call: the fresh session starts with Path A (lora_grind --min-reach 2 + v3 → setter banks
propagate ×134 + dedup-collapse + flywheel), then Path B (corpus-v4 + a cloud Qwen2.5-Coder-14B
for the giant band). Rationale: A is $0/immediate and its banks enrich B's training corpus.
2026-06-30 10:08:51 -06:00
Drew T 060334d744 docs(phase-23): CURRENT_PHASE up to date — v3 + local serving live; T8/T9 done; next = reach≥2 (v3) or 14B
Refresh the resume blocks for a fresh session: state (v3 current model, serve via
serve_local.py — LM Studio ejected, fleet 63.82%); T8 corpus-v3 + T9 operating-loop marked
DONE; NEXT = two paths (A: lora_grind --min-reach 2 with v3 → setter banks propagate ×134 +
dedup-collapse; B: corpus-v4 + a cloud 14B for the giant band, gate now satisfied); serve+run
command updated to serve_local.py + v3; Decisions/Guardrails/Reuse updated off LM Studio.
2026-06-30 09:45:32 -06:00
Drew T 76054ef383 chore(phase-23): gitignore the unused .venv-serve (llama-cpp SIGILLs; serve via .venv-train) 2026-06-30 07:37:10 -06:00
Drew T 1eadbc73e9 docs(phase-23): 8-hour autonomous run — corpus-v3 + v3 + local serving; fleet 63.67->63.82%
The run (Drew away): built tools/serve_local.py (Unsloth GPU serving, replaces ejected LM
Studio); the prompt fix (translate-every-instruction, 0/3->2/3 on the empty-leaf class);
corpus-v3 (mine the 1623 engine_core.h DEFINE_func macros + struct types: 1312->2891 pairs,
2534+291 trainable); v3 trained (loss 1.275->0.085) eval 23/40 (57.5%); v3 production batch
banked ~352 fns + 45 new shared groups -> fleet 63.67->63.82% (+502 byte-identical), 136/136
byte-clean, 25 auto-commits, $0. v3 banks the empty-leaf/setter class v2 couldn't.

- docs/gen2-mips-matching-model.md: corpus-v3 + serving + prompt-fix + v3 eval + harvest
- docs/SETUP.md: LLM matching tier added to the Tooling inventory (R21)
- phase-ends/CURRENT_PHASE.md: run progress + next levers (reach>=2 targeting, dedup-collapse)
2026-06-30 07:36:33 -06:00