Commit Graph
100 Commits
Author SHA1 Message Date
NilsandClaude Fable 5 3db6dd8fef MATRIX.md: full item 1-31 results matrix (arcs, positives, walls, open threads); overview PDF v3 updated with items 29-31 finals
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 21:24:13 +02:00
NilsandClaude Fable 5 7ac7f9651a item 31 scored: KV-memory flat (39.5 vs 39.1, p=1.0); all gates unmoved at -10 — vanishing-gradient init confound recorded; -3 rerun is the loose thread
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 21:04:46 +02:00
NilsandClaude Fable 5 96afac769e item 30 scored: readiness strongly decodable (AUC 0.80) but NOT recurrence-specific (FF 0.79); early-stop loses everywhere, oracle only +3.9 — head is instrumentation, not a stopping lever; extension/deferral gating stays live
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 20:04:06 +02:00
NilsandClaude Fable 5 64a20750bd item 29 complete: trajectory TF = adapter training signal for hybrid regimes (39.1, p=0.045), not an internalization mechanism (job 2 answer-only 15.6 < 19.1 plateau; FR term harmful)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 14:46:54 +02:00
NilsandClaude Fable 5 b18ffbd739 item 31 pre-registered (Nils's design): synthetic memory tokens — burst states → per-band-layer KV prefix via KVMemoryAdapter (in-place attention wrap, bit-exact disarmed, gated silent init); composed with frozen item-29 arm-1; +29 tf+fr in-flight note (30.5, FR term hurts)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 13:25:25 +02:00
NilsandClaude Fable 5 11604d0949 item 30 pre-registered (Nils's design): carried state as metacognitive signal — answer-readiness head on L30 at line boundaries, carry-vs-FF AUC as primary, theta sweep + oracle stop via item-20 LUT methodology
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 12:57:05 +02:00
NilsandClaude Fable 5 c7167d512f overview PDF v2: add the prior arc (items 1-20) — retrofit discovery, band-location/anchor ablations, adapter-class factorial, transfer ladder, GSM boundary, gate program
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 12:36:38 +02:00
NilsandClaude Fable 5 3e02c6e24e INTERNALIZATION_OVERVIEW.pdf: program overview items 21-29 (architecture, ladder+controls, microscopy, lens-supervision series, trajectory TF result, conclusions & open moves)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 12:33:29 +02:00
NilsandClaude Fable 5 add87cdd72 item 29 arm 1: FIRST SIGNIFICANT POSITIVE — 39.1 (p=0.045 paired), every bucket a d=1 record; ablation 8-8 p=1.0 reattributes the gain: trajectory TF is a training signal for the adapter, not an inference loop
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 12:24:18 +02:00
NilsandClaude Fable 5 f1e6a628eb item 29 pre-registered (Nils's design): trajectory teacher-forcing — 10 waypoint transitions supervised independently (T[i-1]→T[i]), TF and TF+FR arms; job 1 d=1 step-span, job 2 answer-only full-CoT span
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 10:34:44 +02:00
NilsandClaude Fable 5 deae500ad0 item 26 scored: staging supervision actively harmful (24.2 alone, 15.6 combined) — blanket pre-'=' forcing corrupts the board's just-in-time schedule; overnight program complete, items 25-28 all scored
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 07:18:09 +02:00
NilsandClaude Fable 5 1af6cb5e45 item 28 scored: distillation succeeded (cos 0.113→0.044), function didn't follow — 30.1 matched / 29.7 ablated, easy damaged to 48.3; state-side supervision 2x2 complete and uniformly null; read-side clamp is item 29 candidate
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 03:41:43 +02:00
NilsandClaude Fable 5 67f9c3091c item 27 scored: 34.0 best-in-series with zero pauses, but paired ns (burst 10-6 p=0.45; vs positional 44-38 p=0.58) — ceiling holds; pause tape confirmed ~worthless (ablation 32.4)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 02:12:54 +02:00
NilsandClaude Fable 5 6542f80339 item 28 job: fix eval tags to ts50
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 00:46:57 +02:00
NilsandClaude Fable 5 bbf8a02c6b item 28 pre-registered (Nils's variant): teacher-state distillation — frozen full-cot teacher's band-exit state at step end, cosine into burst s^10; λ amended 1.0→5.0 pre-run (smoke: baseline cos-dist 0.113)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 00:46:19 +02:00
NilsandClaude Fable 5 62ce30e557 item 25 closed (truncated): writing is not computing — lce 1.9 with 2:12 flat at 31.2 (log-only; eval json never written due to kill); λ=1.0 arm cancelled; item 27 promoted
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 00:25:32 +02:00
NilsandClaude Fable 5 44e814e78c item 27 pre-registered: zero-pause internal band looping — single M=10 in-place burst at prompt end, iteration-aligned lens targets, ii0 inference ablation; carry_steps gains inplace updates, trainer gains --inner-iters/--base-pauses
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-17 00:21:20 +02:00
NilsandClaude Fable 5 0cffce876b item 26 pre-registered: result-staging lens supervision at pre-'=' positions (no causal leakage — low loss requires computation); arms lg03 and lt03+lg03; item-25 in-flight note (lce 10.3→2.3)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 23:23:13 +02:00
NilsandClaude Fable 5 64abfe66f3 item 25 pre-registered: latent process supervision via differentiable lens readout — pause j trained to lens-encode deleted-step token j (λ=0.3/1.0 arms); carry_logits gains return_states
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 23:03:56 +02:00
NilsandClaude Fable 5 f31e6e7e30 item 24 closed (stopped by Nils): trainable band doesn't improve fit either; E2-L internalization line closed on all four axes; LoopLoRA k=0 bit-exactness validated in passing
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 22:55:10 +02:00
NilsandClaude Fable 5 fe89820e64 item 24 pre-registered: d=1 retry with loop-only band-LoRA r=16 (4.8M params, whole band, k=0 bit-exact); trainer/eval gain --bandlora; smoke-tested train+eval
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 21:44:01 +02:00
NilsandClaude Fable 5 7a141948fa item 23 scored: both control axes confirm — pp30 29.3 (within ±5 of 31.6, 3x pauses bought nothing), x600 no recovery; d=1 ceiling is structural, ladder chapter closed
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 20:08:54 +02:00
NilsandClaude Fable 5 46b5e1b802 whiteboard microscopy on hard(795)/drop(430) specimens: FF slips at the 3-term sum (155), carry re-expands and defers (165 ✓); boards show live continuation-plan vs premature digit-commit at identical prefixes
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 19:48:58 +02:00
NilsandClaude Fable 5 f143c67b3d probe_discount: single-prompt whiteboard microscopy (lens table + digit probs, carry vs FF control) on the 80/15% problem
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 19:14:23 +02:00
NilsandClaude Fable 5 001a4ca5f3 item 23 pre-registered: d=1 ceiling controls (x600 undertrain arm, pp30 pause-bandwidth arm, +-5pt decision rule); trainer gains --tag-suffix
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 16:27:54 +02:00
NilsandClaude Fable 5 7d60f37cf1 item 22 scored: ladder breaks at d=1 (57.4->31.6), plateaus ~19 at d=2/3 — 2x cold floor (d=3 vs base McNemar p=0.0025); latent loop trades easy reliability for hard/drop reach
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 15:29:42 +02:00
NilsandClaude Fable 5 4e744e7d94 26B-A4B lens mapped: 30 layers (not 48), same early-persist/terminal-motor family as E4B+31B; patched save delivered full regimes.pt incl. per-layer ignition; 5-scale figure complete
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 11:03:38 +02:00
NilsandClaude Fable 5 20f7014f5b item 22 pre-registered: E2-L rung B internalization ladder (front-first deletion, 10 pauses/step, warm-started d=1..3); trainer gains --drop-steps/--warm-start/--steps/--lr; smoke-tested 2 steps on Spark
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 10:13:01 +02:00
NilsandClaude Fable 5 272a7b1d1f 31B regimes parsed (early persist bump L7-16, motor only terminal — E2B signature absent, matches E4B); exp4_regimes.py takes explicit out path / defaults next to input jbar (fix pushed to node before 26B stage)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 09:54:52 +02:00
NilsandClaude Fable 5 34497b8835 item 21 McNemar scored: drop-bucket edge significant (2:6 p=0.0094, survives Bonferroni x4); overall A-vs-B ns; + session handoff, fig cleanup
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 09:49:21 +02:00
Nils 051e90e805 item 21: GSM carry-cot 57.4% (5x prior best); control isolates whiteboard to drop-bucket; E2-N/A2 planned 2026-07-16 09:40:23 +02:00
Nils 1618c206ae item 20 scored; item 21 (GSM carry-CoT + control) pre-registered and queued 2026-07-16 02:42:46 +02:00
NilsandClaude Fable 5 4b9e168838 item 20: gate threshold curve + oracle bound (probs pass, merge per-item LUT, offline sweep)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 02:03:12 +02:00
NilsandClaude Fable 5 74f04d124f node_bootstrap.sh v2: one-command node setup encoding every paid-for lesson (workspace-only, snapshot pinning, credential-aware sync, contract workers, graceful stop) + gpuq_presign for credential-less nodes
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 01:51:44 +02:00
NilsandClaude Fable 5 21908a0e33 E1c scored: easy routing solved (95.9% at 0.11 iters), hard recall regressed; threshold calibration = identified next knob
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 01:48:14 +02:00
NilsandClaude Fable 5 a643b4a146 E4B regime artifacts (registry row, diagnostics, scan log, updated figure)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 01:36:57 +02:00
NilsandClaude Fable 5 332f7f3622 E4B regime map (ckpt-salvaged, 150 prompts): no clear workspace signature — sensor L11-22, motor from L23, persistence bump absent; candidate band inside KV-shared zone
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 01:35:38 +02:00
NilsandClaude Fable 5 dec27a4017 gpuq worker: STOP sentinel for graceful drain (never kill mid-job again)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 01:21:00 +02:00
NilsandClaude Fable 5 550d5cbe56 gpuq data contract: declarative per-job in/out sync (pull inputs, push outputs every 120s + at exit), gpuq_sync.sh helper
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-16 01:17:33 +02:00
NilsandClaude Fable 5 684e793eef E1c: k*=0 routing + pre-loop halt target (item 19 scored, E1c pre-registered)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 23:51:44 +02:00
NilsandClaude Fable 5 f2a48ce338 E1b trainer: label-supervised halting head on frozen merge (item 19)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 23:43:37 +02:00
NilsandClaude Fable 5 dafbd8fd25 item 18 scored (uniform-depth collapse, CE depth-flatness mechanism); item 19 E1b pre-registered
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 23:42:31 +02:00
NilsandClaude Fable 5 ba95d2aa3d item 18 amendment: E1 arms moved to 4xH100 parallel + seed-1 arm added (pre-results)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 23:28:38 +02:00
NilsandClaude Fable 5 357a5add06 E1 halting-gate machinery (adapter, trainer, gated eval) + pre-registration item 18
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 23:00:39 +02:00
NilsandClaude Fable 5 5f58bc8aed PLAN_SELFPACED.md: v2 prototype plan for learned workspace-compute gating (E0 numbers grounded, E1-E3 pre-registered)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 22:50:35 +02:00
NilsandClaude Fable 5 600f965247 regimes figure: sensor/workspace/motor shading restored (rule-derived, matches original hand-shaded bands)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 22:09:09 +02:00
NilsandClaude Fable 5 dc43769118 fig_regimes.py: reproducible cross-model depth-regimes figure (E2B+12B filled, 3 scans pending)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 22:05:29 +02:00
NilsandClaude Fable 5 8187b79b50 track the E2B lens-regime figures (were gitignored, disk-only)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 22:02:42 +02:00
NilsandClaude Fable 5 3a0a6a96ae INDEX.md (task-oriented repo guide), REGIMES.json -> results/, phase diagram updated with full sweep (anchored family, seed means)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 21:52:26 +02:00
NilsandClaude Fable 5 5d681a57b5 REGIMES: 31B structure (60L, d=5376, no KV-sharing key found)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 21:48:42 +02:00
NilsandClaude Fable 5 8ebb326745 REGIMES.json: canonical per-model lens registry (bands, KV boundaries, pinned revisions)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 21:45:12 +02:00
NilsandClaude Fable 5 cb0f1d950c item 17 scored: GSM-only current recipe fails as predicted; GSM chapter closed
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 21:14:58 +02:00
NilsandClaude Fable 5 2cd1f37f5f protocol: principled exclusion note for the design-space x GSM8K matrix
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 21:03:38 +02:00
NilsandClaude Fable 5 ed5455277b pre-register item 17: GSM-only prompt-only arm (last missing cell of the GSM question)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 21:01:23 +02:00
NilsandClaude Fable 5 c97d9d9cda kcurves final: all 10 panels filled
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 20:57:45 +02:00
NilsandClaude Fable 5 d81afef488 items 16 + 15-closure scored: cross-task transfer toxic (task-locality confirmed 3-point); noise-s0 50%+ was a lucky seed
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 20:57:44 +02:00
NilsandClaude Fable 5 1e6473e1aa parcae seed 1: fidelity refutation replicates (easy ~71-73% both seeds)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 20:56:28 +02:00
NilsandClaude Fable 5 0f386ea29d fig_kcurves.py: restore original output filename
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 18:34:18 +02:00
NilsandClaude Fable 5 b6d54c2726 LESSONS: thermal hard-freeze pattern and diagnosis by exclusion
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 18:30:01 +02:00
NilsandClaude Fable 5 b17d7faea0 rename kcurves figure -> fig_kcurves2.png (cache-bust)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 18:00:07 +02:00
NilsandClaude Fable 5 873dc351a0 kcurves updated: noise-s0 and h2048 panels filled (both cross the distill line)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 17:56:04 +02:00
NilsandClaude Fable 5 cf9e38f858 h2048 outcome: per-depth exonerated (sharing >> time-variation at matched params); ceiling nudged upward
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 15:00:32 +02:00
NilsandClaude Fable 5 713fbdce76 randk + noise-s0 eval JSONs (landed pre-crash)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 14:15:26 +02:00
NilsandClaude Fable 5 f0e524cf68 noise-s0 exceeds prediction upward; seed arms queued and pre-registered
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 13:01:14 +02:00
NilsandClaude Fable 5 ebf0eb8f49 pre-register item 16: code->GSM8K cross-task transfer
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 12:54:58 +02:00
NilsandClaude Fable 5 b013ca27f1 kcurves: full design-space grid (10 panels, distill reference line, auto-fills pending arms)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 12:42:29 +02:00
NilsandClaude Fable 5 4455d4bb9d ladder figure: base vs FF vs loops vs distill (fig_loop_vs_ff)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 12:26:22 +02:00
NilsandClaude Fable 5 13643fa504 abstract rewritten: fold in regime sweep (two independent dials, B-tie isolation, ceiling survival, output-orbit)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 11:42:15 +02:00
NilsandClaude Fable 5 fb5fb13806 tied-alpha outcome: all predictions confirmed; free B causally isolated as fidelity culprit
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 04:13:11 +02:00
NilsandClaude Fable 5 0a5cd80dc1 halting probe: output-stable orbit, not state fixed point; no free ACT at state level; paper claims softened
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 03:29:26 +02:00
NilsandClaude Fable 5 8981cda31d phase diagram: add per-depth point (fidelity kept, gain depth-stranded)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 03:25:16 +02:00
NilsandClaude Fable 5 b53538e82c per-depth outcome scored (depth-stranded content, shared-tail rescue); kcurves updated with k=8
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 03:20:49 +02:00
NilsandClaude Fable 5 82cc1b85b8 depth-curve small multiples per regime (fig_kcurves)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 03:16:58 +02:00
NilsandClaude Fable 5 0e6d6adcb9 fidelity factorial arms (randk / noises0 / hidden-capacity) + pre-registration item 15
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 02:47:14 +02:00
NilsandClaude Fable 5 d39e02f4b9 parcae outcome scored: dynamics confirmed, fidelity refuted -- stability and fidelity are independent dials
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 02:38:51 +02:00
NilsandClaude Fable 5 16f4a057aa TiedAlphaAdapter: learned per-dim alpha with tied B (anchored by construction); pre-registration item 14
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 02:33:14 +02:00
NilsandClaude Fable 5 f370883e23 phase diagram: stability vs fidelity are independent dials (fig_phase)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 02:24:56 +02:00
NilsandClaude Fable 5 1076d57d96 rec arm outcome: rho->4.5 (norm-projected churn), prediction (a) confirmed through k=8; k16/32 cancelled
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 01:39:22 +02:00
NilsandClaude Fable 5 3477fb5da0 method: truncated-BPTT bias bound via rho(A) — contraction certifies tail-only gradients
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 01:08:58 +02:00
NilsandClaude Fable 5 d00f120f27 PerDepthAdapter (Bae-style per-iteration merges) + convergence-halting probe (free ACT); pre-registration item 13
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 01:07:01 +02:00
NilsandClaude Fable 5 f254b20b62 ParcaeAdapter: rho(A)<1 by construction (ZOH negative-diag), rho logging in rec arms, pre-registration item 12
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 00:53:34 +02:00
NilsandClaude Fable 5 d2da8044c3 RecurrentAdapter arm: Huginn-regime retrofit (learned A/B, noise h0, randomized depth) + pre-registration item 11
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 00:49:44 +02:00
NilsandClaude Fable 5 0fd93cb328 n=500 controls: paired net-effect significant (loop vs untrained merge 17-4, p=0.007); ladder and net accounting finalized
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 20:08:57 +02:00
NilsandClaude Fable 5 1d4cffd6ad integrate LCB dissociation (untrained merge wins far-transfer, p=0.001 vs trained loop), capability panel (no MC damage), L23 exit completes sweep
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 19:44:07 +02:00
NilsandClaude Fable 5 caef95f10f budget-CoT per-item: paired ties with latent arms confirmed (p>=0.69)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 17:29:56 +02:00
NilsandClaude Fable 5 2ce646d175 best-of-3 oracle/deployable split: realistic selector loses the overall edge (55.0/27.3 vs oracle 57.8/34.5); paper economics rewritten
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 17:16:00 +02:00
NilsandClaude Fable 5 e5fc453005 pin gemma-4 model revisions (upstream 12B template regression: thought channel -> empty generations)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 17:13:35 +02:00
NilsandClaude Fable 5 378bb36b8c node_setup: retry+timeout around model downloads (xet mid-transfer stalls)
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 16:56:17 +02:00
NilsandClaude Fable 5 7821f304f8 LiveCodeBench transfer harness: raw-jsonl loader (script datasets dead), stdin judge, newest-window selection, plan labeling
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 16:48:12 +02:00
NilsandClaude Fable 5 dcd0b0b2dc HumanEval transfer: trained-vs-untrained-merge paired test (p=0.80, n.s.) -- transfer gain is the merge itself, not trained content
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 16:30:36 +02:00
NilsandClaude Fable 5 d1bafc2d4d revision per review: seed means in headlines, net accounting vs untrained merge, bucket definition up front, GSM12B n.s. (p=0.86), law->regularity, norm spec, compute appendix, public repo URL
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 16:05:40 +02:00
NilsandClaude Fable 5 01fd272028 panel: chat-template MC scoring (raw scoring is chance on -it model), parquet dataset mirrors, incremental dump
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 16:00:17 +02:00
NilsandClaude Fable 5 87308cfb0b score outcomes against pre-registered protocol items 1-10
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 15:48:36 +02:00
NilsandClaude Fable 5 55665ce251 CPU endgame: stats pass (Wilson/McNemar/pooled hard), final figures, PAPER.md rewrite around amortizable-content thesis
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 15:46:58 +02:00
NilsandClaude Fable 5 6a954bd3e4 MC capability panel: ARC/WinoGrande/HellaSwag/MMLU with prompt-loop
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 13:58:57 +02:00
NilsandClaude Fable 5 b461970c9a warm-start flag (stacking arm), adaptive flags for Blocksworld
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 13:02:46 +02:00
NilsandClaude Fable 5 aa3e11fb20 gpuq worker: tee job output to pane for live viewing
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 13:00:38 +02:00
NilsandClaude Fable 5 f2cbce5a03 related_work: log 12b_adaptive outcome as confirmation of the anchoring account
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 12:57:08 +02:00
NilsandClaude Fable 5 e152a91c05 parse_known_args: module-level parser must tolerate importers' argv
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 12:50:45 +02:00
NilsandClaude Fable 5 cd8e94dda5 gpuq: idle-time class dispatcher (single-writer, race-free) + docs
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 12:47:23 +02:00