items 16 + 15-closure scored: cross-task transfer toxic (task-locality confirmed 3-point); noise-s0 50%+ was a lucky seed
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
@@ -303,3 +303,24 @@ the fidelity refutation replicates. easy 70.5/73.0/72.1 at k=2/4/8
|
||||
ordinary seed spread at n=28). Two-seed conclusion: contraction-with-
|
||||
free-B loses ~17 points of easy items regardless of seed; the phase
|
||||
diagram's Parcae point is solid.
|
||||
|
||||
--- Outcome, item 16 (code->GSM8K transfer, scored 2026-07-15): ALL THREE
|
||||
PREDICTIONS CONFIRMED, emphatically. MBPP-trained loop on GSM8K: hard
|
||||
0.8-1.6% at every k (prediction a: ~0 gain — plan content is task-local);
|
||||
easy 93.1 -> 27.6-44.8% (prediction b: damaged, in fact WORSE than the
|
||||
GSM-trained merge's 48%); overall strictly below k=0 at every k>0
|
||||
(prediction c). noise-s0 variant identical (easy 34.5, hard 1.6). The
|
||||
transfer-distance ladder ends cleanly: near (HumanEval) tie, far-code
|
||||
(LCB) trained-hurts, cross-task (GSM8K) trained-content actively toxic
|
||||
while gaining nothing. Task-locality of the learned content is now a
|
||||
three-point monotone result.
|
||||
|
||||
--- Closure of the item-15b/15c "ceiling nudged upward" question
|
||||
(2026-07-15, after ns seeds): LUCKY SEED, per the pre-registered rule.
|
||||
noise-s0 hard(k=4) across seeds: 53.6 / 39.3 / 35.7 -> seed mean 42.9,
|
||||
inside the 37-46 band. Fidelity across seeds intact (easy 90.2-94.3 —
|
||||
the factorial conclusion is seed-robust); the 50-54% cells (ns seed 0,
|
||||
h2048 single seed) were upper-tail draws of the same distribution the
|
||||
merge's 46.4 came from. No recipe amendment; the abstract's original
|
||||
"same level within noise" framing stands; single-cell records are not
|
||||
levels — only seed means are.
|
||||
|
||||
Reference in New Issue
Block a user