nils/jspace
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

protocol: principled exclusion note for the design-space x GSM8K matrix

Browse Source 
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
Nils
2026-07-15 21:03:38 +02:00
co-authored by Claude Fable 5
parent ed5455277b
commit 2cd1f37f5f
1 changed files with 9 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
results-loop/PROTOCOL_UNIFIED.md
+9
View File
@@ -336,3 +336,12 @@ levels — only seed means are.
(c) overall never beats k=0. If hard exceeds 15% or overall beats (c) overall never beats k=0. If hard exceeds 15% or overall beats
k=0, task interference in the mixed run was masking a real GSM k=0, task interference in the mixed run was masking a real GSM
capability — would reopen the GSM chapter. capability — would reopen the GSM chapter.
Scope note (item 17): the design-space arms of items 11-15 are NOT
crossed with GSM8K, deliberately. Exclusion by dominance: fidelity-
failing regimes (rec, parcae) cannot improve on a task MORE fidelity-
fragile than MBPP; architecture-failing (per-depth) and equivalent
(tied-alpha -> merge) and k-placement-only (randk) and same-family
(noise-s0, h2048) variants have no mechanism by which task change
could invert their MBPP verdict. Only the recipe family's best member
(this item) is informative on GSM8K.