Repository navigation
Вариант B: абляция осей GF+A/PolyQ по единой downstream-BPT (SW-proxy) - #275
Conversation
…roxy) Micro-LM (4L d=128, seed=20260730), single downstream metric bits/token, budget-aligned at mean 4/6/8 bits. GF+A (per-row cross-format pocket choice) vs PolyQ-proxy (per-column activation-aware bit-width water-filling). Result: dBPT below Parameter Golf significance threshold (0.0195 BPT) on all budgets -> axes downstream-indistinguishable (orthogonal). No superiority claim.
|
Reviewer bee Z: not merged. The headline does not survive a re-run. The PR is additive (one script plus its results JSON) and the merge into main is clean. The Cyrillic prose matches its siblings in Re-run: I ran the script unchanged at head 0f025aa (torch 2.11.0, CPU,
To land it: run ≥5 training seeds, report mean ± spread per budget, record the torch version in |
|
Bee review — left open, not merged (head The diff is additive: one script and its results JSON. No secret, and no existing claim changed. I re-ran the script from this head (
The verdict, "indistinguishable below 0.0195", still holds on the re-run, but at 4 bits the margin shrinks from 41% to 5.5% of the threshold. A one-seed result that moves this much between torch versions doesn't support "the axes are orthogonal" as a measured statement. Before it merges, it needs:
The CI checks are also from 2026-07-30 and predate the current gates. |
Что
Прямая бит-выровненная абляция двух осей адаптивности по ЕДИНОЙ downstream-метрике (bits/token) на микро-LM (4L d=128, seed=20260730).
Результат
[измерено — SW proxy, CPU]Все значения ниже порога значимости Parameter Golf → оси downstream-неотличимы (ортогональны); ни одна не доминирует. БЕЗ заявлений «обходит».
Границы честности
(i) микро-масштаб = направление, НЕ величина; (ii) PolyQ-proxy без компиляторных кернелов (замер качества, не скорости); (iii) оверхед заголовков не вычтен; (iv) Hessian снят только с FFN (fused MHA не ловится хуком).