I3366 — The economics calculator decides a binary paired outcome by an exact task-level test, intervals a continuous paired difference by task-clustered bootstrap, and turns either into one verdict

○PŘIPRAVENO vlna 0 · p1 · profil implementation · bezpečné souběžně

Part of a-registered-corpus-judges-majordomus — The registered corpus judges the same agent with and without Majordomus, by an exact task-level test on accepted results, and the verdict is published with its losses.

Cíl

Add to apps/majordomus-cli/src/economics/stats.rs pure seeded functions: an exact task-level test for a binary paired outcome (per-task mean difference of accepted share, a sign-flip permutation test over tasks, exact when the task count allows enumeration), its minimum detectable difference for a given task count and level, a percentile bootstrap of the mean paired difference resampling whole tasks for continuous outcomes, and one Verdict enum (favourable, unfavourable, inconclusive) with the declared better direction. All are deterministic for a seed, independent of input order, drop non-finite values, and return no result below min_n or with fewer than two clusters, as bootstrap_median_clustered does.

Proč

T2 of the owner's report of 2026-10-19 asks for a with/without comparison that says inconclusive when the sample cannot decide. The critique found that a percentile bootstrap over 20 task clusters of mostly-zero binary differences under-covers, and that the plan had two verdict enums. One exact test for the primary outcome and one enum, in the one calculator ADR 0082 mandates, answer both.

Aktuální stav

stats.rs:37 reduction returns None when the control is zero; stats.rs:182 and :260 compute intervals of a median only; model.rs:1186 EconomicsMetricStatus holds no direction verdict.

Cílový stav

stats.rs exposes the test, the MDE, the clustered mean-difference interval and Verdict, each with a doc test.

Rozsah

• apps/majordomus-cli/src/economics/stats.rs

Mimo rozsah

• Wiring into summarize (I3371)
• A methodology change
• A new statistics dependency

Závislosti

Žádné. Tento úkol je kořenem grafu.

Co na tom čeká

• I3354✕BLOCKED A pure scorecard function computes each proof test's status, counted sample, effect and losses from committed records, and withholds a verdict until the registered sample is complete
• I3371✕BLOCKED Economics summary decides a registered suite's primary outcome by its registered test, reports secondary differences without a verdict word, and refuses typed figures about them

Kritéria přijetí

• A doc test shows the same clusters in another order give the same result
• A doc test shows a non-rejecting test is inconclusive and a rejecting one is favourable or unfavourable by direction
• A doc test shows fewer than two clusters give no result
• A doc test computes the MDE for 20 tasks at the methodology's level
• Each result names its method

Validace

• cargo test --manifest-path apps/majordomus-cli/Cargo.toml --lib economics::stats
• cargo test --manifest-path apps/majordomus-cli/Cargo.toml --doc economics::stats

Požadované důkazy

• test_exact_paired_test
• test_interval_verdict

Důkazy

Nic nezaznamenáno. Za každým tokenem výše musí stát příkaz nebo artefakt, než lze tento úkol dokončit; vyprávění se odmítá.

Časová osa

zahájeno

—

ověřeno

—

dokončeno

—

Tato tři pole, důkazy výše a stav závislostí jsou vše, z čeho se stav skládá. Neexistuje žádné pole stavu, které by s nimi mohlo být v rozporu.

Canonical record: .ai/repo/project/issues/I3366.yaml. Read it back with majordomus plan show I3366.