Přeskočit na obsah

Tato stránka byla automaticky přeložena z angličtiny, jediného jazyka, ve kterém se tento web píše. Číst originál.

I3298 — The benchmark declares one arm per mechanism and per agent topology, and a short-task hypothesis beside the long-work one

Extend .ai/repo/benchmarks/economics/methodology.yaml with treatment arms that isolate context compilation, handover, skills and single-agent versus architect-plus-workers, and record the hypothesis that a short isolated task gains little or loses, so a later total can be explained by parts.

PŘIPRAVENO vlna 0 · p3 · profil implementation · bezpečné paralelně

Part of every-sessions-usage-is-observed — What every AI session consumed is observed from the provider, attributed to the work it served, and never estimated into a fact.

Připraveno. Všechny závislosti jsou hotové, takže majordomus plan start I3298 bude přijato.

Cíl

Extend .ai/repo/benchmarks/economics/methodology.yaml with treatment arms that isolate context compilation, handover, skills and single-agent versus architect-plus-workers, and record the hypothesis that a short isolated task gains little or loses, so a later total can be explained by parts.

Proč

The only declared hypothesis is long-running-work (30-70 percent, untested); the owner asked whether one agent or fan-out is cheaper, and the repository's answer is measurement through ADR 0082, not a second economics subsystem. On 2026-10-18 `majordomus economics summary` (master 707a04c) reports 0 valid pairs of the 30 the rule asks for. It is ADR 0082 benchmark design, so it serves the intent's savings-are-measured-by-arm, the proof of the statement's 'saves', rather than no-estimate-shown-as-spend-or-saving; it stays bound to this intent because milestone cost-per-accepted-outcome belongs to no intent. It extends milestone cost-per-accepted-outcome. Sources: chatgpt-majordomus:c162#2, chatgpt-majordomus:c162#4, chatgpt-majordomus:c213#2, chatgpt-majordomus:c252#5, chatgpt-majordomus:c162#3, chatgpt-majordomus:c231#3, chatgpt-majordomus:c046#5, chatgpt-majordomus:c286#12, chatgpt-majordomus:c278#4.

Aktuální stav

`majordomus economics summary` on master 707a04c (2026-10-18): suite context 9 runs, suite pilot 0 runs with 14 pairs declared; one hypothesis.

Cílový stav

Arms and hypotheses declared as data, validated, and listed by economics summary as unmeasured until run.

Rozsah

  • apps/majordomus-cli/src/economics
  • docs/ECONOMICS.md
  • .ai/repo/benchmarks/economics/methodology.yaml
  • .ai/repo/benchmarks/economics/README.md
  • apps/majordomus-cli/tests/economics.rs
  • docs/generated/economics.json
  • docs/generated/economics.md

Mimo rozsah

  • Running the live suite (spends provider usage; owner decision)

Závislosti

Žádné. Tento úkol je kořenem grafu.

Co na tom čeká

Kritéria přijetí

  • economics summary lists every arm and hypothesis with status untested
  • An arm without a declared baseline is refused

Validace

  • majordomus economics summary
  • cargo test --manifest-path apps/majordomus-cli/Cargo.toml --test economics

Požadované důkazy

  • case_mechanism_arms_are_declared

Důkazy

Nic nezaznamenáno. Za každým tokenem výše musí stát příkaz nebo artefakt, než lze tento úkol dokončit; vyprávění se odmítá.

Časová osa

zahájeno
—
ověřeno
—
dokončeno
—

Tato tři pole, důkazy výše a stav závislostí jsou vše, z čeho se stav skládá. Neexistuje žádné pole stavu, které by s nimi mohlo být v rozporu.

Canonical record: .ai/repo/project/issues/I3298.yaml. Read it back with majordomus plan show I3298.

Prohledává názvy a popisy všech stránek, které tento web publikuje.