Skip to content

Majordomus will state a total-token change only from matched, verified runs that meet the methodology's publication rule

**Planned.** Majordomus will state how much it changes total token consumption only when matched live runs, with and without it, judged by the same hidden acceptance tests, meet the methodology's publication rule. Until then, the statement every surface shows is that no verified total-token-savings claim is available, beside whatever preliminary observation the runs support.

declared statusdeclared status: planned Specified and not implemented. Named so the omission is visible.

recorded evidencerecorded evidence: no test Not judged: only a guaranteed claim is held to a recorded run. how evidence is recorded

The benchmark, its runner and its calculator exist; what is missing is enough evidence. The generated report states what the recorded runs show and why no claim follows yet.

What it means

Planned. Majordomus will state how much it changes total token consumption only when matched live runs, with and without it, judged by the same hidden acceptance tests, meet the methodology's publication rule. Until then, the statement every surface shows is that no verified total-token-savings claim is available, beside whatever preliminary observation the runs support.

How it works

The benchmark exists and runs: majordomus economics run executes each task of the corpus in a real coding harness, once in the fixture as a competent team keeps it and once with Majordomus installed, records the provider's usage and the gate verdicts, and the calculator pairs the runs, derives the per-pair reduction, its distribution and a seeded bootstrap interval, and checks the publication rule. What is missing is evidence: enough valid pairs, across enough task categories, with enough repetitions.

How to see it

majordomus economics summary
majordomus economics explain effective_token_reduction

What it does not cover

It is not a claim, and says so. The hypotheses the benchmark was built to test are recorded as hypotheses, never as results.

Why it exists

A token-saving percentage is the most quotable thing this project could publish and the easiest to invent. This page is where the claim will stand once the evidence exists, and it cannot move to guaranteed before then: economics check refuses it.

Detail rendered from docs/claims/token-savings-measured.md.

From the statement to the proof

  1. 1 · the public statement

    Majordomus will state a total-token change only from matched, verified runs that meet the methodology's publication rule

    Made on Economics.

  2. 2 · the canonical claim

    token-savings-measureddeclared status: planned in docs/CLAIMS.yaml

    Defined in read it on this site · docs/ECONOMICS.md

  3. 3 · the implementation

    Nothing implements it yet.

  4. 4 · the test and the scenarios

    No executable evidence linked: the claim names no test, and no use case executes it.

  5. 5 · the recorded runs

    recorded evidence: no test how evidence is recorded

Searches the titles and descriptions of every page this site publishes.