Skip to content

A quantity about tokens, context or cost typed into hand-written prose is refused, and a claim bound to a metric cannot be guaranteed while its evidence does not stand

No number about tokens, context or cost reaches a reader unless recorded evidence produced it. Hand-written prose that states one is refused, and a claim bound to a metric cannot be guaranteed while that metric's evidence does not stand.

declared statusdeclared status: guaranteed Declared deterministic and blocking, implemented, and naming the behavioural test that is to prove it. Whether a recorded run supports it is the evidence verdict, shown beside it.

recorded evidencerecorded evidence: not run Declared guaranteed, and not supported by a recorded run: the test is named, and no passing run of the current inputs is recorded. how evidence is recorded

`majordomus economics check` exits 10 naming every finding; the numbers readers see are generated from recorded runs into docs/generated/economics.* and the site's data.

What it means

No number about tokens, context or cost reaches a reader unless recorded evidence produced it. Hand-written prose that states one is refused, and a claim bound to a metric cannot be guaranteed while that metric's evidence does not stand.

How it works

majordomus economics check runs two checks. The first scans every hand-written document, page, site data file and claim sentence for a quantity (a percentage, a multiplier such as "3x fewer") in the same sentence as a word of the economics vocabulary. Generated files are exempt, because their numbers come from the calculator. The second reads the claims the methodology binds to metrics: a bound claim may be guaranteed only while its metric is verified (sampled evidence meeting the publication rule) or measured (deterministic evidence), and current. Evidence that goes stale takes the guarantee with it. Every finding is named; the exit code is 10.

How to see it

majordomus economics check
majordomus economics check --format json | jq '.findings'

What it does not cover

It reads text, not meaning: a claim phrased without a quantity, or a quantity in a sentence that names none of the vocabulary, passes. It covers the files the repository publishes, not what anyone says elsewhere.

Why it exists

Every routing document studied while designing this tool carried improvement figures with no measurement behind them. A rule against doing the same is only as strong as the check that enforces it.

Detail rendered from docs/claims/economics-claims-gated.md.

From the statement to the proof

  1. 1 · the public statement

    A quantity about tokens, context or cost typed into hand-written prose is refused, and a claim bound to a metric cannot be guaranteed while its evidence does not stand

    Made on Economics, Doctor.

  2. 2 · the canonical claim

    economics-claims-gateddeclared status: guaranteed in docs/CLAIMS.yaml

    Defined in read it on this site · docs/ECONOMICS.md

  3. 3 · the implementation

    apps/majordomus-cli/src/economics/claims.rs

  4. 4 · the test and the scenarios

    Test: test/cases/431_economics_claims_gated.sh

  5. 5 · the recorded runs

    recorded evidence: not run how evidence is recorded

Verify it yourself

The test runs in a disposable temporary repository and asserts the behaviour, not a string in the source.

from a clone of the repository
bash test/run.sh 431_economics_claims_gated

Where this claim is used

responsibilities it covers

Searches the titles and descriptions of every page this site publishes.