Skip to content

the-proof-tests-are-registered-before-they-run — The six proof tests are registered as validated protocols, each frozen by its own digest, and every trial is a typed record that publishes only what its basis permits

A validated proof plan names the six tests. Each protocol is frozen by its own digest; a paired protocol references its suite's registration block by digest. One typed trial record serves T1, T3, T5 and T6, refuses what its protocol does not declare and redacts what its publication basis does not permit.

PLANNED 0 of 3 issues done

ready
1
blocked
2
active
0
verify
0
done
0
cancelled
0

Problem

The owner's report of 2026-10-19 asks for six proof tests (T1 to T6), each settled by measurement. Nothing registers a test, its arms or trials, strata, minimum sample or decision rule before a run. The token methodology (.ai/repo/benchmarks/economics/methodology.yaml) has hypotheses whose status model.rs:311 says a person sets. Suite freshness binds a suite's runs to its whole input list (suites/pilot.yaml freshness_inputs), so a shared plan file in that list would stale every suite's runs whenever any test is registered. No record type exists for a trial that is not a paired benchmark run (an adoption, a fault injection, a newcomer's first intent), and nothing stops such a record from publishing details that identify a private repository.

Outcome

A validated proof plan names the six tests. Each protocol is frozen by its own digest; a paired protocol references its suite's registration block by digest. One typed trial record serves T1, T3, T5 and T6, refuses what its protocol does not declare and redacts what its publication basis does not permit.

Current state

apps/majordomus-cli/src/economics/mod.rs:43-49 declares claims, context, model, report, runner, stats and usage and nothing for proof tests. git ls-files .ai/repo/benchmarks lists README.md and the economics, observatory, pages and rust subdirectories; no proof-plan.yaml and no trials directory. docs/CLAIMS.yaml:20-28 declares the statuses guaranteed, advisory, planned and rejected and holds no claim about the proof tests.

Desired state

.ai/repo/benchmarks/proof-plan.yaml (schema proof-plan/v1) validated by economics::proof; six tests with planned claims; trial records under .ai/repo/benchmarks/trials/<test>/ loaded by one typed loader with redaction classes.

Scope

  • apps/majordomus-cli/src/economics
  • apps/majordomus-cli/src/economics/mod.rs
  • apps/majordomus-cli/tests/economics.rs
  • .ai/repo/benchmarks
  • .ai/repo/benchmarks/README.md
  • docs/CLAIMS.yaml
  • docs/ECONOMICS.md

Out of scope

  • Computing a verdict (the-proof-scorecard-is-published)
  • Writing any protocol's thresholds, corpus or candidates (each experiment milestone registers its own)
  • Changing methodology version 1's token publication rule
  • A second statistics engine

Acceptance criteria

  • The tracked plan validates with exactly six tests and no protocol, and each test settles one planned claim of docs/CLAIMS.yaml
  • Registering a protocol for one test changes no counted record of another test, proven by a fixture
  • A trial record of a repository without a publication basis that carries a name, raw commit id, path or free text is refused

Validation

  • majordomus plan validate

Risks

  • A digest beside its protocol can be re-stamped; the guarantee is that a record must carry its own protocol's digest and postdate registered_at, so re-stamping costs the records, not the verdict
  • proof.rs is extended by I3351, I3353 and I3354 in sequence; parallel work on it is ordered by depends_on
  • I3299 also scopes .ai/repo/benchmarks/README.md; whichever lands second merges onto the first

Issues

Each one is an execution contract with its own acceptance criteria, validation command and required evidence. The wave column is the layer of the dependency graph it sits in.

issuestatuswavedepends ontitle
I3351 READY 0 — A proof plan is a validated record in which each protocol is frozen by its own digest, so registering one test never stales another's records
I3352 BLOCKED 1 I3351 The six proof tests are registered, each with the claim it settles and its instrument, and none carries a protocol yet
I3353 BLOCKED 1 I3351 A trial is a typed record that carries its protocol's digest, refuses what the protocol does not declare, and redacts what its publication basis does not permit

The graph

the-proof-tests-are-registered-before-they-run dependency graphfrom .ai/repo/project
flowchart LR
    I3351["I3351<br/>A proof plan is a validated record in which each protocol is frozen by its own digest, so registering one test never stales another's records"]:::ready
    I3352["I3352<br/>The six proof tests are registered, each with the claim it settles and its instrument, and none carries a protocol yet"]:::blocked
    I3353["I3353<br/>A trial is a typed record that carries its protocol's digest, refuses what the protocol does not declare, and redacts what its publication basis does not permit"]:::blocked
    I3351 --> I3352
    I3351 --> I3353
    classDef done stroke:#16a34a,fill:#dcfce7,color:#14532d,stroke-width:2px
    classDef active stroke:#2563eb,fill:#eff6ff,color:#1e3a8a,stroke-width:2px
    classDef verify stroke:#7c3aed,fill:#f5f3ff,color:#4c1d95,stroke-width:2px
    classDef ready stroke:#0891b2,fill:#ecfeff,color:#164e63,stroke-width:2px
    classDef planned stroke:#0891b2,fill:#ecfeff,color:#164e63,stroke-width:2px
    classDef blocked stroke:#b45309,fill:#fffbeb,color:#78350f,stroke-width:2px
    classDef cancelled stroke:#6b7280,fill:#f9fafb,color:#374151,stroke-width:2px
    classDef superseded stroke:#6b7280,fill:#f9fafb,color:#374151,stroke-width:2px

Canonical record: .ai/repo/project/milestones/the-proof-tests-are-registered-before-they-run.yaml. Read it back with majordomus plan show the-proof-tests-are-registered-before-they-run.

Searches the titles and descriptions of every page this site publishes.