Skip to content
Cockpit0.29.0
A snapshot: read at commit 707a04c7ce8 on 2026-10-18T00:06:01Z by majordomus 0.29.0. Nothing on this page is read again. See it live

I0838

bench compare and the top regressions report

Where it stands

devtask.issue
Readiness
ready no dependency and no gate holds it; nobody has started it
Status
READY
Can start
startable
Milestone
M004
Milestone status
ACTIVE
Wave
5
Waiting on
none
Holds back
none
Behind it in all
0
Evidence
0 of 1

Moves

plan.transition
A move writes the repository: it stamps one field of this issue's record and appends one event to the ledger, and a commit will carry both.
The same moves from a terminal

majordomus plan start I0838

majordomus plan verify I0838

majordomus plan done I0838

What it is

Objective
Add bench compare <run-a> <run-b> and make the human report rank the largest regressions, the largest improvements and the slowest targets by p95.
Why
A wall of numbers hides the one that matters.
Now
Only --check compares, against the baseline.
Wanted
Any two persisted runs compare with the same table as --check; the default report ends with the ranked tail.
Done when
unknown: the record declares no `completion`
Risk
Percentile arithmetic is implemented once and unit-tested on small datasets.

Acceptance

  • compare of a run with itself reports zero deltas
  • Case 85 proves the ranking on two fixture runs
Validation
bash test/run.sh 85_bench_compare
Evidence required
regression_refused
Evidence present
unknown: the record carries no `evidence` entries

Scope

Touches
lib/bench.shdocs/CLI.mdtest/cases
Not
none
Depends on
I0826
Priority
p0
Profile
implementation
Parallel safe
false
Owner
unknown: the record declares no `owner`

The work so far

Branches
none
Merged
none
Commits
0
Trunk
master
Sessions
none
Created
2026-09-05
Updated
2026-09-05
Started
unknown: the record declares no `started_at`
Verified
unknown: the record declares no `verified_at`
Completed
unknown: the record declares no `completed_at`

Synchronisation

Adapter
scripts/github-sync
Repository
unknown: the derived plan's header carries no repository
External issue
unknown: a live GitHub state; this executable makes no network call, so only `scripts/github-sync --check` can answer it
State there
unknown: a live GitHub state; this executable makes no network call, so only `scripts/github-sync --check` can answer it

Findings

Nothing is wrong with these records.