Skip to content

Verification strength

Every result carries one of three labels. They are not confidence scores. They describe what RigorRun was able to read.

What it meansWhen you get it
AUTHORITATIVEDirect, trusted state. RigorRun can see the whole of the system’s state.In-process environments only — the bundled example, and fixtures.
PARTIALVerified through the reads your system exposes, and nothing beyond them.Any real connected system.
OBSERVATIONALThe actions were watched. The final state was not independently read back.A browser connection with no readable system attached.

A real system is PARTIAL, and that is the honest answer

Section titled “A real system is PARTIAL, and that is the honest answer”

AUTHORITATIVE requires RigorRun to be able to see all of the state. Over MCP or HTTP it sees what your read operations return. If a write touched a table nothing reads back, RigorRun did not check it and says so under What this system stopped RigorRun doing.

The way to strengthen a verdict is to nominate more reads, not to reinterpret the label.

Inside a run, each individual check also names where its answer came from:

SourceShown asCan it block a release?
STATEread from your systemyes
EVENTfrom your system’s own logyes
OUTPUTfrom what the tool returnedyes
HUMANdecided by a personyes
MODELjudged by a modelyes
DECLAREDclaimed by the system itself, unverifiednever

DECLARED is deliberately not styled as a warning. A warning reads as “probably fine, look when you can”. A claim the system under test made about itself, which nothing has checked, is not probably fine — it is the thing the rest of the product exists to go and test. Nothing with a DECLARED source may block, and there is a test for it.

Of the six sources above, generated suites only ever produce STATE and EVENT. Nothing produces a model-judged or human-review evaluator today, so those tiers exist in the schema and are unreachable in practice. See limitations.