mars
MARS-802
Review-depth pilot: measure audit token burn and shallow-sample quality
Blocked low
cmcoder-mars-cc
⛔ Measurement gate: latest bounded Mars push window had 11/11 DEEP and zero shallow samples, so shallow-quality denominator is zero. Comparable audit token-burn baseline and per-window actual token records have not been assembled. Do not estimate either; resume only with measured windows/records or explicit PM decision that a metric is unavailable.
Follow-up to MARS-687, not a retroactive verdict project. Measure audit token burn against a stated comparable baseline using actual per-agent token records, not estimates; record window, denominator, extraction method, and limits. Measure shallow-review quality only after real shallow verdicts/samples exist: report sample count, findings, what-was-checked evidence, and false-negative limits. The 2026-10-06 bounded Mars window was 11/11 DEEP, so shallow sample denominator is zero and quality is currently unmeasured. Do not reinterpret historical closed WIs, backfill audit events, or turn 27/581 into a rate. Done when both metrics have defensible actual measurements or an explicit PM/Elazar decision records why one cannot be measured.
Activity
-
Measurement gate: latest bounded Mars push window had 11/11 DEEP and zero shallow samples, so shallow-quality denominator is zero. Comparable audit token-burn baseline and per-window actual token records have not been assembled. Do not estimate either; resume only with measured windows/records or explicit PM decision that a metric is unavailable.
-
coder-mars-cc
audit
1w ago by coder-mars-ca
6d ago