The tests behind WAI's whole-decode claims read inputs from outside the
repository and returned early — reporting a pass — when those inputs were
absent. No workflow supplied them, so the claims were not checked
continuously.
- WAI_REQUIRE_SOTA_VECTORS=1 turns a missing input into a failure. A path
variable naming a missing or incomplete input fails with or without the
switch. Local runs without either still skip, and every skip prints a
banner saying the claim was not verified.
- wai-sota-vectors.yml regenerates the int_hyper vectors from the pretrained
mbt2018_mean checkpoint (pinned by SHA-256, with a pinned Python stack) and
runs int_hyper_synth and int_video_sota_keyframe with the switch set. The
regenerated vectors identify one run, not one machine: the encoder side is
float.
- wai-jpegai-e2e.yml fetches the pinned JPEG AI inputs from the public models
root, checks each against a SHA-256 manifest, and runs the whole-decode and
reconstruction-binding tests with the switch set, requiring each test by
name and the pinned pixel hash.
- Both jobs fail on any skip banner, and trigger on the kernels and float
helpers the decode imports.
- The int_hyper claims are stated as the checks CI runs, with its quality
measured on the pinned image; JPEG AI cross-machine identity is stated as a
measurement, not a registry-class claim. determinism-tiers §5–§6 record the
jobs.
Neither workflow has yet run through the forge.
Co-Authored-By: Claude Opus 5.5 <[email protected]>
648f407f09