The tests behind WAI's whole-decode claims read inputs from outside the repository and returned early — reporting a pass — when those inputs were absent. No workflow supplied them, so the claims were not checked continuously. - WAI_REQUIRE_SOTA_VECTORS=1 turns a missing input into a failure. A path variable naming a missing or incomplete input fails with or without the switch. Local runs without either still skip, and every skip prints a banner saying the claim was not verified. - wai-sota-vectors.yml regenerates the int_hyper vectors from the pretrained mbt2018_mean checkpoint (pinned by SHA-256, with a pinned Python stack) and runs int_hyper_synth and int_video_sota_keyframe with the switch set. The regenerated vectors identify one run, not one machine: the encoder side is float. - wai-jpegai-e2e.yml fetches the pinned JPEG AI inputs from the public models root, checks each against a SHA-256 manifest, and runs the whole-decode and reconstruction-binding tests with the switch set, requiring each test by name and the pinned pixel hash. - Both jobs fail on any skip banner, and trigger on the kernels and float helpers the decode imports. - The int_hyper claims are stated as the checks CI runs, with its quality measured on the pinned image; JPEG AI cross-machine identity is stated as a measurement, not a registry-class claim. determinism-tiers §5–§6 record the jobs. Neither workflow has yet run through the forge. Co-Authored-By: Claude Opus 5.5 <[email protected]>
13 lines
1,009 B
Text
13 lines
1,009 B
Text
f3b325c583c6b7613ccddc2d89bfaa50e0e8314ceecd8d82fc4df7fb159b6083 hs_uv.json
|
|
1d193f15b5d8d1531ef9ffef8676904d76cfedbd1d2df931d581dfb26daa2688 hs_y.json
|
|
2c5f6f12fcf9a36489553e0e02e95684c339d82bab64cb7bae76a4635f9ec56d hyp_uv.json
|
|
32ab3a153e33ded902b1d8a6c413047634bc39e8b74525dfbb40eded0763433d hyp_y.json
|
|
bd3aa0c23294a462895416eda38399468781163858229c386deaba58def5a1c3 icci.json
|
|
562740aba18ba4dccdc007b3d54a669ecd18feac9d0bd1fd7a29e66a0ba498ee mcm0_y.json
|
|
fbd4b7c05e81cd32df4db4e2f6dfa4d6e3fc2edb6c21150f80ef5ac04765228d mcm1_y.json
|
|
b42d6fa96bf865dd2db47955aba14d8d65b9152c941be3ee3e92eae5643834a7 mcm2_y.json
|
|
e06766d0a7bff16188a0e96297d6e498e28fbaf7850f68b0a29447a9391c9d9d mcm3_y.json
|
|
5353b76f25e59f52d85adc896c9dc6b4aa8552589e3e4e1d97b8f29692e37b13 norm.json
|
|
8ddf8fe9dd15569910ad5755a5495526df959835bcf86a259d06ab6445f02b4e synth_uv.json
|
|
4f2c9ae807ea22197adaae0263c9d6d4d53ef7d4fccb81848b7bb4da9ef0ea69 synth_y.json
|
|
99840e5f472423f5a1261c9ec219d12dc910e9623d752672555dfea69ea4a097 test256.bin
|