open-standards/wai/tools/jpegai-e2e-v1.sha256
Transaction Science 648f407f09 wai: the headline decode tests fail on a missing input, and CI supplies their inputs
The tests behind WAI's whole-decode claims read inputs from outside the
repository and returned early — reporting a pass — when those inputs were
absent. No workflow supplied them, so the claims were not checked
continuously.

- WAI_REQUIRE_SOTA_VECTORS=1 turns a missing input into a failure. A path
  variable naming a missing or incomplete input fails with or without the
  switch. Local runs without either still skip, and every skip prints a
  banner saying the claim was not verified.
- wai-sota-vectors.yml regenerates the int_hyper vectors from the pretrained
  mbt2018_mean checkpoint (pinned by SHA-256, with a pinned Python stack) and
  runs int_hyper_synth and int_video_sota_keyframe with the switch set. The
  regenerated vectors identify one run, not one machine: the encoder side is
  float.
- wai-jpegai-e2e.yml fetches the pinned JPEG AI inputs from the public models
  root, checks each against a SHA-256 manifest, and runs the whole-decode and
  reconstruction-binding tests with the switch set, requiring each test by
  name and the pinned pixel hash.
- Both jobs fail on any skip banner, and trigger on the kernels and float
  helpers the decode imports.
- The int_hyper claims are stated as the checks CI runs, with its quality
  measured on the pinned image; JPEG AI cross-machine identity is stated as a
  measurement, not a registry-class claim. determinism-tiers §5–§6 record the
  jobs.

Neither workflow has yet run through the forge.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-09-28 18:40:59 -04:00

13 lines
1,009 B
Text

f3b325c583c6b7613ccddc2d89bfaa50e0e8314ceecd8d82fc4df7fb159b6083 hs_uv.json
1d193f15b5d8d1531ef9ffef8676904d76cfedbd1d2df931d581dfb26daa2688 hs_y.json
2c5f6f12fcf9a36489553e0e02e95684c339d82bab64cb7bae76a4635f9ec56d hyp_uv.json
32ab3a153e33ded902b1d8a6c413047634bc39e8b74525dfbb40eded0763433d hyp_y.json
bd3aa0c23294a462895416eda38399468781163858229c386deaba58def5a1c3 icci.json
562740aba18ba4dccdc007b3d54a669ecd18feac9d0bd1fd7a29e66a0ba498ee mcm0_y.json
fbd4b7c05e81cd32df4db4e2f6dfa4d6e3fc2edb6c21150f80ef5ac04765228d mcm1_y.json
b42d6fa96bf865dd2db47955aba14d8d65b9152c941be3ee3e92eae5643834a7 mcm2_y.json
e06766d0a7bff16188a0e96297d6e498e28fbaf7850f68b0a29447a9391c9d9d mcm3_y.json
5353b76f25e59f52d85adc896c9dc6b4aa8552589e3e4e1d97b8f29692e37b13 norm.json
8ddf8fe9dd15569910ad5755a5495526df959835bcf86a259d06ab6445f02b4e synth_uv.json
4f2c9ae807ea22197adaae0263c9d6d4d53ef7d4fccb81848b7bb4da9ef0ea69 synth_y.json
99840e5f472423f5a1261c9ec219d12dc910e9623d752672555dfea69ea4a097 test256.bin