open-standards/wai/int-payload-conformance
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Transaction Science 1f3c452550 D2c M2 gate 6: the planned breaks written, the scan of every committed set and payload
Completes the switch (abfbbc6a).

- tests/int_splat_ops.rs needs legacy_int now that the direct decode is test-only
  (required-features), and gains the scan: every committed splat set (the one that
  int-payload-conformance and the staged splat case name) has a layer of tag 0, 1 or
  2, header shifts under 128, no bias of magnitude 2^63 - 1 or more, and lowers and
  loads under acc64; every committed payload (the vector, the refusal fixtures, the
  staged base's) decodes or is refused through the lowering exactly as directly.
- integer-payloads: 2 names the decode its stream rules define (E1, t4097, lenient,
  canonical); 6 cites whm1/1 and the RGB8 step; 7's set rules add the lowering and
  load, its order puts them after g_s's shape and before the stream, and Exactness
  says a lowered network makes its checks as check ranges; 12 lists WIA1 and WIS1
  among the byte-equality goldens (so does int-payload-conformance's README).
- integer-operators: the status note names wai.splat.int_codec; 15.3 item 3 states
  the codes and order of its breaks and the two more the lowering makes.
- SPEC 8's planned breaks and the CHANGELOG entry (the decode, the breaks, the
  interpreter's memory) record them.

Measured (int_payload_cost): with the set loaded, the splat decode holds 325878 bytes
against 344656 declared; with the previous interpreter it held 622992 (1.8 times the
declared bytes, not the 1.6 the previous commit's message estimated).

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-10-14 10:15:05 -04:00
..
refusals wai: int_codec model and vectors regenerated from the generated signal 2026-10-07 09:43:20 -04:00
sets wai: one refusal order for integer decodes, planned alike on every target 2026-10-01 19:25:37 -04:00
.gitattributes wai-rs: int_payload — the WIV1, WIH1, WIA1 and WIS1 payloads, and decode_int 2026-10-01 12:20:06 -04:00
int_payload_verify.py wai: receipt decode refusals are codes; the Python decode allocates as it goes 2026-10-01 21:15:43 -04:00
README.md D2c M2 gate 6: the planned breaks written, the scan of every committed set and payload 2026-10-14 10:15:05 -04:00
vectors.json wai: int_codec model and vectors regenerated from the generated signal 2026-10-07 09:43:20 -04:00

int-payload-conformance — the integer payloads

Vectors for the payload formats SPEC §5 pins to the WAI-native integer codecs (extensions/integer-payloads.md): WIV1 for wai.video.int_motion (keyframe 0) and wai.video.int_hyper (keyframe 1), WIH1 for wai.neural.int_hyper, WIA1 for wai.audio.int_codec and WIS1 for wai.splat.int_codec.

Provenance. Generated here: wai_int_payload_vectors gen converts the vectors under ../wai-rs/tests/vectors/ and changes them for the refusal fixtures; tests/vectors/README.md states each vector's provenance. One payload indexed here is not generated content: video_real (int_video) codes a third-party image (see there).

Code-equivalence. A conforming sink decodes every payload to the output digests its vector states, and refuses every fixture with the code it states, from the extension's closed list (§8).

  • vectors.json — the index. For each payload: its capability, its path, its SHA-256, the JSON it is converted from, the parameter set it decodes against (each member's name in the set, and the committed file that holds it), and the sha256.json sidecar that states its decoded output's SHA-256. For each refusal fixture: its capability, its path, its code, and whether parsing alone refuses it (parse) or the decode does (decode). Paths are relative to wai/.
  • The payloads sit beside their JSON sources under ../wai-rs/tests/vectors/: int_video/*.wiv1, int_hyper/tiny_bitstream.wih1, int_audio/audio_bitstream.wia1 and int_splat/splat.wis1. Their sidecars are the ones the JSON forms' decodes are checked against: a payload and its JSON source decode to the same bytes.
  • refusals/*.bin — each a committed payload changed in one place (a byte, a field, a truncation, a word appended to a stream), so that it is refused with one code, or, for wiv1_end_state and wiv1_one_frame_end_state, a small clip written to end its stream in a state other than 2^31. The fixtures named *_order_* break two rules at once and pin which one a sink reports (the extension's §2 and §7), and so do the wiv1_geometry_flip_* fixtures: wiv1_geometry with one byte of its keyframe's last stream words changed, refused for the keyframe's size before that stream is read. The fixtures for bad_magic are the JSON sources themselves: a tool's JSON output is a converter input, never a payload.
  • sets/ — a parameter-set member a fixture decodes against in place of a committed one: entropy_median_max.json is the tiny conditional codec's tables with one median at i64::MAX.

Files are compared as bytes; .gitattributes turns off line-ending conversion.

Generation. Every file here, and every payload under tests/vectors/, is written by one generator from the committed JSON alone, so it can be rebuilt and compared:

cd wai/wai-rs
cargo run --no-default-features --features video_int,audio_int,splat_int \
    --bin wai_int_payload_vectors -- gen ../int-payload-conformance

Verifiers.

  • wai_int_payload_vectors verify ../int-payload-conformance (wai-rs) regenerates every file and requires it to equal the committed one byte for byte, decodes every payload through int_payload::decode_int to its sidecar's SHA-256, and requires every fixture to be refused with its code at its layer, and by int_payload::declared_cost with the same code unless the decode's refusal comes from a stream or a network run. tests/int_payload.rs runs the fixtures again in both build profiles, refuses every strict prefix of every payload, and runs a sweep of single-byte changes in which nothing may panic; tests/int_payload_preflight.rs checks that a header past the caps or past what the parameter set can fit is refused before anything sized from it is allocated, and that a payload whose streams cannot carry what its header declares is refused at its first exhausted symbol, having allocated only what it decoded.

  • int_payload_verify.py, Python standard library only and sharing no code with wai-rs, written from the extension: it parses every payload with the extension's rules and check order, converts every JSON source independently and requires the committed bytes, decodes the WIV1 payloads with keyframe 0 in full (the rANS decoder with its bypass escape, its stop at the first exhausted symbol and its canonical end, whole-pel and half-pel motion compensation) to their sidecars' SHA-256, and checks every fixture: a parse fixture's code, and that a decode fixture parses (a WIV1 keyframe-0 one is decoded and must be refused with its code).

    python3 int-payload-conformance/int_payload_verify.py int-payload-conformance
    

Not decoded independently. The Python verifier does not decode WIH1, WIV1 with keyframe 1 (its keyframe is a WIH1), WIA1 or WIS1: their decodes run integer networks it does not implement. Their outputs are checked by wai-rs against the sidecars above, and also by the cross-architecture goldens in ../byte-exact-conformance/. For their decode fixtures the Python verifier checks that they parse; their codes are checked by wai-rs.