d4c922bebe
Some checks failed
no-vanity-metrics / Scan committed Markdown for vanity metrics (pull_request) Successful in 3s
wai cross-architecture byte-equality / linux-x86_64 (pull_request) Successful in 14s
WAI conformance / cargo-class corpora · linux (pull_request) Successful in 30s
wai cross-architecture byte-equality / linux-aarch64 (pull_request) Successful in 1m5s
WAI conformance / cross-arch byte-equality · linux (pull_request) Successful in 14s
WAI conformance / cargo-class corpora · linux-arm64 (pull_request) Successful in 1m22s
WAI conformance / cross-arch byte-equality · linux-arm64 (pull_request) Successful in 1m11s
wai cross-architecture byte-equality / macos-arm64 (reference) (pull_request) Successful in 24s
WAI conformance / cargo-class corpora · macos (pull_request) Successful in 56s
WAI conformance / cross-arch byte-equality · macos (pull_request) Successful in 17s
wai cross-architecture byte-equality / windows-x86_64 (pull_request) Has been cancelled
WAI conformance / cargo-class corpora · windows (pull_request) Has been cancelled
WAI conformance / cross-arch byte-equality · windows (pull_request) Has been cancelled
The previous commit named this gap and left it open: `wai.video.int_hyper` — the variant whose I-frame is decoded by the *learned* conditional codec rather than as an ordinary integer keyframe — could not be driven by `int_video::decode` and so sat outside the four-platform matrix. Covering it meant pulling `int_hyper_synth.rs` in rather than adding a line, which is why it was deferred rather than bodged. It needed one more source than expected: `int_hyper_synth` depends on `int_transform::igdn`, which was not included either. `int_transform` turns out to have no crate-internal dependencies at all, so both drop in cleanly and the legs still run in about a minute with no codec libraries and no ONNX. This is the strictest composition the container has — a learned decode feeding a feedback loop. The keyframe comes out of a quantised transform network, and every later frame predicts from the previously reconstructed one, so a divergent byte in the learned synthesis does not stay in the keyframe; it propagates through the clip. Frame 0 is therefore pinned in its own test as well as inside the clip, so a regression in the conditional codec is distinguishable from one in the motion predictor rather than leaving both suspect. A side effect worth naming: including a source brings its `#[cfg(test)]` module with it, so `int_transform`'s 13 unit tests now run on linux-x86_64, linux-aarch64, macos-arm64 and windows-x86_64 instead of only where someone passes `--features`. The crate goes from 17 tests to 32. Both new sources and the `int_hyper` vectors are added to the workflow's path triggers, on the same rule as before: every source the crate compiles must be able to fire the matrix, or a change can break cross-arch equality and merge green. Verified: 32 tests pass in the conformance crate, the clip reproducing its committed hash `a5f53d477999d159`; workflow YAML parses with all four legs intact and 13 triggers.
103 lines
4.5 KiB
YAML
103 lines
4.5 KiB
YAML
name: wai cross-architecture byte-equality
|
|
|
|
# The `replicate` determinism contract, checked on real silicon. WAI claims its
|
|
# integer-exact decode paths (rANS entropy coder, integer fixed-point synthesis)
|
|
# produce BYTE-IDENTICAL output on every machine. This matrix proves it: five
|
|
# OS/arch combinations decode the same fixtures and assert the same golden
|
|
# bytes — rANS streams produced by CompressAI's upstream encoder, and an
|
|
# int_synth output hash produced on the reference machine (macOS arm64). One
|
|
# diverging byte anywhere fails the suite.
|
|
#
|
|
# Coverage is still-image AND temporal, classical AND learned: the rANS coder,
|
|
# integer fixed-point synthesis, the JPEG-AI entropy stage, the inter-frame video
|
|
# decoder (`wai.video.int_motion`), and the neural-keyframe variant
|
|
# (`wai.video.int_hyper`) whose I-frame comes out of a learned conditional codec. Video is the strictest leg — inter-frame decode is a
|
|
# feedback loop, so one divergent half-pel rounding does not stay one byte, it
|
|
# predicts the next frame and compounds for the rest of the clip.
|
|
#
|
|
# The conformance crate (`wai/byte-exact-conformance`) #[path]-includes the
|
|
# pure-integer sources from wai-rs — no system codec libraries, no ONNX runtime
|
|
# — so every leg runs in about a minute.
|
|
|
|
on:
|
|
pull_request:
|
|
paths:
|
|
- 'wai/byte-exact-conformance/**'
|
|
- 'wai/wai-rs/src/neural/int_synth.rs'
|
|
- 'wai/wai-rs/src/neural/jpegai_mans.rs'
|
|
# Every source the crate #[path]-includes must be able to fire this
|
|
# workflow, or a change can break cross-arch equality and merge green.
|
|
- 'wai/wai-rs/src/int_synth.rs'
|
|
- 'wai/wai-rs/src/int_entropy.rs'
|
|
- 'wai/wai-rs/src/jpegai_mans.rs'
|
|
- 'wai/wai-rs/src/rans.rs'
|
|
- 'wai/wai-rs/src/int_video.rs'
|
|
- 'wai/wai-rs/src/int_transform.rs'
|
|
- 'wai/wai-rs/src/int_hyper_synth.rs'
|
|
- 'wai/wai-rs/tests/vectors/int_video/**'
|
|
- 'wai/wai-rs/tests/vectors/int_hyper/**'
|
|
- '.github/workflows/wai-byte-equality.yml'
|
|
push:
|
|
branches:
|
|
- main
|
|
paths:
|
|
- 'wai/byte-exact-conformance/**'
|
|
- 'wai/wai-rs/src/neural/int_synth.rs'
|
|
- 'wai/wai-rs/src/neural/jpegai_mans.rs'
|
|
# Every source the crate #[path]-includes must be able to fire this
|
|
# workflow, or a change can break cross-arch equality and merge green.
|
|
- 'wai/wai-rs/src/int_synth.rs'
|
|
- 'wai/wai-rs/src/int_entropy.rs'
|
|
- 'wai/wai-rs/src/jpegai_mans.rs'
|
|
- 'wai/wai-rs/src/rans.rs'
|
|
- 'wai/wai-rs/src/int_video.rs'
|
|
- 'wai/wai-rs/src/int_transform.rs'
|
|
- 'wai/wai-rs/src/int_hyper_synth.rs'
|
|
- 'wai/wai-rs/tests/vectors/int_video/**'
|
|
- 'wai/wai-rs/tests/vectors/int_hyper/**'
|
|
- '.github/workflows/wai-byte-equality.yml'
|
|
|
|
jobs:
|
|
byte-equality:
|
|
name: ${{ matrix.label }}
|
|
runs-on: ${{ matrix.os }}
|
|
strategy:
|
|
fail-fast: false
|
|
matrix:
|
|
# Self-hosted fleet labels, not GitHub-hosted images. macos-x86_64 is
|
|
# dropped: no Intel-Mac runner exists in the fleet, and by the same
|
|
# argument the cargo-classes matrix already makes, it adds no arch
|
|
# coverage — x86_64 is held by linux-x86_64 and windows-x86_64, arm64
|
|
# by linux-aarch64 and the macos-arm64 reference.
|
|
include:
|
|
- { os: linux, label: linux-x86_64 }
|
|
- { os: linux-arm64, label: linux-aarch64 }
|
|
- { os: macos, label: macos-arm64 (reference) }
|
|
- { os: windows, label: windows-x86_64 }
|
|
steps:
|
|
- name: Checkout
|
|
uses: actions/checkout@v4
|
|
|
|
# unix: bootstrap rustup (docker image ships no Rust; macOS host has it but
|
|
# launchd's PATH omits ~/.cargo/bin). Windows is a host executor with rustup
|
|
# already present, and must use pwsh — its `bash` is the WSL stub.
|
|
- name: Install Rust 1.97.1 (unix)
|
|
if: matrix.os != 'windows'
|
|
shell: bash
|
|
run: |
|
|
export PATH="$HOME/.cargo/bin:$PATH"
|
|
command -v rustup >/dev/null 2>&1 || \
|
|
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh -s -- -y --profile minimal --default-toolchain 1.97.1
|
|
rustup toolchain install 1.97.1 --profile minimal
|
|
rustup default 1.97.1
|
|
echo "$HOME/.cargo/bin" >> "$GITHUB_PATH"
|
|
- name: Install Rust 1.97.1 (Windows)
|
|
if: matrix.os == 'windows'
|
|
shell: pwsh
|
|
run: |
|
|
rustup toolchain install 1.97.1 --profile minimal
|
|
rustup default 1.97.1
|
|
|
|
- name: Decode fixtures, assert golden bytes
|
|
working-directory: wai/byte-exact-conformance
|
|
run: cargo test --release -- --nocapture
|