open-standards/.github/wai-conformance
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Transaction Science da8dce1844
Some checks failed
WAI operation catalogue / does this change touch it (push) Successful in 1m54s
wai-key-proxy / does this change touch it (push) Successful in 1m55s
wai-audit collector and player integration / does this change touch it (push) Successful in 1m57s
joule-moq-remote host agent / joule-moq-remote · does this change touch it (push) Successful in 1m58s
joule-moq-room room service / joule-moq-room · does this change touch it (push) Successful in 1m59s
wai-fleet service / does this change touch it (push) Successful in 1m58s
joule-moq-web browser client / joule-moq-web · does this change touch it (push) Successful in 1m59s
wai-app and Create / wai-app · does this change touch it (push) Successful in 1m59s
joule-moq-remote host agent / joule-moq-remote, every target (macos) (push) Successful in 55s
wai-ledger service / does this change touch it (push) Successful in 1m7s
wai-sink-android native sink library / does this change touch it (push) Successful in 1m7s
wai-quantum for JavaScript / does this change touch it (push) Successful in 1m9s
wai-quantum studio and desktop / does this change touch it (push) Successful in 1m8s
WAI Studio / does this change touch it (push) Successful in 1m7s
wai-sink-swift native sink package / does this change touch it (push) Successful in 1m8s
wai-audit collector and player integration / collector, player integration and the browser end to end · macos (push) Successful in 1m28s
wai-fleet service / service · macos (push) Successful in 42s
wai-ledger service / service · macos (push) Successful in 1m1s
wai-quantum studio and desktop / desktop app · macos (push) Successful in 4m24s
wai-app and Create / wai-app · Create, browser end-to-end (macos) (push) Successful in 6m22s
joule-moq-remote host agent / joule-moq-remote, every target (linux-arm64) (push) Has been cancelled
joule-moq-room room service / joule-moq-room, every target (push) Has been cancelled
repository checks / lockfiles, advisories, tests in CI, workflow hygiene, spec and section references, public text (push) Has been cancelled
wai-app and Create / wai-app · tests, clippy, the line language's verifier (linux) (push) Has been cancelled
joule-moq-web browser client / joule-moq-web · browser end-to-end (macos) (push) Has been cancelled
wai-audit collector and player integration / collector · linux (push) Has been cancelled
WAI operation catalogue / the catalogue and every door · linux (push) Has been cancelled
wai-fleet service / service · linux (push) Has been cancelled
wai-key-proxy / proxy · linux (push) Has been cancelled
wai-ledger service / service · linux (push) Has been cancelled
wai-quantum for JavaScript / javascript · linux (push) Has been cancelled
wai-quantum energy-landscape jobs / does this change touch it (push) Has been cancelled
wai-quantum energy-landscape jobs / reader, kernels, answers and the stated result · linux, release (push) Has been cancelled
wai-quantum energy-landscape jobs / the same bits · linux-arm64 (push) Has been cancelled
wai-quantum energy-landscape jobs / the same bits · macos (push) Has been cancelled
wai-quantum energy-landscape jobs / the module under wasm32-wasip2 (wasmtime) (push) Has been cancelled
wai-quantum energy-landscape jobs / native against WebAssembly, over many seeds (push) Has been cancelled
wai-quantum studio and desktop / studio · browser (push) Has been cancelled
wai-quantum studio and desktop / desktop app · linux (push) Has been cancelled
wai-quantum studio and desktop / desktop app · windows (push) Has been cancelled
wai-sink-android native sink library / the JNI layer and the platform-free half on the host JVM · linux-arm64 (push) Has been cancelled
WAI Studio / the catalogue's actions, the unit tests and the core · linux (push) Has been cancelled
WAI Studio / Studio in WebKit · linux (push) Has been cancelled
WAI Studio / Studio in Chromium and Firefox · macos (push) Has been cancelled
wai-sink-android native sink library / every ABI, the AAR, and the instrumented tests in a headless emulator · macos (push) Has been cancelled
wai-sink-swift native sink package / libwai slices, desktop tests, simulator tests · macos (push) Has been cancelled
WAI breaking changes and the conformance runner / WAI breaking · does this change touch WAI (push) Successful in 14s
WAI breaking changes and the conformance runner / WAI breaking · wire, record and API against main · linux (push) Successful in 2m11s
WAI breaking changes and the conformance runner / WAI breaking and conform · their tests, and the independent verifiers through wai conform · linux (push) Successful in 5m12s
wai: signal health — what a monitor measured on an input, signed, and the switch that acts on it
A channel's operator needs to know, per input, whether the picture went black or froze, the sound
went silent, captions or cues stopped, or the transport stream broke; and an input switch needs
that answer from a monitor it can hold to account.

extensions/signal-health.md registers `wai.live.signal_health`: a monitor's signed record (WSH1)
of one input over a window with up to six checks: black and freeze over the decoded luma, silence
in 10 ms blocks, caption and cue gaps, and the first-priority indicators of ETSI TR 101 290 V1.4.1
(sync lost with its five-and-two hysteresis, bad sync bytes, PAT_error_2, continuity, PMT_error_2,
PID_error). Each check states its thresholds, its integer values, the digest of the media it read
and its verdict. A verifier holds each verdict to its values and thresholds and each threshold to
the profile it expects with no media, and recomputes every value with it; an input switch carries
the first input whose latest record by a trusted monitor is fresh and states no fault.

The reference is the `signal_health` module of wai-rs; the corpus is live-conformance/signal-health/
(41 records, 26 checks against a profile and their media, 10 switches), its media written from
fixed seeds with each case's values declared and held by the generator, and signal_health_verify.py
is its second implementation: 77 cases agree, 14 of 14 mutated copies fail and 30 of 30 weakened
verifiers are caught. Twelve faults planted in the reference (the verdict rule, the freeze's held
frame, the duplicate allowance, the discontinuity indicator, the profile, trust, silence over one
channel, the PAT gap, the end of the window, the sync hysteresis, the media digest, freshness) each
fail its tests.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-11-08 14:48:46 -05:00
..
corpora wai conform relay --suite moqt holds a relay to the MOQT interop cases, pq joins the verifier suites, and wai conformance gen writes a corpus by its generator 2026-11-08 14:44:52 -05:00
verifiers wai: signal health — what a monitor measured on an input, signed, and the switch that acts on it 2026-11-08 14:48:46 -05:00
baseline.json wai-conformance starts on a change to joule-ui-catalogue, the crate wai-app now links 2026-11-07 03:10:33 -05:00
README.md wai conform relay --suite moqt holds a relay to the MOQT interop cases, pq joins the verifier suites, and wai conformance gen writes a corpus by its generator 2026-11-08 14:44:52 -05:00

What wai-conformance.yml runs, one file a step

wai-conformance.yml keeps no hand list of its verifier steps, corpora or kernel tests. Its lists are derived, when it runs, from the files here and from tags in the test files, by scripts/wai-conformance-lists.py, whose docstring states every key; its gate reads the steps' paths: through scripts/pr-touches-paths.py. A change that adds a verifier, a corpus or a kernel test adds a file, or a line to a file of its own, and edits no line of the workflow, unless a step's paths: names a file under none of the trigger's paths (check names it). Its features and [[test]] entries in wai/wai-rs/Cargo.toml stay shared (wai/CONTRIBUTING.md).

  • verifiers/<name>.sh: one step of the independent-verifiers job. Its body is the step's shell, run in wai/ (or working-directory:) with bash -eo pipefail, as a workflow step runs. Its header, the leading # key: value lines, gives step: (its name), order: (steps run in ascending order, a tie by file name), features: (each list compiles alone in features-alone, and every feature joins WAI_FEATURES), and where it needs them alone:, build: pq, release-features:, bins:, pq-bins:, paths: (the extension texts it reads, which the workflow's gate then runs on) and working-directory:. Its corpus's independent verifier is an independent: line, <name> <area> [needs=<packages>] [verdicts=<file>] [dir=<dir>] python3 [-I] <script> <args>, the command line its README gives, run in wai/ by the job's one step wai conform --independent and never by the body; wai-rs/build.rs reads the binary's table of independent verifiers from these lines. A file with such lines and no body is a declaration: its verifiers run in that step alone. Prose comments follow the header, after a # line.
  • corpora/<name>.txt: one cargo-class corpus, verified by its own tool on every leg of cargo-classes (corpus:, order:, bin:, dir:), and written by it through wai conformance gen --suite <corpus>: its gen mode, or the modes gen: names in order (none where the tool writes nothing and the corpus's README says what does). wai-rs/build.rs reads these files for that command's table, and a dir: that names no corpus fails the build.
  • A test file of wai/wai-rs/tests/ whose first line is // wai-conformance: int-kernels runs in the fast integer kernels' steps of both profiles (int-kernels-release: the release step only; int-kernels-amd: the AVX-512 host too). The steps' features are the tagged tests' required-features.
  • baseline.json: the lists the workflow kept by hand before they were derived. The repository checks require every derived list to hold every entry of it, and every step it names to run.

To see what the workflow runs: python3 scripts/wai-conformance-lists.py dry-run (of another commit: --ref <commit>; two of them diff line by line). To run one step as CI does: python3 scripts/wai-conformance-lists.py run --only <name>. To check the files: python3 scripts/wai-conformance-lists.py check.