ci: run each suite for what can affect it; merges no longer repeat the pull request's run #332

Merged
dcharlot merged 2 commits from ci/lean-triggers into main 2026-10-19 06:02:04 -04:00
Owner

The owner asked to remove CI bottlenecks. The Linux arm64 runner (3 jobs at a time) carried about 100 queued runs, most of them for suites that a pull request's diff could not affect, and every merge to main re-ran what its pull request had already run.

What changes

  1. Merges no longer repeat the pull request's run. 27 workflows lose their push-to-main trigger and gain a nightly schedule, staggered between 04:00 and 08:59 UTC. A nightly run has no pull-request context, so every gate answers true and the full suite runs. That is the backstop for two pull requests that each passed but break together. repo-checks keeps its push trigger, because one of its steps runs only on a push. Workflows that already had a weekly schedule now run nightly. standards-build's comments are updated to match.

  2. Shared files no longer fire heavy suites. wai-http, wai-jpegai-e2e, wai-neural-gates, wai-pack, wai-quantum-webgpu, wai-sota-vectors, wai-web-reach and wai-web-wasm drop wai/wai-rs/Cargo.toml, wai/wai-rs/src/lib.rs, wai/registry/** and wai/registry/capabilities.json from their paths. Every new feature or capability touches those files. wai/wai-rs/Cargo.lock stays, so a dependency change still runs them. wai-conformance keeps its registry trigger, because it checks the registry.

  3. wai-http's falsify shards (about 1.5 hours of arm64 time) now gate on their own output, falsify. It is true when the pull request's diff touches one of these:

    • the files the patches in http-conformance/falsify/ modify: http_binding/**, container.rs, sig.rs, jwp_hash.rs, jwp_delivery.rs, hls_render.rs, wai_video_manifest.rs, and bin/wai_cli/http*;
    • the corpus and its verifier;
    • bin/wai_http_vectors.rs;
    • the workflow itself.

    It is also true nightly, and whenever the diff cannot be read, so it fails open. Other changes on wai-http's list still run its corpus jobs.

Trade-off

Before, a break that appears only when two separately green pull requests combine on main showed right after the merge. Now it shows in the next nightly run.

Checks

  • every workflow file parses (Ruby's YAML loader);
  • check-workflow-concurrency.sh, pr-touches-paths-selftest.sh, check-tests-in-ci.py and check-orphan-sources.py all pass;
  • the falsify gate's pattern answers false for a live-rooms or registry change and true for sig.rs.

🤖 Generated with Claude Code

The owner asked to remove CI bottlenecks. The Linux arm64 runner (3 jobs at a time) carried about 100 queued runs, most of them for suites that a pull request's diff could not affect, and every merge to main re-ran what its pull request had already run. ## What changes 1. **Merges no longer repeat the pull request's run.** 27 workflows lose their push-to-main trigger and gain a nightly schedule, staggered between 04:00 and 08:59 UTC. A nightly run has no pull-request context, so every gate answers `true` and the full suite runs. That is the backstop for two pull requests that each passed but break together. `repo-checks` keeps its push trigger, because one of its steps runs only on a push. Workflows that already had a weekly schedule now run nightly. `standards-build`'s comments are updated to match. 2. **Shared files no longer fire heavy suites.** `wai-http`, `wai-jpegai-e2e`, `wai-neural-gates`, `wai-pack`, `wai-quantum-webgpu`, `wai-sota-vectors`, `wai-web-reach` and `wai-web-wasm` drop `wai/wai-rs/Cargo.toml`, `wai/wai-rs/src/lib.rs`, `wai/registry/**` and `wai/registry/capabilities.json` from their paths. Every new feature or capability touches those files. `wai/wai-rs/Cargo.lock` stays, so a dependency change still runs them. `wai-conformance` keeps its registry trigger, because it checks the registry. 3. **`wai-http`'s falsify shards** (about 1.5 hours of arm64 time) now gate on their own output, `falsify`. It is true when the pull request's diff touches one of these: - the files the patches in `http-conformance/falsify/` modify: `http_binding/**`, `container.rs`, `sig.rs`, `jwp_hash.rs`, `jwp_delivery.rs`, `hls_render.rs`, `wai_video_manifest.rs`, and `bin/wai_cli/http*`; - the corpus and its verifier; - `bin/wai_http_vectors.rs`; - the workflow itself. It is also true nightly, and whenever the diff cannot be read, so it fails open. Other changes on `wai-http`'s list still run its corpus jobs. ## Trade-off Before, a break that appears only when two separately green pull requests combine on main showed right after the merge. Now it shows in the next nightly run. ## Checks - every workflow file parses (Ruby's YAML loader); - `check-workflow-concurrency.sh`, `pr-touches-paths-selftest.sh`, `check-tests-in-ci.py` and `check-orphan-sources.py` all pass; - the falsify gate's pattern answers `false` for a live-rooms or registry change and `true` for `sig.rs`. 🤖 Generated with [Claude Code](https://claude.com/claude-code)
ci: run each suite for what can affect it; re-runs after a merge become nightly
Some checks failed
wai-quantum CPU vector units / member · vector unit, avx2 (x86_64 silicon) (pull_request) Has been cancelled
wai-quantum CPU vector units / member · vector unit, sve 512-bit (aarch64, emulated) (pull_request) Has been cancelled
wai-quantum CPU vector units / member · vector units, avx2 and avx512 (framework-128gb silicon) (pull_request) Has been cancelled
wai-quantum CPU vector units / member · vector unit absent (macos) (pull_request) Has been cancelled
wai-quantum WebGPU member / does this change touch it (pull_request) Has been cancelled
wai-quantum WebGPU member / shader checks · browser build · wasip2 inertness · MSRV (pull_request) Has been cancelled
wai-quantum WebGPU member / member · software Vulkan (linux) (pull_request) Has been cancelled
wai-quantum WebGPU member / member · Metal (macos) (pull_request) Has been cancelled
wai-quantum WebGPU member / member · discrete GPU, Vulkan (jetson-hub) (pull_request) Has been cancelled
wai-quantum WebGPU member / member · integrated GPU, Vulkan (framework-128gb) (pull_request) Has been cancelled
wai-quantum WebGPU member / member · browser WebGPU (macos) (pull_request) Has been cancelled
WAI mbt2018_mean integer decode (regenerated vectors) / does this change touch it (pull_request) Has been cancelled
WAI mbt2018_mean integer decode (regenerated vectors) / regenerate mbt2018_mean integer vectors → Rust decode, required (pull_request) Has been cancelled
wai-web reach builds / wai-web reach builds · the package of record, every output as recorded (pull_request) Has been cancelled
wai-web reach builds / wai-web reach builds · this tree's wai-web, every rung on its engine line (pull_request) Has been cancelled
wai-web wasm32 / does this change touch it (pull_request) Has been cancelled
wai-web wasm32 / wai-web wasm32 build · corpus, menu and writers (pull_request) Has been cancelled
wai-web reach builds / wai-web reach · does this change touch it (pull_request) Has been cancelled
wai-quantum WebGPU member / member · DX12 and Vulkan (cbio-windows) (pull_request) Has been cancelled
WAI HTTP delivery / WAI HTTP · does this change touch it (pull_request) Successful in 6s
repository checks / lockfiles, tests in CI, workflow hygiene, spec and section references, public text (pull_request) Successful in 39s
WAI HTTP delivery / HTTP corpus · falsify mutations 2/3 (pull_request) Has been cancelled
WAI HTTP delivery / HTTP corpus · falsify patches 0/3 (pull_request) Has been cancelled
WAI HTTP delivery / HTTP corpus · falsify patches 1/3 (pull_request) Has been cancelled
WAI HTTP delivery / HTTP corpus · falsify patches 2/3 (pull_request) Has been cancelled
WAI HTTP delivery / HTTP corpus · every patch and mutation in exactly one shard (pull_request) Has been cancelled
WAI HTTP delivery / HTTP corpus · verified both ways, and the differential (pull_request) Has been cancelled
WAI HTTP delivery / cache rules · controls and labelled caches (pull_request) Has been cancelled
WAI HTTP delivery / HTTP corpus · falsify mutations 1/3 (pull_request) Has been cancelled
WAI HTTP delivery / HTTP corpus · falsify mutations 0/3 (pull_request) Has been cancelled
ac511a78ff
- 27 workflows that ran on pull requests and again on every push to main now run on
  pull requests and nightly (staggered 04:00-08:59 UTC). A merge no longer repeats what
  its pull request ran; the nightly run is the backstop for a combination of two
  pull requests that each passed. repo-checks keeps its push trigger: one of its
  steps runs only on a push.
- Eight heavy WAI workflows (http, jpegai-e2e, neural-gates, pack, quantum-webgpu,
  sota-vectors, web-reach, web-wasm) no longer fire on wai-rs/Cargo.toml,
  wai-rs/src/lib.rs or the registry, which every new feature and capability touches.
  Cargo.lock stays a trigger, so a dependency change still runs them; wai-conformance
  keeps the registry, which it checks.
- wai-http's falsify shards (about an hour and a half of runner time) run when a pull
  request changes the code the falsify patches break, the HTTP corpus, its verifier or
  the workflow, and nightly; other changes on wai-http's list run its corpus jobs only.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Merge origin/main into ci/lean-triggers; wai-conformance keeps no push block
Some checks failed
WAI HTTP delivery / HTTP corpus · falsify patches 1/3 (pull_request) Has been cancelled
WAI HTTP delivery / HTTP corpus · falsify patches 2/3 (pull_request) Has been cancelled
WAI HTTP delivery / HTTP corpus · every patch and mutation in exactly one shard (pull_request) Has been cancelled
WAI HTTP delivery / HTTP corpus · verified both ways, and the differential (pull_request) Has been cancelled
WAI HTTP delivery / cache rules · controls and labelled caches (pull_request) Has been cancelled
WAI energy receipts / does this change touch it (pull_request) Has been cancelled
WAI energy receipts / energy receipts · linux (pull_request) Has been cancelled
WAI energy receipts / energy receipts · linux-arm64 (pull_request) Has been cancelled
WAI energy receipts / energy receipts · macos (pull_request) Has been cancelled
WAI conformance / does this change touch it (pull_request) Has been cancelled
WAI conformance / cargo-class corpora · linux (pull_request) Has been cancelled
WAI conformance / cargo-class corpora · linux-arm64 (pull_request) Has been cancelled
WAI conformance / cargo-class corpora · macos (pull_request) Has been cancelled
WAI conformance / quantum core and corpus under wasm32-wasip2 (wasmtime) (pull_request) Has been cancelled
WAI conformance / v2 vocabulary · manifests validate as stated (pull_request) Has been cancelled
WAI conformance / independent verifiers · claims, JWP, key discovery and integer payloads (Python) (pull_request) Has been cancelled
WAI conformance / delivery telemetry · CMCD and CMSD against an independent library (pull_request) Has been cancelled
WAI conformance / cross-arch byte-equality · linux (pull_request) Has been cancelled
WAI conformance / cross-arch byte-equality · linux-arm64 (pull_request) Has been cancelled
WAI conformance / cross-arch byte-equality · macos (pull_request) Has been cancelled
WAI conformance / codec wrappers · fuzz smoke, text decode limits, C entry points, provenance, the semantic path (pull_request) Has been cancelled
WAI conformance / C2PA manifest emission · signed, read back, validated (pull_request) Has been cancelled
standards workspaces build + test / which workspaces this change touches (pull_request) Has been cancelled
standards workspaces build + test / macOS energy backends (pull_request) Has been cancelled
repository checks / lockfiles, tests in CI, workflow hygiene, spec and section references, public text (pull_request) Has been cancelled
joule-moq-web browser client / joule-moq-web · does this change touch it (pull_request) Has been cancelled
joule-moq-web browser client / joule-moq-web · browser end-to-end (macos) (pull_request) Has been cancelled
joule-code conformance gate / Build + round-trip C1-C4 vectors (pull_request) Has been cancelled
joule-code conformance gate / joule-moq-relay, every target (pull_request) Has been cancelled
joule-code conformance gate / joule-moq-ingest, every target (pull_request) Has been cancelled
ea0a855dcb
Main's new path entries in the push block (the live extensions) are also in the pull-
request list, which stays; the push block goes, as this branch intends.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
Transaction-Science/open-standards!332
No description provided.