wai-quantum: a study of the co-design, every measure the engine's #512
2026-10-27
wai-quantum: a study of the co-design, every measure the engine's
All checks were successful
WAI mbt2018_mean integer decode (regenerated vectors) / regenerate mbt2018_mean integer vectors → Rust decode, required (pull_request) Successful in 6m16s
wai-web reach builds / wai-web reach builds · this tree's wai-web, every rung on its engine line (pull_request) Successful in 4m30s
wai-web wasm32 / wai-web wasm32 build · corpus, menu and writers (pull_request) Successful in 5m16s
WAI energy receipts / energy receipts · linux-arm64 (pull_request) Successful in 10m45s
wai-sink-android native sink library / the JNI layer and the platform-free half on the host JVM · linux-arm64 (pull_request) Successful in 3m22s
wai-quantum signal processor / processor and member · signal processor, emulated (pull_request) Successful in 13m35s
wai-quantum WebGPU member / member · discrete GPU, Vulkan (jetson-hub) (pull_request) Successful in 25m12s
WAI conformance / independent verifiers · claims, JWP, key discovery and integer payloads (Python) (pull_request) Successful in 1h1m10s
wai-audit collector and player integration / collector, player integration and the browser end to end · macos (pull_request) Successful in 1m36s
standards workspaces build + test / macOS energy backends (pull_request) Successful in 10m7s
WAI conformance / cross-arch byte-equality · macos (pull_request) Successful in 25s
WAI conformance / codec wrappers · fuzz smoke, text decode limits, C entry points, provenance, the semantic path (pull_request) Successful in 1m1s
WAI energy receipts / energy receipts · macos (pull_request) Successful in 5m13s
wai-quantum command line / command line · macos (pull_request) Successful in 1m18s
wai-quantum dataflow member / member · dataflow device absent (macos) (pull_request) Successful in 38s
wai-quantum FPGA member / member · FPGA datapath, simulated (macos) (pull_request) Successful in 2m17s
wai-quantum Metal member / member · Metal (macos) (pull_request) Successful in 32s
WAI conformance / cargo-class corpora · macos (pull_request) Successful in 19m15s
wai-quantum OpenCL member / member · OpenCL GPU (macos) (pull_request) Successful in 36s
wai-quantum service / service · macos (pull_request) Successful in 1m17s
wai-quantum matrix-extension member / member · matrix extension absent (macos) (pull_request) Successful in 12s
WAI examples / WAI examples · the archive, the readiness check, the browser and Apple · macos (pull_request) Successful in 15m56s
wai-quantum studio and desktop / desktop app · macos (pull_request) Successful in 3m23s
wai-quantum portable tensor program / tensor program · Metal and the arm64 CPU (macos) (pull_request) Successful in 19s
wai-quantum CPU vector units / member · vector unit absent (macos) (pull_request) Successful in 18s
wai-quantum WebGPU member / member · browser WebGPU (macos) (pull_request) Successful in 1m48s
wai-quantum WebGPU member / member · Metal (macos) (pull_request) Successful in 2m45s
wai-quantum neural-processor member / member · neural processor (macos) (pull_request) Successful in 10m29s
wai-sink-android native sink library / every ABI, the AAR, and the instrumented tests in a headless emulator · macos (pull_request) Successful in 9m12s
wai-sink-swift native sink package / libwai slices, desktop tests, simulator tests · macos (pull_request) Successful in 19m32s
The measurement harness the co-design report puts under every feature:
each feature behind a flag, compared against a control, in a study whose
protocol is sealed before any data.
- engine::study:
- Protocol: the study, hypotheses, primary measure, conditions (each a
setting of FLAGS), control and analysis (resamples, seed, level),
checked and sealed with the researcher's key before any data;
- assign: the protocol's digest and the participant's key hashed
together, so the condition is fixed and anyone can check it;
- seal_record / open_record: the participant's record sealed with their
key, refused if changed, for another study, sealed by another key, or
in a condition its key is not assigned;
- measure: the report's eight, each computed again from the record:
quality of the edits proved equal (and its trend), diversity (Vendi),
novelty, selection skill against chance, calibration (mean distance,
slope), unassisted probe scores (four probes, each a workbench
specification), ownership (five items, 1 to 7) beside the authorship
share, and convergence;
- cohort: per condition the means, each condition's difference from the
control on the primary measure with a seeded bootstrap interval,
Cronbach's alpha, the Vendi score of the final designs, one record per
participant; call and call_sealing for hosts.
- The command line: study catalog | new | assign | measure | cohort
(--out seals the report).
- MCP: study_measure and study_cohort. The probes are not offered to
agents: a probe is done without the assistant.
- The Studio: the Study pane (Features, each switchable off and held where
a study's condition names it; Load a protocol, shown before Take part; a
record kept once asked: choices in Alternatives and the Workbench with
the engine's best, How much is this yours?, probe tasks with the
assistant paused; My record; Export my record, sealed with the browser's
key). A condition holds only the features it names; leaving restores the
reader's own.
- Bindings: QuantumEngine::study in the page (it seals with the page's
key), study in the desktop app.
- CI: wai-web's native engine tests count 14.
- The e2e brings the editor's first lines into view before reading its
gutter, and counts the taste profile from the choices it already holds.
Co-Authored-By: Claude Opus 5.5 <[email protected]>