Transaction-Science/open-standards
Watch
1
0
Fork
You've already forked open-standards
 0
Code Issues Pull requests Projects Releases 15 Packages Wiki Activity Actions 6

wai-quantum: a study of the co-design, every measure the engine's #509

Closed
dcharlot wants to merge 1 commit from wai/quantum-study into main
pull from: wai/quantum-study
merge into: Transaction-Science:main
Conversation 0 Commits 1 Files changed 21 +1482 -28

2026-10-27

Transaction Science
wai-quantum: a study of the co-design, every measure the engine's
Some checks failed
wai-quantum npu-cores member / member · npu-cores absent (linux-arm64) (pull_request) Successful in 32s
Details
wai-quantum tensor-engine member / member · tensor engine absent (linux-arm64) (pull_request) Successful in 23s
Details
WAI conformance / each feature of the independent verifiers' steps compiles alone (pull_request) Successful in 11m54s
Details
wai-sink-android native sink library / the JNI layer and the platform-free half on the host JVM · linux-arm64 (pull_request) Successful in 2m47s
Details
WAI energy receipts / energy receipts · linux-arm64 (pull_request) Successful in 10m24s
Details
wai-quantum WebGPU member / member · discrete GPU, Vulkan (jetson-hub) (pull_request) Successful in 25m29s
Details
wai-audit collector and player integration / collector, player integration and the browser end to end · macos (pull_request) Successful in 1m40s
Details
WAI conformance / cross-arch byte-equality · macos (pull_request) Successful in 27s
Details
WAI conformance / codec wrappers · fuzz smoke, text decode limits, C entry points, provenance, the semantic path (pull_request) Successful in 1m25s
Details
WAI conformance / cargo-class corpora · linux-arm64 (pull_request) Successful in 21m23s
Details
WAI energy receipts / energy receipts · macos (pull_request) Successful in 8m6s
Details
standards workspaces build + test / macOS energy backends (pull_request) Successful in 12m38s
Details
wai-quantum command line / command line · macos (pull_request) Successful in 46s
Details
wai-quantum dataflow member / member · dataflow device absent (macos) (pull_request) Successful in 15s
Details
wai-quantum FPGA member / member · FPGA datapath, simulated (macos) (pull_request) Successful in 1m18s
Details
wai-quantum Metal member / member · Metal (macos) (pull_request) Successful in 36s
Details
WAI conformance / cargo-class corpora · macos (pull_request) Successful in 21m48s
Details
wai-quantum OpenCL member / member · OpenCL GPU (macos) (pull_request) Successful in 23s
Details
WAI examples / WAI examples · the archive, the readiness check, the browser and Apple · macos (pull_request) Successful in 12m58s
Details
wai-quantum service / service · macos (pull_request) Successful in 47s
Details
wai-quantum matrix-extension member / member · matrix extension absent (macos) (pull_request) Successful in 11s
Details
wai-quantum portable tensor program / tensor program · Metal and the arm64 CPU (macos) (pull_request) Successful in 17s
Details
wai-quantum CPU vector units / member · vector unit absent (macos) (pull_request) Successful in 15s
Details
wai-quantum neural-processor member / member · neural processor (macos) (pull_request) Successful in 11m6s
Details
wai-quantum studio and desktop / desktop app · macos (pull_request) Successful in 2m47s
Details
wai-quantum WebGPU member / member · Metal (macos) (pull_request) Successful in 2m49s
Details
wai-quantum WebGPU member / member · browser WebGPU (macos) (pull_request) Successful in 1m50s
Details
WAI conformance / independent verifiers · claims, JWP, key discovery and integer payloads (Python) (pull_request) Failing after 52m29s
Details
wai-sink-android native sink library / every ABI, the AAR, and the instrumented tests in a headless emulator · macos (pull_request) Successful in 9m12s
Details
wai-sink-swift native sink package / libwai slices, desktop tests, simulator tests · macos (pull_request) Successful in 22m13s
Details 
The measurement harness the co-design report puts under every feature:
each feature behind a flag, compared against a control, in a study whose
protocol is sealed before any data.

- engine::study:
  - Protocol: the study, hypotheses, primary measure, conditions (each a
    setting of FLAGS), control and analysis (resamples, seed, level),
    checked and sealed with the researcher's key before any data;
  - assign: the protocol's digest and the participant's key hashed
    together, so the condition is fixed and anyone can check it;
  - seal_record / open_record: the participant's record sealed with their
    key, refused if changed, for another study, sealed by another key, or
    in a condition its key is not assigned;
  - measure: the report's eight, each computed again from the record:
    quality of the edits proved equal (and its trend), diversity (Vendi),
    novelty, selection skill against chance, calibration (mean distance,
    slope), unassisted probe scores (four probes, each a workbench
    specification), ownership (five items, 1 to 7) beside the authorship
    share, and convergence;
  - cohort: per condition the means, each condition's difference from the
    control on the primary measure with a seeded bootstrap interval,
    Cronbach's alpha, the Vendi score of the final designs, one record per
    participant; call and call_sealing for hosts.
- The command line: study catalog | new | assign | measure | cohort
  (--out seals the report).
- MCP: study_measure and study_cohort. The probes are not offered to
  agents: a probe is done without the assistant.
- The Studio: the Study pane (Features, each switchable off and held where
  a study's condition names it; Load a protocol, shown before Take part; a
  record kept once asked: choices in Alternatives and the Workbench with
  the engine's best, How much is this yours?, probe tasks with the
  assistant paused; My record; Export my record, sealed with the browser's
  key). A condition holds only the features it names; leaving restores the
  reader's own.
- Bindings: QuantumEngine::study in the page (it seals with the page's
  key), study in the desktop app.
- CI: wai-web's native engine tests count 14.
- The e2e brings the editor's first lines into view before reading its
  gutter, and counts the taste profile from the choices it already holds.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
8a48b36ee8
2026-10-27 06:55:14 -04:00