open-standards/wai/wai-studio
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Transaction Science e39297fac6 wai.sink.models: which models a fleet's sinks may run, and what they ran
A sink is a computer that runs named, pinned models: codec priors, DRED's weights, an exact
upscale's prior, enhancement and generator models. Nothing said which of them a fleet's sinks may
run, revoked one across a fleet, or rolled up what each class of device ran.

extensions/model-governance.md registers the record `wai.sink.models`, in the `models` profile
(core/profiles.json, CORE.md's table), outside the core. An operator signs a model policy
(`wai-model-policy`): classes of devices, enrolled by key or vouched for by an attestation key
(`wai-model-device`), and for each class the parameter sets it may run by the digest a pin names
(SPEC §3.1), per capability and role (decode, upscale, enhance, generate), with the least tier each
must run at; a span, a successor that takes its place from its own start, and the operator's key
log (jwp-receipts §7), whose `revoked_modules` revoke a set from the first revision that lists it:
the list SPEC §3.1 check 5 already reads at a sink. A device signs a run report (`wai-model-run`)
from what it already states: each decode's neural-dispatch report with the set it read (a sealed
set's opened digest too), and its sessions' exact-upscale presentation statements, whose sink-made
pictures name their prior or model. A verifier refuses a set outside the policy
(`model_not_in_policy`), a revoked set run at or after its revocation (`model_revoked`), a period
outside the policy's time in force (`policy_expired`, `policy_not_yet_valid`), a run below the
policy's tier (`model_tier_below_policy`) and a float path claiming decode-equivalence
(neural-dispatch's `dispatch_tier_refused`). The operator's roll-up (`wai-model-rollup`) states per
class the reports, the devices that reported and those enrolled that did not, and each set's
decodes by unit, frames and pixels, recomputed from the reports (`rollup_mismatch`).
neural-dispatch §5, exact-upscale §6.2 and fleet §1 point to it; no record they define changes.

The reference is the `model_policy` module of wai-rs (feature `model_policy`, in `full`);
`wai model verify` (catalogue `model.verify`) verifies a bundle (`*.wai-models.json`), and `wai
verify` reads a bundle and each record alone. The corpus is live-conformance/models/ (57 bundles:
3 accepted, 54 refused, every reason of §10 and every reused reason at least once), and
model_policy_verify.py is its second implementation, written from the text: it agrees on every
outcome, reason, place and statement, 14 of 14 mutated copies fail, and 51 of 51 weakened
verifiers are caught. vectors.json has one SHA-256 when generated on x86_64 and on arm64. 22
faults planted in the reference (a capability or role ignored, the revocation instant excluded, a
sealed set's inner identity ignored, the successor's start ignored, expiry unchecked, a float
path's claimed tier believed, silent devices and units miscounted, the signing domain, a period's
end included, the attestation's span, a statement counted twice, overlap, the roll-up's signer
and reports, a path's arithmetic, pictures' revocation, the tier compared the wrong way, the
successor chain, the key log ignored, an unnamed model admitted) each fail its tests. The
registry export, the operation catalogue and Studio's actions are regenerated by their tools.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-11-10 14:23:40 -05:00
..
core wai 0.6.0 2026-11-09 16:17:06 -05:00
e2e WAI Studio: Escape closes the palette from its search field too; the e2e holds it 2026-10-28 02:08:48 -04:00
scripts WAI Studio on the web: one front end, its core in WebAssembly, served by wai dev at /_wai/ 2026-10-27 15:22:51 -04:00
src wai.sink.models: which models a fleet's sinks may run, and what they ran 2026-11-10 14:23:40 -05:00
test WAI Studio e2e: a publisher in the room before a viewer joins; WebKit on Linux in Playwright's image; scrollable blocks focusable; Quantum Studio's critique a named group 2026-10-27 16:17:25 -04:00
.gitignore WAI Studio on the web: one front end, its core in WebAssembly, served by wai dev at /_wai/ 2026-10-27 15:22:51 -04:00
build.mjs WAI Studio on the web: one front end, its core in WebAssembly, served by wai dev at /_wai/ 2026-10-27 15:22:51 -04:00
package-lock.json WAI Studio on the web: one front end, its core in WebAssembly, served by wai dev at /_wai/ 2026-10-27 15:22:51 -04:00
package.json WAI Studio on the web: one front end, its core in WebAssembly, served by wai dev at /_wai/ 2026-10-27 15:22:51 -04:00
README.md WAI Studio: README, CI (wai-studio.yml, cli_studio in the quickstart step), one target directory per workspace in e2e/run.sh 2026-10-27 15:38:01 -04:00

WAI Studio on the web

One front end for the WAI toolchain, with two hosts, chosen when the page starts:

  • hosted: the core in WebAssembly, in the tab. What you open is read there; nothing is uploaded, and there is no account. The WAI site serves it at /studio/.
  • local: served by wai dev at /_wai/, on the origin it already serves on loopback. The core in WebAssembly does what a tab can, and the local wai does the rest, reached through the dev stack's own routes (/_wai/api/).

The panels

Panel Hosted Through wai dev
Inspect A .wai file opened or dropped: its envelope, its capabilities with the registry's row for each, its provenance (what it refines, what it was derived from, its security), SPEC §4's verdict at this sink, and its receipts when its receipt index is opened with it The same, and the local wai's own report, with every codec it holds
Verify and receipts Receipt indexes with their group receipts, and the object where it is opened too, checked in the tab by the verifier wai verify runs, each line with its reason code The same
Encode, decode, package The mandatory floor: decode PNG, FLAC and zstd, encode PNG and zstd; any registered capability's bytes wrapped in an envelope The same, and every codec the local wai holds
Rooms A room's signed description from its service; join it as a viewer, through the room client; a pre-call test of a relay (its WebSocket binding and its SETUP, timed) The same, against the dev room
Run — The stack wai dev started: its routes, each service and the loopback address it listens on, the room service's health, the relay's session records, each log as it grows
Quantum Quantum Studio (../quantum-studio/), unchanged, as a panel The same

The command palette (the top bar's button, or Ctrl+K, ⌘K on macOS) lists every operation of the WAI catalogue by its id. One this host runs opens the panel that runs it; one it does not says where it runs: its command line, its wai mcp tool, the service route it is served at, or Studio served by wai dev.

The actions come from the catalogue

The operation catalogue (../catalogue/ops.json, written by wai ops export from the table in wai-rs) names every operation. scripts/actions.mjs generates Studio's action table from it (src/actions.generated.js), and src/bindings.js binds by hand the operations Studio runs: their panel, and how each host runs them (in the tab, through the local wai, or by the page). node scripts/actions.mjs --check fails on drift:

  • an action with no operation: a binding, a call of the core, or an operation wai dev runs for the page, whose id the catalogue does not hold;
  • an operation placed client or both (it runs on this side of a service, as a page does) with no action;
  • a mismatched name: the generated table not what the catalogue generates; a binding run in the tab whose call is not the core's noun_verb; a call of the core or an operation of wai dev bound to another host than the one that runs it; an operation id in the source that names no operation.

Until the catalogue is on main, ops.pending.json is a copy of its export from the pull request that brings it, and the check reads that; once ../catalogue/ops.json exists, the check reads it and fails until the copy is deleted.

The core

core/ (wai-studio-core) is the wai crate the command line is built from, with the floor and the receipt checks, bound for WebAssembly. Each call is an operation of the catalogue, named noun_verb, and answers the JSON envelope (envelope/1) the command line prints with --json: envelope_inspect, envelope_wrap, envelope_unwrap, media_decode, media_encode, receipt_verify, registry_list. It reads no file and opens no connection.

cd core && cargo build --locked --release --target wasm32-unknown-unknown
wasm-bindgen --target web --out-dir pkg --out-name wai_studio_core \
  "$CARGO_TARGET_DIR/wasm32-unknown-unknown/release/wai_studio_core.wasm"

The floor's zstd is C: its archive for wasm32 needs an archiver that indexes WebAssembly objects, llvm-ar (AR_wasm32_unknown_unknown); macOS's own ar writes one the linker finds no symbol in. e2e/run.sh picks llvm-ar where there is one.

Building and hosting

npm ci && node build.mjs --core-pkg core/pkg [--quantum ../quantum-studio/dist]

writes dist/: wai-studio.js, wai-studio-worker.js, wai-studio.css, tokens.css, the core in pkg/, Quantum Studio in quantum/ when given, index.html (the local host's page) and hosted.html (the hosted host standing alone), and BUILD.json with each file's SHA-256.

wai dev serves dist/ at /_wai/ when it finds it: $WAI_STUDIO, or share/wai/studio beside the wai binary. A host page mounts Studio on an element:

<div id="wai-studio" data-host="hosted" data-embedded
     data-core-pkg="/studio/pkg/wai_studio_core.js" data-worker="/studio/wai-studio-worker.js"
     data-service="/room-api" data-room-page="/studio/room.html"
     data-moq-transport="/room/room-transport.js" data-moq-session="/room/room-session.js"
     data-moq-pkg="/room/moq/pkg/wai_room_moq.js"
     data-quantum-script="/quantum-studio/studio.js" data-quantum-css="/quantum-studio/studio.css"
     data-quantum-pkg="/quantum-ide/pkg/wai_quantum_ide.js" data-quantum-worker="/quantum-studio/worker.js"
     data-quantum-service="/quantum-jobs"></div>
<script type="module" src="/studio/wai-studio.js"></script>

The dev stack's routes for Studio

wai dev opens no listener for Studio. Under /_wai/api/ on its origin:

Route What it answers
GET /_wai/api/state the stack: origin, room service, relay, each service with its process and loopback address, its logs, what the local wai decodes and encodes
GET /_wai/api/log?name=&from= a log (relay, room, conversation) from a byte on
GET /_wai/api/sessions the relay's session records
POST /_wai/api/op/<id> envelope.inspect, media.decode or media.encode, run by the local wai on the bytes sent, in a directory of its own, removed after

Every request must name the origin as its host (127.0.0.1:<port>, localhost:<port> or [::1]:<port>), carry X-WAI-Studio: 1, and state no other origin or fetch site.

Testing it

bash e2e/run.sh [--browsers chromium,webkit,firefox]

builds wai, the relay, the room service, the core, the room client's packages, the quantum engine, Quantum Studio and Studio; runs the unit tests (test/: the generation and every rule of the drift check, the palette's "where it runs", the local core's calls, and each panel's calls on the core) and the drift check; then e2e/studio.e2e.mjs against a wai dev stack, on both hosts, in Chromium, WebKit and Firefox:

  • each panel the host shows loads, and Run on the local host alone;
  • Inspect and Verify on vectors of ../http-conformance/, their results those its cases expect;
  • the floor decoded and encoded in the tab, a payload wrapped and inspected;
  • the dev room joined as a viewer, and the pre-call test against its relay;
  • the stack in Run, every service on loopback;
  • Quantum Studio mounted;
  • the palette: every operation, one this host runs opening its panel, one it does not saying where it runs;
  • axe finds no WCAG 2.2 A or AA violation on any panel; no console error, no failed request; nothing scrolls sideways at a phone's width.

core/ has its own tests (cargo test --locked), and wai-rs/tests/cli_studio.rs runs wai dev against a stand-in relay and room service: /_wai/ answers, every socket the stack listens on is on loopback, and the local wai runs an operation for the page.

Apache-2.0.