open-standards/wai/extensions/volumetric.md
Transaction Science d009db9087
Some checks failed
no-vanity-metrics / Scan committed Markdown for vanity metrics (pull_request) Successful in 3s
standards workspaces build + test / eoc-rs (pull_request) Successful in 1m48s
standards workspaces build + test / jcp-rs (pull_request) Successful in 1m17s
standards workspaces build + test / proof-rs (pull_request) Successful in 1m16s
standards workspaces build + test / sandbox-rs (pull_request) Successful in 2m7s
standards workspaces build + test / smart-byte-rs (pull_request) Successful in 2m29s
wai cross-architecture byte-equality / linux-x86_64 (pull_request) Successful in 22s
WAI conformance / cargo-class corpora · linux (pull_request) Successful in 2m7s
WAI conformance / cross-arch byte-equality · linux (pull_request) Successful in 22s
WAI conformance / C2PA manifest emission · signed, read back, validated (pull_request) Successful in 42s
WAI energy receipts / energy receipts · linux (pull_request) Successful in 39s
wai formal verification (integer core) / kani (pull_request) Successful in 4m59s
WAI JPEG-AI whole decode (pinned inputs, required) / fetch pinned JPEG-AI inputs → whole decode + pixel hash, required (pull_request) Successful in 52s
WAI neural decoders end-to-end / synthetic fixtures → Rust decode → reference (±4) (pull_request) Failing after 1m7s
standards workspaces build + test / jouleclaw-rs (pull_request) Successful in 6m49s
WAI neural sink gates / model-free refusals of the neural sink (pull_request) Successful in 24s
WAI mbt2018_mean integer decode (regenerated vectors) / regenerate mbt2018_mean integer vectors → Rust decode, required (pull_request) Successful in 2m28s
standards workspaces build + test / aac-rs (pull_request) Successful in 3m25s
standards workspaces build + test / joule-code-rs (pull_request) Successful in 3m46s
standards workspaces build + test / joulecontract-rs (pull_request) Successful in 1m22s
standards workspaces build + test / map-rs (pull_request) Successful in 2m16s
standards workspaces build + test / mesh-rs (pull_request) Successful in 2m3s
standards workspaces build + test / openpay (pull_request) Successful in 18m29s
wai cross-architecture byte-equality / linux-aarch64 (pull_request) Successful in 1m58s
WAI conformance / cargo-class corpora · linux-arm64 (pull_request) Failing after 7s
WAI conformance / cross-arch byte-equality · linux-arm64 (pull_request) Failing after 7s
WAI energy receipts / energy receipts · linux-arm64 (pull_request) Failing after 8s
standards workspaces build + test / arl-rs (pull_request) Successful in 3m49s
standards workspaces build + test / joule-ui-rs (pull_request) Successful in 3m19s
standards workspaces build + test / jouledesk-rs (pull_request) Successful in 3m45s
standards workspaces build + test / joulehook-rs (pull_request) Successful in 3m17s
standards workspaces build + test / sense-rs (pull_request) Successful in 4m0s
standards workspaces build + test / macOS energy backend (jcp-energy) (pull_request) Successful in 3m42s
wai cross-architecture byte-equality / macos-arm64 (reference) (pull_request) Successful in 27s
WAI conformance / cargo-class corpora · macos (pull_request) Successful in 2m43s
WAI conformance / cross-arch byte-equality · macos (pull_request) Successful in 28s
WAI energy receipts / energy receipts · macos (pull_request) Successful in 1m14s
wai cross-architecture byte-equality / windows-x86_64 (pull_request) Has been cancelled
WAI conformance / cargo-class corpora · windows (pull_request) Has been cancelled
WAI conformance / cross-arch byte-equality · windows (pull_request) Has been cancelled
wai: on-chip counters and calibrated instruments are separate energy classes, and every joule-carrying receipt can say which
The single `HwShunt` acquisition class covered both an on-chip vendor
counter (RAPL, NVML, SMC, IOReport) and an external calibrated shunt. They
are different evidence: a calibrated instrument's uncertainty is traceable to
a calibration, while a counter is a vendor's reading whose error the vendor
states (RAPL readings are deliberately noised when SGX or TDX is enabled,
per security advisory INTEL-SA-00389).

- extensions/energy-measurement.md §2 splits hardware evidence into
  `OnChipCounter` and `CalibratedInstrument`, each with a required declared
  uncertainty (relative error and integration window). IOReport is an
  on-chip counter, like RAPL and NVML. `HwShunt` stays readable as the legacy
  class, ranked below both, and is not sealed into a new WAI receipt.
- Every receipt family that carries joules — video, world, film, reel,
  haptic, score, splat4d, audio scene, ternary, provenance and the wai-quantum
  receipts — can carry its class. The label is additive: every committed
  signed vector still verifies, and the signed bytes of unlabelled and
  legacy-labelled receipts are pinned by tests. A sealed figure declares its
  1 µJ resolution, and the floor is stated as the rule verified (0.5/√3 µJ).
- The acquisition rules are scoped to the receipt profiles WAI defines, and
  the text says what enforces each one.
- Meters open their window from rest, report an all-zero power reader as
  unusable rather than clean, and state the running-window count model as
  conservative.
- oer-receipts.md maps OER's evidential grade onto the refined classes. The
  rule that a producer must not grade `measured` a figure whose class is
  `Estimator` is kept as settled on main.
- wai-quantum verifies a receipt in either form on every in-tree verify
  path, including wai-quantum-serve's POST /verify.
- CI: wai-energy-receipts.yml runs the energy-class, label and legacy-pin
  tests for wai-rs, wai-quantum and wai-quantum-serve, which no workflow
  enabled before.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-09-29 01:27:37 -04:00

5.1 KiB
Raw Permalink Blame History

WAI Extension: Volumetric / 4D Splats

Status: Draft. Phase 5 of the cargo roadmap (the frontier). A scene that is volumetric and moves: ship a Gaussian cloud as per-Gaussian keyframed tracks, the sink interpolates the cloud at any frame and renders it with the EWA pipeline. Conformance is frame-state-equivalence. Reference impl: the splat4d feature of wai-rs; corpus: volumetric-conformance/; live sink: wai.transaction.science/volumetric. Keywords MUST, MUST NOT, SHOULD, MAY are RFC 2119/8174.

1. Scope and model

A wai.splat.4d object is a temporal Gaussian splat: the static splat (wai.splat.spz) is a single anisotropic-Gaussian cloud; this extension gives each Gaussian a keyframed track — position, scale, rotation, color, opacity over time — and the sink reconstructs the cloud at any frame by interpolating the tracks in the wai.det.fixed64 floor. It is lever 3 (instructions-at-the-sink) for volumetric capture: the wire carries the trajectories, the sink reconstructs the frame.

In scope: the container, the per-Gaussian keyframe model, the deterministic reconstruct contract, the frame-state-equivalence conformance criterion, and the receipt profile.

Out of scope: a transport; the render (EWA splatting, depth sort, alpha blend — the sink's, exactly as the static splat's rasterization is); a codec for the cloud bytes (a real capture is authored by an upstream 3DGS/4DGS pipeline; this extension carries and verifies its trajectories, it does not fit Gaussians to video).

Relationship to the core spec: mirrors haptics / spatial audio. The reconstruct runs in the wai.det.fixed64 floor; media takes the informational value "volumetric"; wai.splat.4d is authoritative.

2. Container (W4DS)

"W4DS" | u16 n_sections | section table (u8 kind, u32 off, u32 len) | sections
kind section required
0x01 contract (canonical JSON) REQUIRED
0x02 Gaussian tracks REQUIRED

2.1 Contract

{ "frame_rate": 30, "n_frames": 13, "n_gaussians": 2,
  "numeric": "wai.det.fixed64" }

2.2 Gaussian tracks

n_gaussians u32, then per Gaussian: n_keys u16, then n × ( frame u64 | pos[3] | scale[3] | rot[4] | color[3] | opacity ), the 14 attributes as i64 Fx in that field order. Each track MUST be ascending by frame. color and opacity are in [0, 1]; rot is a quaternion (x, y, z, w).

3. Reconstruct contract

For each Gaussian, at frame f: each of the 14 attributes is the Fx linear interpolation of the track's keyframes at f; before the first / after the last key the endpoint holds. The canonical reconstruction of a frame is n_gaussians u32 | per-Gaussian 14×i64 in the field order above. The floor stays trig-free — rotations interpolate component-wise (nlerp without renormalization, deterministic); the sink normalizes the quaternion for rendering, which is presentation.

4. Conformance — frame-state-equivalence

Given the same wai.splat.4d, a conforming sink MUST reconstruct the identical Gaussian set at every frame, hence the identical BLAKE3 — on every machine, no tolerance parameter.

frame_hash = BLAKE3("wai:splat4d-frame\x01" || frame_le || canonical frame bytes)
clip_hash  = BLAKE3("wai:splat4d-clip\x01"  || contract_bytes || tracks)

frame_hash is the temporal counterpart of the static splat's content hash; clip_hash is the frame-independent identity.

5. Fidelity and size (honest)

A splat approximates a captured scene, so wai.splat.4d is tiered Lossy like wai.splat.spz — even though the per-frame reconstruction from the tracks is frame-state-exact. Volumetric is heavy: a real cloud is megabytes per frame. The win here is the same as the static splat — content-addressing, dedup, one signed envelope, and a verifiable per-frame state — not payload reduction. We state that plainly rather than imply a compression claim the format does not make.

6. Receipt (JWP profile)

clip_hash is the identity; the group's objects are per-frame reconstruction blocks (frame_hash per frame), Merkle-bound; one Ed25519 signature over clip_hash + root + work (= n_frames × n_gaussians) + carried joules_micro; parent_receipt_hash chains — the worlds / audio / haptics receipt shape reused. The figure's acquisition class rides beside it as an optional signed label (energy-measurement §2.8): absent, the receipt keeps its legacy bytes and the figure is unlabelled; present, it is inside the signature. The reference meter labels every figure it measures OnChipCounter, with its declared uncertainty.

Appendix

Frame-state-equivalence is sample-equivalence with the haptic sample replaced by a whole Gaussian cloud, and the static splat extended to time. The same fixed-point floor that makes a world replay, a mix sum, an actuator buzz, a feed converge, and a body pose now makes a volumetric frame reconstruct — one floor, six cargo classes, one verification. The representation is heavy and approximate; the reconstruction of it is exact and auditable, and that is the honest thing the standard adds.