Some checks failed
no-vanity-metrics / Scan committed Markdown for vanity metrics (pull_request) Successful in 3s
standards workspaces build + test / eoc-rs (pull_request) Successful in 1m48s
standards workspaces build + test / jcp-rs (pull_request) Successful in 1m17s
standards workspaces build + test / proof-rs (pull_request) Successful in 1m16s
standards workspaces build + test / sandbox-rs (pull_request) Successful in 2m7s
standards workspaces build + test / smart-byte-rs (pull_request) Successful in 2m29s
wai cross-architecture byte-equality / linux-x86_64 (pull_request) Successful in 22s
WAI conformance / cargo-class corpora · linux (pull_request) Successful in 2m7s
WAI conformance / cross-arch byte-equality · linux (pull_request) Successful in 22s
WAI conformance / C2PA manifest emission · signed, read back, validated (pull_request) Successful in 42s
WAI energy receipts / energy receipts · linux (pull_request) Successful in 39s
wai formal verification (integer core) / kani (pull_request) Successful in 4m59s
WAI JPEG-AI whole decode (pinned inputs, required) / fetch pinned JPEG-AI inputs → whole decode + pixel hash, required (pull_request) Successful in 52s
WAI neural decoders end-to-end / synthetic fixtures → Rust decode → reference (±4) (pull_request) Failing after 1m7s
standards workspaces build + test / jouleclaw-rs (pull_request) Successful in 6m49s
WAI neural sink gates / model-free refusals of the neural sink (pull_request) Successful in 24s
WAI mbt2018_mean integer decode (regenerated vectors) / regenerate mbt2018_mean integer vectors → Rust decode, required (pull_request) Successful in 2m28s
standards workspaces build + test / aac-rs (pull_request) Successful in 3m25s
standards workspaces build + test / joule-code-rs (pull_request) Successful in 3m46s
standards workspaces build + test / joulecontract-rs (pull_request) Successful in 1m22s
standards workspaces build + test / map-rs (pull_request) Successful in 2m16s
standards workspaces build + test / mesh-rs (pull_request) Successful in 2m3s
standards workspaces build + test / openpay (pull_request) Successful in 18m29s
wai cross-architecture byte-equality / linux-aarch64 (pull_request) Successful in 1m58s
WAI conformance / cargo-class corpora · linux-arm64 (pull_request) Failing after 7s
WAI conformance / cross-arch byte-equality · linux-arm64 (pull_request) Failing after 7s
WAI energy receipts / energy receipts · linux-arm64 (pull_request) Failing after 8s
standards workspaces build + test / arl-rs (pull_request) Successful in 3m49s
standards workspaces build + test / joule-ui-rs (pull_request) Successful in 3m19s
standards workspaces build + test / jouledesk-rs (pull_request) Successful in 3m45s
standards workspaces build + test / joulehook-rs (pull_request) Successful in 3m17s
standards workspaces build + test / sense-rs (pull_request) Successful in 4m0s
standards workspaces build + test / macOS energy backend (jcp-energy) (pull_request) Successful in 3m42s
wai cross-architecture byte-equality / macos-arm64 (reference) (pull_request) Successful in 27s
WAI conformance / cargo-class corpora · macos (pull_request) Successful in 2m43s
WAI conformance / cross-arch byte-equality · macos (pull_request) Successful in 28s
WAI energy receipts / energy receipts · macos (pull_request) Successful in 1m14s
wai cross-architecture byte-equality / windows-x86_64 (pull_request) Has been cancelled
WAI conformance / cargo-class corpora · windows (pull_request) Has been cancelled
WAI conformance / cross-arch byte-equality · windows (pull_request) Has been cancelled
The single `HwShunt` acquisition class covered both an on-chip vendor counter (RAPL, NVML, SMC, IOReport) and an external calibrated shunt. They are different evidence: a calibrated instrument's uncertainty is traceable to a calibration, while a counter is a vendor's reading whose error the vendor states (RAPL readings are deliberately noised when SGX or TDX is enabled, per security advisory INTEL-SA-00389). - extensions/energy-measurement.md §2 splits hardware evidence into `OnChipCounter` and `CalibratedInstrument`, each with a required declared uncertainty (relative error and integration window). IOReport is an on-chip counter, like RAPL and NVML. `HwShunt` stays readable as the legacy class, ranked below both, and is not sealed into a new WAI receipt. - Every receipt family that carries joules — video, world, film, reel, haptic, score, splat4d, audio scene, ternary, provenance and the wai-quantum receipts — can carry its class. The label is additive: every committed signed vector still verifies, and the signed bytes of unlabelled and legacy-labelled receipts are pinned by tests. A sealed figure declares its 1 µJ resolution, and the floor is stated as the rule verified (0.5/√3 µJ). - The acquisition rules are scoped to the receipt profiles WAI defines, and the text says what enforces each one. - Meters open their window from rest, report an all-zero power reader as unusable rather than clean, and state the running-window count model as conservative. - oer-receipts.md maps OER's evidential grade onto the refined classes. The rule that a producer must not grade `measured` a figure whose class is `Estimator` is kept as settled on main. - wai-quantum verifies a receipt in either form on every in-tree verify path, including wai-quantum-serve's POST /verify. - CI: wai-energy-receipts.yml runs the energy-class, label and legacy-pin tests for wai-rs, wai-quantum and wai-quantum-serve, which no workflow enabled before. Co-Authored-By: Claude Opus 5.5 <[email protected]>
109 lines
4.6 KiB
Markdown
109 lines
4.6 KiB
Markdown
# WAI Extension: Score (Music as Instructions)
|
||
|
||
> Status: Draft. Phase 6 — the deepest audio lever. Ship the
|
||
> composition, not the recording: a score of note events the sink
|
||
> synthesizes. Conformance is **mixdown-equivalence**, the music
|
||
> counterpart of spatial audio. Reference impl: the `score` feature of
|
||
> `wai-rs`; corpus: `score-conformance/`; live sink:
|
||
> wai.transaction.science/score.
|
||
Keywords **MUST**, **MUST NOT**, **SHOULD**, **MAY** are RFC 2119/8174.
|
||
|
||
## 1. Scope and model
|
||
|
||
A `wai.audio.score` object carries **no recorded audio** — only note
|
||
events. Where `wai.audio.scene` mixes recorded sound *objects*, a score
|
||
is reconstructed from instructions: a deterministic reference synth
|
||
turns the notes into a canonical PCM mixdown, and a sink with a richer
|
||
instrument (soundfont, neural) renders the same score for presentation.
|
||
It is lever 3 (instructions-at-the-sink) for music — a minute of music
|
||
is kilobytes of notes, not megabytes of samples.
|
||
|
||
In scope: the container, the note model, the deterministic reference
|
||
synthesis, the **mixdown-equivalence** conformance criterion, the
|
||
receipt profile. Out of scope: a transport; the sink's instrument
|
||
(soundfonts, neural synths — presentation, not conformance); MIDI-file
|
||
import (an authoring concern).
|
||
|
||
Relationship to the core spec: mirrors spatial audio. The reconstruct
|
||
runs in the `wai.det.fixed64` floor; `media` takes the value `"audio"`;
|
||
`wai.audio.score` is authoritative.
|
||
|
||
## 2. Container (`WSCR`)
|
||
|
||
```
|
||
"WSCR" | u16 n_sections | section table (u8 kind, u32 off, u32 len) | sections
|
||
```
|
||
|
||
| kind | section | required |
|
||
|---|---|---|
|
||
| `0x01` | contract (canonical JSON) | REQUIRED |
|
||
| `0x02` | note events | REQUIRED |
|
||
|
||
### 2.1 Contract
|
||
|
||
```json
|
||
{ "channels": 1, "duration": 34000, "numeric": "wai.det.fixed64",
|
||
"sample_rate": 22050 }
|
||
```
|
||
|
||
`duration` is the rendered mixdown length in samples.
|
||
|
||
### 2.2 Notes
|
||
|
||
`n_notes u32`, then per note (65 bytes):
|
||
`start u64 | dur u64 | phase_inc i64 Fx | gain i64 Fx | waveform u8 |
|
||
attack u64 | decay u64 | sustain i64 Fx | release u64`.
|
||
|
||
`phase_inc` is the per-sample phase advance `freq / sample_rate`,
|
||
authored off-line from the pitch — so the floor never evaluates an
|
||
exponential to turn a note into a frequency (the same authoring
|
||
discipline as the avatar quaternion). `waveform` selects a reference
|
||
timbre: `0` saw, `1` square, `2` triangle, `3` 25%-pulse.
|
||
|
||
## 3. Reference synthesis (trig-free)
|
||
|
||
For each note, a phase accumulator advances by `phase_inc` each sample
|
||
(wrapping at `1.0`); a **piecewise-linear** oscillator maps the phase to
|
||
`[-1, 1]` (no trig); a **linear ADSR** envelope (attack ramp → decay to
|
||
`sustain` → held until `dur` → release to zero over `release`) scales
|
||
it; the result times `gain` accumulates into the mixdown buffer. Each
|
||
output sample is quantized to `i16` (`round(v · 32767)`, half away from
|
||
zero, clamped) in integer space. The whole path is `+ − × ÷` in the
|
||
`Fx` floor — bit-identical on every machine.
|
||
|
||
## 4. Conformance — mixdown-equivalence
|
||
|
||
> Given the same `wai.audio.score`, a conforming sink MUST reconstruct
|
||
> the identical canonical `i16` PCM via the reference synth, hence the
|
||
> identical BLAKE3 — on every machine, no tolerance parameter.
|
||
|
||
```
|
||
mixdown_hash = BLAKE3("wai:score-mixdown\x01" || i16le PCM)
|
||
score_hash = BLAKE3("wai:score\x01" || contract || notes) // identity
|
||
```
|
||
|
||
A sink MAY play a soundfont/neural instrument instead; that is
|
||
presentation and does not affect conformance, exactly as the audio-scene
|
||
HRTF render or the worlds renderer does not.
|
||
|
||
## 5. Receipt (JWP profile)
|
||
|
||
`score_hash` is the identity; the group's objects are the mix PCM blocks
|
||
(per a fixed sample span), Merkle-bound; one Ed25519 signature over
|
||
score_hash + root + exact work (= duration × notes) + carried
|
||
`joules_micro`; `parent_receipt_hash` chains — the worlds/audio receipt
|
||
shape reused. The figure's acquisition class rides beside it as an optional signed label
|
||
([energy-measurement](energy-measurement.md) §2.8): absent, the receipt keeps
|
||
its legacy bytes and the figure is unlabelled; present, it is inside the
|
||
signature. The reference meter labels every figure it measures
|
||
`OnChipCounter`, with its declared uncertainty.
|
||
|
||
## Appendix
|
||
|
||
Mixdown-equivalence is spatial audio's criterion with the recorded
|
||
objects replaced by note events: both render a deterministic `i16` mix
|
||
in the `Fx` floor and hash it. The score is the most extreme
|
||
instructions-at-the-sink case in audio — there is no recording anywhere
|
||
in the payload, only the composition. Sight, hearing, touch, motion,
|
||
state, captured-content provenance — and now the composition itself —
|
||
are one floor, one verification.
|