open-standards/wai/live-conformance/audio-mark/robustness/measured/measurement-voice.json
Transaction Science 63e856b226
Some checks failed
joule-moq-web browser client / joule-moq-web · does this change touch it (push) Successful in 8m12s
WAI operation catalogue / does this change touch it (push) Successful in 8m3s
wai-app and Create / wai-app · does this change touch it (push) Successful in 8m7s
joule-moq-room room service / joule-moq-room · does this change touch it (push) Successful in 8m21s
joule-moq-remote host agent / joule-moq-remote · does this change touch it (push) Successful in 8m24s
wai-audit collector and player integration / does this change touch it (push) Successful in 8m6s
wai-key-proxy / does this change touch it (push) Successful in 7m59s
wai-fleet service / does this change touch it (push) Successful in 8m2s
wai-quantum studio and desktop / does this change touch it (push) Successful in 1m40s
wai-ledger service / does this change touch it (push) Successful in 1m42s
wai-quantum for JavaScript / does this change touch it (push) Successful in 1m43s
wai-sink-android native sink library / does this change touch it (push) Successful in 1m41s
WAI Studio / does this change touch it (push) Successful in 1m40s
wai-sink-swift native sink package / does this change touch it (push) Successful in 1m41s
joule-moq-remote host agent / joule-moq-remote, every target (macos) (push) Successful in 46s
wai-audit collector and player integration / collector, player integration and the browser end to end · macos (push) Successful in 1m40s
wai-fleet service / service · macos (push) Successful in 47s
wai-app and Create / wai-app · Create, browser end-to-end (macos) (push) Successful in 5m44s
wai-ledger service / service · macos (push) Successful in 50s
wai-quantum studio and desktop / desktop app · macos (push) Successful in 4m37s
repository checks / lockfiles, advisories, tests in CI, workflow hygiene, spec and section references, public text (push) Has been cancelled
wai-app and Create / wai-app · tests, clippy, the line language's verifier (linux) (push) Has been cancelled
wai-fleet service / service · linux (push) Has been cancelled
joule-moq-web browser client / joule-moq-web · browser end-to-end (macos) (push) Has been cancelled
wai-ledger service / service · linux (push) Has been cancelled
WAI Studio / the catalogue's actions, the unit tests and the core · linux (push) Has been cancelled
WAI Studio / Studio in WebKit · linux (push) Has been cancelled
WAI Studio / Studio in Chromium and Firefox · macos (push) Has been cancelled
wai-sink-android native sink library / every ABI, the AAR, and the instrumented tests in a headless emulator · macos (push) Successful in 7m9s
wai-sink-swift native sink package / libwai slices, desktop tests, simulator tests · macos (push) Successful in 10m50s
wai-quantum studio and desktop / desktop app · windows (push) Successful in 10m5s
WAI breaking changes and the conformance runner / WAI breaking · does this change touch WAI (push) Successful in 8s
wai-quantum energy-landscape jobs / does this change touch it (push) Successful in 8s
wai-audit collector and player integration / collector · linux (push) Successful in 1m50s
wai-key-proxy / proxy · linux (push) Successful in 1m37s
wai-quantum energy-landscape jobs / the same bits · macos (push) Successful in 3m28s
WAI operation catalogue / the catalogue and every door · linux (push) Successful in 9m6s
wai-quantum studio and desktop / studio · browser (push) Successful in 7m10s
wai-quantum for JavaScript / javascript · linux (push) Successful in 6m42s
wai-quantum studio and desktop / desktop app · linux (push) Successful in 9m10s
WAI breaking changes and the conformance runner / WAI breaking · wire, record and API against main · linux (push) Successful in 2m38s
wai-quantum energy-landscape jobs / the module under wasm32-wasip2 (wasmtime) (push) Successful in 2m38s
wai-quantum energy-landscape jobs / native against WebAssembly, over many seeds (push) Successful in 5m0s
WAI breaking changes and the conformance runner / WAI breaking and conform · their tests, and the independent verifiers through wai conform · linux (push) Successful in 7m33s
wai-quantum energy-landscape jobs / reader, kernels, answers and the stated result · linux, release (push) Successful in 17m45s
joule-moq-remote host agent / joule-moq-remote, every target (linux-arm64) (push) Successful in 1m42s
joule-moq-room room service / joule-moq-room, every target (push) Successful in 4m49s
wai-sink-android native sink library / the JNI layer and the platform-free half on the host JVM · linux-arm64 (push) Successful in 4m25s
wai-quantum energy-landscape jobs / the same bits · linux-arm64 (push) Successful in 7m38s
wai: register wai-mark:band64, a watermark for sound, peer of tent64
synthesis §7.10 registers the second marking layer for speech and other audio: the same
8-byte payload and BCH code as tent64, the same marking and detection records and failure
codes (audio states rate, channels and length), embedded by a pinned integer derivation in
the band energies of the mono mix and read key-free after trims, rate and level changes and
the codecs §7.10.7 measures. robustness-evidence registers audio corpora, ten pinned
transforms of sound and the lossy codecs as measured transforms, whose records are stated.

Reference in wai-rs (synthesis::mark::audio, audio_mark, robustness::audio,
wai_audio_mark_vectors), second implementation in _wai_audio_mark.py with
audio_mark_verify.py, corpus in live-conformance/audio-mark/ with records measured on
generated voices and music and on recorded speech named by digest.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-11-08 16:20:24 -05:00

710 lines
13 KiB
JSON

{
"items": [
{
"set": "voice",
"item": "voice-00",
"snr": "24.74",
"segmental_snr": "27.64",
"cells": 762,
"silent": 234
},
{
"set": "voice",
"item": "voice-01",
"snr": "24.06",
"segmental_snr": "27.54",
"cells": 756,
"silent": 240
},
{
"set": "voice",
"item": "voice-02",
"snr": "24.76",
"segmental_snr": "27.20",
"cells": 779,
"silent": 217
},
{
"set": "voice",
"item": "voice-03",
"snr": "23.91",
"segmental_snr": "26.91",
"cells": 769,
"silent": 227
},
{
"set": "voice",
"item": "voice-04",
"snr": "23.12",
"segmental_snr": "26.44",
"cells": 787,
"silent": 209
},
{
"set": "voice",
"item": "voice-05",
"snr": "24.80",
"segmental_snr": "27.40",
"cells": 818,
"silent": 178
},
{
"set": "voice",
"item": "voice-06",
"snr": "25.18",
"segmental_snr": "26.88",
"cells": 816,
"silent": 180
},
{
"set": "voice",
"item": "voice-07",
"snr": "23.05",
"segmental_snr": "25.83",
"cells": 803,
"silent": 193
},
{
"set": "voice",
"item": "voice-08",
"snr": "24.47",
"segmental_snr": "27.10",
"cells": 793,
"silent": 203
},
{
"set": "voice",
"item": "voice-09",
"snr": "24.68",
"segmental_snr": "27.19",
"cells": 777,
"silent": 219
},
{
"set": "voice",
"item": "voice-10",
"snr": "24.13",
"segmental_snr": "26.86",
"cells": 772,
"silent": 224
},
{
"set": "voice",
"item": "voice-11",
"snr": "23.81",
"segmental_snr": "26.86",
"cells": 789,
"silent": 207
},
{
"set": "voice",
"item": "voice-12",
"snr": "24.59",
"segmental_snr": "26.89",
"cells": 771,
"silent": 225
},
{
"set": "voice",
"item": "voice-13",
"snr": "25.09",
"segmental_snr": "26.64",
"cells": 786,
"silent": 210
},
{
"set": "voice",
"item": "voice-14",
"snr": "25.92",
"segmental_snr": "26.59",
"cells": 817,
"silent": 179
},
{
"set": "voice",
"item": "voice-15",
"snr": "24.08",
"segmental_snr": "26.59",
"cells": 781,
"silent": 215
}
],
"attacks": [
"none",
"gain-1/4",
"gain-1/2",
"gain-3/2",
"trim-start-500",
"trim-start-1310",
"trim-both-1000",
"resample-8000",
"resample-48000",
"resample-44100",
"resample-trip-8000",
"noise-64",
"noise-512",
"mix-noise-30dB",
"mix-noise-20dB",
"mix-noise-10dB",
"mulaw",
"requantize-8",
"echo-50ms",
"echo-150ms",
"mono",
"opus-6k",
"opus-8k",
"opus-12k",
"opus-16k",
"opus-24k",
"opus-32k",
"opus-64k",
"mp3-32k",
"mp3-64k",
"aac-32k",
"aac-64k",
"g722",
"g726-32k",
"g723-1"
],
"table": [
{
"attack": "none",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "gain-1/4",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 2,
"missed": []
},
{
"attack": "gain-1/2",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 1,
"missed": []
},
{
"attack": "gain-3/2",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "trim-start-500",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 4,
"missed": []
},
{
"attack": "trim-start-1310",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 29,
"missed": []
},
{
"attack": "trim-both-1000",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 4,
"missed": []
},
{
"attack": "resample-8000",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 4,
"missed": []
},
{
"attack": "resample-48000",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "resample-44100",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 2,
"missed": []
},
{
"attack": "resample-trip-8000",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 2,
"missed": []
},
{
"attack": "noise-64",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 28,
"missed": []
},
{
"attack": "noise-512",
"set": "voice",
"items": 16,
"survived": 0,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": [
"voice-00",
"voice-01",
"voice-02",
"voice-03",
"voice-04",
"voice-05",
"voice-06",
"voice-07",
"voice-08",
"voice-09",
"voice-10",
"voice-11",
"voice-12",
"voice-13",
"voice-14",
"voice-15"
]
},
{
"attack": "mix-noise-30dB",
"set": "voice",
"items": 16,
"survived": 15,
"wrong": 0,
"false_positives": 0,
"errors_max": 26,
"missed": [
"voice-03"
]
},
{
"attack": "mix-noise-20dB",
"set": "voice",
"items": 16,
"survived": 1,
"wrong": 0,
"false_positives": 0,
"errors_max": 29,
"missed": [
"voice-00",
"voice-02",
"voice-03",
"voice-04",
"voice-05",
"voice-06",
"voice-07",
"voice-08",
"voice-09",
"voice-10",
"voice-11",
"voice-12",
"voice-13",
"voice-14",
"voice-15"
]
},
{
"attack": "mix-noise-10dB",
"set": "voice",
"items": 16,
"survived": 0,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": [
"voice-00",
"voice-01",
"voice-02",
"voice-03",
"voice-04",
"voice-05",
"voice-06",
"voice-07",
"voice-08",
"voice-09",
"voice-10",
"voice-11",
"voice-12",
"voice-13",
"voice-14",
"voice-15"
]
},
{
"attack": "mulaw",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 26,
"missed": []
},
{
"attack": "requantize-8",
"set": "voice",
"items": 16,
"survived": 2,
"wrong": 0,
"false_positives": 0,
"errors_max": 27,
"missed": [
"voice-00",
"voice-01",
"voice-02",
"voice-03",
"voice-04",
"voice-07",
"voice-08",
"voice-09",
"voice-10",
"voice-11",
"voice-12",
"voice-13",
"voice-14",
"voice-15"
]
},
{
"attack": "echo-50ms",
"set": "voice",
"items": 16,
"survived": 1,
"wrong": 0,
"false_positives": 0,
"errors_max": 27,
"missed": [
"voice-00",
"voice-01",
"voice-02",
"voice-03",
"voice-04",
"voice-05",
"voice-07",
"voice-08",
"voice-09",
"voice-10",
"voice-11",
"voice-12",
"voice-13",
"voice-14",
"voice-15"
]
},
{
"attack": "echo-150ms",
"set": "voice",
"items": 16,
"survived": 15,
"wrong": 0,
"false_positives": 0,
"errors_max": 29,
"missed": [
"voice-11"
]
},
{
"attack": "mono",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "opus-6k",
"set": "voice",
"items": 16,
"survived": 0,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": [
"voice-00",
"voice-01",
"voice-02",
"voice-03",
"voice-04",
"voice-05",
"voice-06",
"voice-07",
"voice-08",
"voice-09",
"voice-10",
"voice-11",
"voice-12",
"voice-13",
"voice-14",
"voice-15"
]
},
{
"attack": "opus-8k",
"set": "voice",
"items": 16,
"survived": 0,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": [
"voice-00",
"voice-01",
"voice-02",
"voice-03",
"voice-04",
"voice-05",
"voice-06",
"voice-07",
"voice-08",
"voice-09",
"voice-10",
"voice-11",
"voice-12",
"voice-13",
"voice-14",
"voice-15"
]
},
{
"attack": "opus-12k",
"set": "voice",
"items": 16,
"survived": 2,
"wrong": 0,
"false_positives": 0,
"errors_max": 28,
"missed": [
"voice-00",
"voice-01",
"voice-02",
"voice-03",
"voice-04",
"voice-07",
"voice-08",
"voice-09",
"voice-10",
"voice-11",
"voice-12",
"voice-13",
"voice-14",
"voice-15"
]
},
{
"attack": "opus-16k",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 25,
"missed": []
},
{
"attack": "opus-24k",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 9,
"missed": []
},
{
"attack": "opus-32k",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 2,
"missed": []
},
{
"attack": "opus-64k",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "mp3-32k",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 6,
"missed": []
},
{
"attack": "mp3-64k",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 3,
"missed": []
},
{
"attack": "aac-32k",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 14,
"missed": []
},
{
"attack": "aac-64k",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 3,
"missed": []
},
{
"attack": "g722",
"set": "voice",
"items": 16,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 25,
"missed": []
},
{
"attack": "g726-32k",
"set": "voice",
"items": 16,
"survived": 15,
"wrong": 0,
"false_positives": 0,
"errors_max": 28,
"missed": [
"voice-09"
]
},
{
"attack": "g723-1",
"set": "voice",
"items": 16,
"survived": 0,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": [
"voice-00",
"voice-01",
"voice-02",
"voice-03",
"voice-04",
"voice-05",
"voice-06",
"voice-07",
"voice-08",
"voice-09",
"voice-10",
"voice-11",
"voice-12",
"voice-13",
"voice-14",
"voice-15"
]
}
],
"unmarked": [],
"words": {
"count": 64,
"ones_mean": "123.89",
"ones_sd": "6.84",
"pairs": 1920,
"distance_mean": "124.30",
"distance_sd": "7.80",
"distance_min": 99
},
"false_positive_log2": "-54.43",
"survived": [
"none",
"gain-1/4",
"gain-1/2",
"gain-3/2",
"trim-start-500",
"trim-start-1310",
"trim-both-1000",
"resample-8000",
"resample-48000",
"resample-44100",
"resample-trip-8000",
"noise-64",
"mulaw",
"mono",
"opus-16k",
"opus-24k",
"opus-32k",
"opus-64k",
"mp3-32k",
"mp3-64k",
"aac-32k",
"aac-64k",
"g722"
]
}