open-standards/wai/live-conformance/audio-mark/robustness/measured/measurement-speech.json
Transaction Science 63e856b226
Some checks failed
joule-moq-web browser client / joule-moq-web · does this change touch it (push) Successful in 8m12s
WAI operation catalogue / does this change touch it (push) Successful in 8m3s
wai-app and Create / wai-app · does this change touch it (push) Successful in 8m7s
joule-moq-room room service / joule-moq-room · does this change touch it (push) Successful in 8m21s
joule-moq-remote host agent / joule-moq-remote · does this change touch it (push) Successful in 8m24s
wai-audit collector and player integration / does this change touch it (push) Successful in 8m6s
wai-key-proxy / does this change touch it (push) Successful in 7m59s
wai-fleet service / does this change touch it (push) Successful in 8m2s
wai-quantum studio and desktop / does this change touch it (push) Successful in 1m40s
wai-ledger service / does this change touch it (push) Successful in 1m42s
wai-quantum for JavaScript / does this change touch it (push) Successful in 1m43s
wai-sink-android native sink library / does this change touch it (push) Successful in 1m41s
WAI Studio / does this change touch it (push) Successful in 1m40s
wai-sink-swift native sink package / does this change touch it (push) Successful in 1m41s
joule-moq-remote host agent / joule-moq-remote, every target (macos) (push) Successful in 46s
wai-audit collector and player integration / collector, player integration and the browser end to end · macos (push) Successful in 1m40s
wai-fleet service / service · macos (push) Successful in 47s
wai-app and Create / wai-app · Create, browser end-to-end (macos) (push) Successful in 5m44s
wai-ledger service / service · macos (push) Successful in 50s
wai-quantum studio and desktop / desktop app · macos (push) Successful in 4m37s
repository checks / lockfiles, advisories, tests in CI, workflow hygiene, spec and section references, public text (push) Has been cancelled
wai-app and Create / wai-app · tests, clippy, the line language's verifier (linux) (push) Has been cancelled
wai-fleet service / service · linux (push) Has been cancelled
joule-moq-web browser client / joule-moq-web · browser end-to-end (macos) (push) Has been cancelled
wai-ledger service / service · linux (push) Has been cancelled
WAI Studio / the catalogue's actions, the unit tests and the core · linux (push) Has been cancelled
WAI Studio / Studio in WebKit · linux (push) Has been cancelled
WAI Studio / Studio in Chromium and Firefox · macos (push) Has been cancelled
wai-sink-android native sink library / every ABI, the AAR, and the instrumented tests in a headless emulator · macos (push) Successful in 7m9s
wai-sink-swift native sink package / libwai slices, desktop tests, simulator tests · macos (push) Successful in 10m50s
wai-quantum studio and desktop / desktop app · windows (push) Successful in 10m5s
WAI breaking changes and the conformance runner / WAI breaking · does this change touch WAI (push) Successful in 8s
wai-quantum energy-landscape jobs / does this change touch it (push) Successful in 8s
wai-audit collector and player integration / collector · linux (push) Successful in 1m50s
wai-key-proxy / proxy · linux (push) Successful in 1m37s
wai-quantum energy-landscape jobs / the same bits · macos (push) Successful in 3m28s
WAI operation catalogue / the catalogue and every door · linux (push) Successful in 9m6s
wai-quantum studio and desktop / studio · browser (push) Successful in 7m10s
wai-quantum for JavaScript / javascript · linux (push) Successful in 6m42s
wai-quantum studio and desktop / desktop app · linux (push) Successful in 9m10s
WAI breaking changes and the conformance runner / WAI breaking · wire, record and API against main · linux (push) Successful in 2m38s
wai-quantum energy-landscape jobs / the module under wasm32-wasip2 (wasmtime) (push) Successful in 2m38s
wai-quantum energy-landscape jobs / native against WebAssembly, over many seeds (push) Successful in 5m0s
WAI breaking changes and the conformance runner / WAI breaking and conform · their tests, and the independent verifiers through wai conform · linux (push) Successful in 7m33s
wai-quantum energy-landscape jobs / reader, kernels, answers and the stated result · linux, release (push) Successful in 17m45s
joule-moq-remote host agent / joule-moq-remote, every target (linux-arm64) (push) Successful in 1m42s
joule-moq-room room service / joule-moq-room, every target (push) Successful in 4m49s
wai-sink-android native sink library / the JNI layer and the platform-free half on the host JVM · linux-arm64 (push) Successful in 4m25s
wai-quantum energy-landscape jobs / the same bits · linux-arm64 (push) Successful in 7m38s
wai: register wai-mark:band64, a watermark for sound, peer of tent64
synthesis §7.10 registers the second marking layer for speech and other audio: the same
8-byte payload and BCH code as tent64, the same marking and detection records and failure
codes (audio states rate, channels and length), embedded by a pinned integer derivation in
the band energies of the mono mix and read key-free after trims, rate and level changes and
the codecs §7.10.7 measures. robustness-evidence registers audio corpora, ten pinned
transforms of sound and the lossy codecs as measured transforms, whose records are stated.

Reference in wai-rs (synthesis::mark::audio, audio_mark, robustness::audio,
wai_audio_mark_vectors), second implementation in _wai_audio_mark.py with
audio_mark_verify.py, corpus in live-conformance/audio-mark/ with records measured on
generated voices and music and on recorded speech named by digest.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-11-08 16:20:24 -05:00

822 lines
17 KiB
JSON

{
"items": [
{
"set": "speech",
"item": "039718dd0f09d98c",
"snr": "20.35",
"segmental_snr": "24.25",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "075c40f1dc7dfb98",
"snr": "21.67",
"segmental_snr": "26.85",
"cells": 838,
"silent": 158
},
{
"set": "speech",
"item": "0faeb8ab5dc10b1c",
"snr": "21.57",
"segmental_snr": "27.96",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "0fca9c0b3f4d7095",
"snr": "23.91",
"segmental_snr": "28.80",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "101dad37803438cf",
"snr": "20.51",
"segmental_snr": "23.48",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "108d6f9723483cae",
"snr": "20.35",
"segmental_snr": "25.11",
"cells": 795,
"silent": 201
},
{
"set": "speech",
"item": "11c2dbe77afd462d",
"snr": "20.56",
"segmental_snr": "25.47",
"cells": 982,
"silent": 14
},
{
"set": "speech",
"item": "15fb15152c2650b4",
"snr": "22.97",
"segmental_snr": "27.30",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "163b2e67c7f2db1b",
"snr": "21.78",
"segmental_snr": "26.37",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "187d5f01b28adc5a",
"snr": "20.56",
"segmental_snr": "22.86",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "1bc8ee256c816e8b",
"snr": "21.22",
"segmental_snr": "25.23",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "1c6f6f4e4481da73",
"snr": "21.54",
"segmental_snr": "25.19",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "1e943f2af710db9b",
"snr": "20.25",
"segmental_snr": "24.14",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "227e984946ca139a",
"snr": "21.98",
"segmental_snr": "26.22",
"cells": 945,
"silent": 51
},
{
"set": "speech",
"item": "24c576a9d857fd68",
"snr": "20.55",
"segmental_snr": "24.14",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "26420bf51a42d897",
"snr": "20.30",
"segmental_snr": "25.34",
"cells": 797,
"silent": 199
},
{
"set": "speech",
"item": "271397c25cfd2a2b",
"snr": "22.08",
"segmental_snr": "26.73",
"cells": 978,
"silent": 18
},
{
"set": "speech",
"item": "2880a22c34fade01",
"snr": "21.35",
"segmental_snr": "26.90",
"cells": 838,
"silent": 158
},
{
"set": "speech",
"item": "2f781084ba73e675",
"snr": "23.36",
"segmental_snr": "26.12",
"cells": 984,
"silent": 12
},
{
"set": "speech",
"item": "36af40a6042146b6",
"snr": "23.33",
"segmental_snr": "28.37",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "385a1e9cf8f6e16f",
"snr": "20.29",
"segmental_snr": "24.93",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "3b7e3f519b3a5865",
"snr": "23.69",
"segmental_snr": "29.08",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "3bad15bb652017a5",
"snr": "24.68",
"segmental_snr": "29.34",
"cells": 996,
"silent": 0
},
{
"set": "speech",
"item": "3ce695ec62c95e60",
"snr": "20.45",
"segmental_snr": "25.87",
"cells": 996,
"silent": 0
}
],
"attacks": [
"none",
"gain-1/4",
"gain-1/2",
"gain-3/2",
"trim-start-500",
"trim-start-1310",
"trim-both-1000",
"resample-8000",
"resample-48000",
"resample-44100",
"resample-trip-8000",
"noise-64",
"noise-512",
"mix-noise-30dB",
"mix-noise-20dB",
"mix-noise-10dB",
"mulaw",
"requantize-8",
"echo-50ms",
"echo-150ms",
"mono",
"opus-6k",
"opus-8k",
"opus-12k",
"opus-16k",
"opus-24k",
"opus-32k",
"opus-64k",
"mp3-32k",
"mp3-64k",
"aac-32k",
"aac-64k",
"g722",
"g726-32k",
"g723-1"
],
"table": [
{
"attack": "none",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "gain-1/4",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "gain-1/2",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "gain-3/2",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "trim-start-500",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "trim-start-1310",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 18,
"missed": []
},
{
"attack": "trim-both-1000",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "resample-8000",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 6,
"missed": []
},
{
"attack": "resample-48000",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "resample-44100",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "resample-trip-8000",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 6,
"missed": []
},
{
"attack": "noise-64",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 12,
"missed": []
},
{
"attack": "noise-512",
"set": "speech",
"items": 24,
"survived": 0,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": [
"039718dd0f09d98c",
"075c40f1dc7dfb98",
"0faeb8ab5dc10b1c",
"0fca9c0b3f4d7095",
"101dad37803438cf",
"108d6f9723483cae",
"11c2dbe77afd462d",
"15fb15152c2650b4",
"163b2e67c7f2db1b",
"187d5f01b28adc5a",
"1bc8ee256c816e8b",
"1c6f6f4e4481da73",
"1e943f2af710db9b",
"227e984946ca139a",
"24c576a9d857fd68",
"26420bf51a42d897",
"271397c25cfd2a2b",
"2880a22c34fade01",
"2f781084ba73e675",
"36af40a6042146b6",
"385a1e9cf8f6e16f",
"3b7e3f519b3a5865",
"3bad15bb652017a5",
"3ce695ec62c95e60"
]
},
{
"attack": "mix-noise-30dB",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 21,
"missed": []
},
{
"attack": "mix-noise-20dB",
"set": "speech",
"items": 24,
"survived": 8,
"wrong": 0,
"false_positives": 0,
"errors_max": 29,
"missed": [
"0faeb8ab5dc10b1c",
"0fca9c0b3f4d7095",
"108d6f9723483cae",
"11c2dbe77afd462d",
"15fb15152c2650b4",
"163b2e67c7f2db1b",
"187d5f01b28adc5a",
"1e943f2af710db9b",
"227e984946ca139a",
"26420bf51a42d897",
"271397c25cfd2a2b",
"2f781084ba73e675",
"36af40a6042146b6",
"3b7e3f519b3a5865",
"3bad15bb652017a5",
"3ce695ec62c95e60"
]
},
{
"attack": "mix-noise-10dB",
"set": "speech",
"items": 24,
"survived": 0,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": [
"039718dd0f09d98c",
"075c40f1dc7dfb98",
"0faeb8ab5dc10b1c",
"0fca9c0b3f4d7095",
"101dad37803438cf",
"108d6f9723483cae",
"11c2dbe77afd462d",
"15fb15152c2650b4",
"163b2e67c7f2db1b",
"187d5f01b28adc5a",
"1bc8ee256c816e8b",
"1c6f6f4e4481da73",
"1e943f2af710db9b",
"227e984946ca139a",
"24c576a9d857fd68",
"26420bf51a42d897",
"271397c25cfd2a2b",
"2880a22c34fade01",
"2f781084ba73e675",
"36af40a6042146b6",
"385a1e9cf8f6e16f",
"3b7e3f519b3a5865",
"3bad15bb652017a5",
"3ce695ec62c95e60"
]
},
{
"attack": "mulaw",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 1,
"missed": []
},
{
"attack": "requantize-8",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 23,
"missed": []
},
{
"attack": "echo-50ms",
"set": "speech",
"items": 24,
"survived": 0,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": [
"039718dd0f09d98c",
"075c40f1dc7dfb98",
"0faeb8ab5dc10b1c",
"0fca9c0b3f4d7095",
"101dad37803438cf",
"108d6f9723483cae",
"11c2dbe77afd462d",
"15fb15152c2650b4",
"163b2e67c7f2db1b",
"187d5f01b28adc5a",
"1bc8ee256c816e8b",
"1c6f6f4e4481da73",
"1e943f2af710db9b",
"227e984946ca139a",
"24c576a9d857fd68",
"26420bf51a42d897",
"271397c25cfd2a2b",
"2880a22c34fade01",
"2f781084ba73e675",
"36af40a6042146b6",
"385a1e9cf8f6e16f",
"3b7e3f519b3a5865",
"3bad15bb652017a5",
"3ce695ec62c95e60"
]
},
{
"attack": "echo-150ms",
"set": "speech",
"items": 24,
"survived": 16,
"wrong": 0,
"false_positives": 0,
"errors_max": 29,
"missed": [
"075c40f1dc7dfb98",
"108d6f9723483cae",
"1c6f6f4e4481da73",
"227e984946ca139a",
"26420bf51a42d897",
"2880a22c34fade01",
"2f781084ba73e675",
"3ce695ec62c95e60"
]
},
{
"attack": "mono",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "opus-6k",
"set": "speech",
"items": 24,
"survived": 0,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": [
"039718dd0f09d98c",
"075c40f1dc7dfb98",
"0faeb8ab5dc10b1c",
"0fca9c0b3f4d7095",
"101dad37803438cf",
"108d6f9723483cae",
"11c2dbe77afd462d",
"15fb15152c2650b4",
"163b2e67c7f2db1b",
"187d5f01b28adc5a",
"1bc8ee256c816e8b",
"1c6f6f4e4481da73",
"1e943f2af710db9b",
"227e984946ca139a",
"24c576a9d857fd68",
"26420bf51a42d897",
"271397c25cfd2a2b",
"2880a22c34fade01",
"2f781084ba73e675",
"36af40a6042146b6",
"385a1e9cf8f6e16f",
"3b7e3f519b3a5865",
"3bad15bb652017a5",
"3ce695ec62c95e60"
]
},
{
"attack": "opus-8k",
"set": "speech",
"items": 24,
"survived": 0,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": [
"039718dd0f09d98c",
"075c40f1dc7dfb98",
"0faeb8ab5dc10b1c",
"0fca9c0b3f4d7095",
"101dad37803438cf",
"108d6f9723483cae",
"11c2dbe77afd462d",
"15fb15152c2650b4",
"163b2e67c7f2db1b",
"187d5f01b28adc5a",
"1bc8ee256c816e8b",
"1c6f6f4e4481da73",
"1e943f2af710db9b",
"227e984946ca139a",
"24c576a9d857fd68",
"26420bf51a42d897",
"271397c25cfd2a2b",
"2880a22c34fade01",
"2f781084ba73e675",
"36af40a6042146b6",
"385a1e9cf8f6e16f",
"3b7e3f519b3a5865",
"3bad15bb652017a5",
"3ce695ec62c95e60"
]
},
{
"attack": "opus-12k",
"set": "speech",
"items": 24,
"survived": 3,
"wrong": 0,
"false_positives": 0,
"errors_max": 29,
"missed": [
"039718dd0f09d98c",
"075c40f1dc7dfb98",
"0faeb8ab5dc10b1c",
"101dad37803438cf",
"108d6f9723483cae",
"11c2dbe77afd462d",
"15fb15152c2650b4",
"163b2e67c7f2db1b",
"1bc8ee256c816e8b",
"1c6f6f4e4481da73",
"1e943f2af710db9b",
"227e984946ca139a",
"24c576a9d857fd68",
"26420bf51a42d897",
"271397c25cfd2a2b",
"2880a22c34fade01",
"2f781084ba73e675",
"36af40a6042146b6",
"385a1e9cf8f6e16f",
"3b7e3f519b3a5865",
"3bad15bb652017a5"
]
},
{
"attack": "opus-16k",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 20,
"missed": []
},
{
"attack": "opus-24k",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 4,
"missed": []
},
{
"attack": "opus-32k",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 1,
"missed": []
},
{
"attack": "opus-64k",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "mp3-32k",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 8,
"missed": []
},
{
"attack": "mp3-64k",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": []
},
{
"attack": "aac-32k",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 18,
"missed": []
},
{
"attack": "aac-64k",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 3,
"missed": []
},
{
"attack": "g722",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 2,
"missed": []
},
{
"attack": "g726-32k",
"set": "speech",
"items": 24,
"survived": 24,
"wrong": 0,
"false_positives": 0,
"errors_max": 17,
"missed": []
},
{
"attack": "g723-1",
"set": "speech",
"items": 24,
"survived": 0,
"wrong": 0,
"false_positives": 0,
"errors_max": 0,
"missed": [
"039718dd0f09d98c",
"075c40f1dc7dfb98",
"0faeb8ab5dc10b1c",
"0fca9c0b3f4d7095",
"101dad37803438cf",
"108d6f9723483cae",
"11c2dbe77afd462d",
"15fb15152c2650b4",
"163b2e67c7f2db1b",
"187d5f01b28adc5a",
"1bc8ee256c816e8b",
"1c6f6f4e4481da73",
"1e943f2af710db9b",
"227e984946ca139a",
"24c576a9d857fd68",
"26420bf51a42d897",
"271397c25cfd2a2b",
"2880a22c34fade01",
"2f781084ba73e675",
"36af40a6042146b6",
"385a1e9cf8f6e16f",
"3b7e3f519b3a5865",
"3bad15bb652017a5",
"3ce695ec62c95e60"
]
}
],
"unmarked": [],
"words": {
"count": 96,
"ones_mean": "124.71",
"ones_sd": "8.40",
"pairs": 4416,
"distance_mean": "124.04",
"distance_sd": "7.95",
"distance_min": 94
},
"false_positive_log2": "-54.43",
"survived": [
"none",
"gain-1/4",
"gain-1/2",
"gain-3/2",
"trim-start-500",
"trim-start-1310",
"trim-both-1000",
"resample-8000",
"resample-48000",
"resample-44100",
"resample-trip-8000",
"noise-64",
"mix-noise-30dB",
"mulaw",
"requantize-8",
"mono",
"opus-16k",
"opus-24k",
"opus-32k",
"opus-64k",
"mp3-32k",
"mp3-64k",
"aac-32k",
"aac-64k",
"g722",
"g726-32k"
]
}