open-standards/wai/live-conformance/detection/vectors.json
Transaction Science 1ff71887ff
Some checks failed
joule-moq-web browser client / joule-moq-web · does this change touch it (push) Successful in 30s
wai-audit collector and player integration / does this change touch it (push) Successful in 24s
wai-app and Create / wai-app · does this change touch it (push) Successful in 21s
joule-moq-remote host agent / joule-moq-remote · does this change touch it (push) Successful in 28s
joule-moq-room room service / joule-moq-room · does this change touch it (push) Successful in 33s
wai-key-proxy / does this change touch it (push) Successful in 27s
wai-fleet service / does this change touch it (push) Successful in 16s
WAI operation catalogue / does this change touch it (push) Successful in 24s
wai-ledger service / does this change touch it (push) Successful in 26s
wai-quantum for JavaScript / does this change touch it (push) Successful in 26s
wai-sink-android native sink library / does this change touch it (push) Successful in 32s
WAI Studio / does this change touch it (push) Successful in 32s
wai-quantum studio and desktop / does this change touch it (push) Successful in 44s
wai-sink-swift native sink package / does this change touch it (push) Successful in 34s
joule-moq-remote host agent / joule-moq-remote, every target (linux-arm64) (push) Successful in 2m16s
repository checks / lockfiles, advisories, tests in CI, workflow hygiene, spec and section references, public text (push) Failing after 7m31s
wai-sink-android native sink library / the JNI layer and the platform-free half on the host JVM · linux-arm64 (push) Successful in 6m13s
joule-moq-room room service / joule-moq-room, every target (push) Successful in 9m1s
WAI breaking changes and the conformance runner / WAI breaking · does this change touch WAI (push) Successful in 23s
wai-quantum energy-landscape jobs / does this change touch it (push) Successful in 17s
wai-app and Create / wai-app · tests, clippy, the line language's verifier (linux) (push) Successful in 57s
wai-audit collector and player integration / collector · linux (push) Successful in 2m24s
wai-key-proxy / proxy · linux (push) Successful in 2m32s
WAI Studio / the catalogue's actions, the unit tests and the core · linux (push) Successful in 1m42s
wai-ledger service / service · linux (push) Successful in 3m21s
wai-fleet service / service · linux (push) Successful in 5m24s
wai-quantum for JavaScript / javascript · linux (push) Successful in 5m33s
wai-quantum studio and desktop / studio · browser (push) Successful in 5m13s
wai-quantum studio and desktop / desktop app · windows (push) Successful in 9m58s
wai-quantum energy-landscape jobs / the same bits · linux-arm64 (push) Successful in 12m36s
WAI operation catalogue / the catalogue and every door · linux (push) Successful in 13m27s
wai-quantum studio and desktop / desktop app · linux (push) Successful in 11m10s
WAI Studio / Studio in WebKit · linux (push) Successful in 13m50s
joule-moq-remote host agent / joule-moq-remote, every target (macos) (push) Successful in 47s
wai-audit collector and player integration / collector, player integration and the browser end to end · macos (push) Successful in 1m55s
wai-fleet service / service · macos (push) Successful in 1m5s
wai-ledger service / service · macos (push) Successful in 1m38s
wai-app and Create / wai-app · Create, browser end-to-end (macos) (push) Successful in 8m20s
wai-sink-android native sink library / every ABI, the AAR, and the instrumented tests in a headless emulator · macos (push) Successful in 8m5s
joule-moq-web browser client / joule-moq-web · browser end-to-end (macos) (push) Successful in 16m45s
wai-quantum studio and desktop / desktop app · macos (push) Failing after 12m13s
WAI Studio / Studio in Chromium and Firefox · macos (push) Failing after 12m25s
wai-sink-swift native sink package / libwai slices, desktop tests, simulator tests · macos (push) Successful in 17m39s
WAI breaking changes and the conformance runner / WAI breaking · wire, record and API against main · linux (push) Successful in 2m42s
wai-quantum energy-landscape jobs / native against WebAssembly, over many seeds (push) Successful in 7m51s
WAI breaking changes and the conformance runner / WAI breaking and conform · their tests, and the independent verifiers through wai conform · linux (push) Successful in 8m29s
wai-quantum energy-landscape jobs / reader, kernels, answers and the stated result · linux, release (push) Successful in 9m9s
wai-quantum energy-landscape jobs / the module under wasm32-wasip2 (wasmtime) (push) Successful in 18m57s
wai-quantum energy-landscape jobs / the same bits · macos (push) Successful in 7m7s
C2PA stores carry identity assertions, soft bindings and the ISCC identifier, trust lists are pinned by digest, and a detection verdict is a claim of its own
c2pa-binding §4.8 to §4.10 and §6.4: after its three assertions a store of wai.asset.c2pa may
carry wai-mark:tent64 as a C2PA soft-binding assertion naming its robustness claim, the
envelope's ISCC identifier, and the Creator Assertions Working Group's identity assertions
(1.3, cawg.x509.cose); a verifier may hold its anchors as trust lists in the C2PA Trust List's
form, pinned by the SHA-256 of their bytes. The algorithm-list entries for tent64 and band64
are written in extensions/c2pa-soft-binding-entries.json.

extensions/iscc.md: ISO 24138's codec, ISCC-SEQ, Instance-, Image- and Audio-Codes and the
ISCC-CODE from the IEP texts, replaying the public test vectors; WAI's integer pre-processing.

extensions/detection.md: wai.media.detection, a detector's signed verdict at an operating point
named by digest, its evidence a robustness record of binding type detector; refused as
provenance, never a change to an origin claim's class.

Corpora c2pa-identity/, iscc/ and detection/, each with a second implementation in Python.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-11-10 15:25:49 -05:00

466 lines
14 KiB
JSON

{
"extension": "detection",
"detector": "wai-detector:conformance",
"definition": "wai-detector:conformance scores a picture by the share of its pixels whose grey (77R + 150G + 29B + 128) >> 8 is at least 128 (detection.md section 8)",
"cases": [
{
"name": "verdicts-beside-claims",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [
"records/verdict-9cdc44acc1afe6fa.json",
"records/verdict-c3704b3c531a6b36.json",
"records/verdict-64b2cae238ae7a3a.json",
"records/verdict-9279383fa9ddcb60.json"
],
"requireEvidence": false,
"expect": {
"outcome": "accept",
"provenance": [
{
"link": "7aabad8f599ce873470e9ff21bbc8081a7b91af8dfb214e7e5499bf4585c780a",
"subject": "2b34fbe8a4c0564165ee285155f58c6ea0d94176a4ddcfb37addee8ba3ed570d",
"class": "captured"
},
{
"link": "4fce7174b35e8c77f94411b9112a44597f07d645c20d3ab2663a7c7301c9f460",
"subject": "b1977123372b40e480a7a180f4864db03e0c6faf768dd7182117228637f96a75",
"class": "synthesized"
},
{
"link": "ac7dcc6ffc997b44dad20d875de89dded09f471f99ea7db8475f63fdeaa92d93",
"subject": "a096aa2e742a53e846d51f9e711ac28177b68af12261c7322d831823d2530eb0",
"class": "captured"
},
{
"link": "fafad6b4cba193f238d1cb90e5d64e3d0657985f34e343043376b65aeab4c509",
"subject": "665e6508580ecdbc4e115d13859e1c3a618424ca3270453e2eea7fc0402d1c8f",
"class": "synthesized"
}
],
"verdicts": [
{
"link": "7c95b387e11c48d4d771a7f173611fe5ded08294717d21f0f14564a16cf206b4",
"subject": "2b34fbe8a4c0564165ee285155f58c6ea0d94176a4ddcfb37addee8ba3ed570d",
"detector": "wai-detector:conformance",
"verdict": "not-detected",
"besideClaim": "agrees",
"evidence": "79f3d6a393d9a2ee442e94d60dce221bc8611333d33d53201388c8c288201ca0"
},
{
"link": "d5310ec198da56463530cc5809d78e0e2bb9176f814e0c30d6c0636b572c4e58",
"subject": "b1977123372b40e480a7a180f4864db03e0c6faf768dd7182117228637f96a75",
"detector": "wai-detector:conformance",
"verdict": "synthetic",
"besideClaim": "agrees",
"evidence": "79f3d6a393d9a2ee442e94d60dce221bc8611333d33d53201388c8c288201ca0"
},
{
"link": "3cc5cd820933ee0134f53e14a08e5b7eefc6ccae74621476320bf493d54e79bf",
"subject": "a096aa2e742a53e846d51f9e711ac28177b68af12261c7322d831823d2530eb0",
"detector": "wai-detector:conformance",
"verdict": "synthetic",
"besideClaim": "disagrees",
"evidence": "79f3d6a393d9a2ee442e94d60dce221bc8611333d33d53201388c8c288201ca0"
},
{
"link": "a899bcb159d417053fad3b4510809a6e5bc4f66b926026aaf56b4e715c0bafed",
"subject": "665e6508580ecdbc4e115d13859e1c3a618424ca3270453e2eea7fc0402d1c8f",
"detector": "wai-detector:conformance",
"verdict": "not-detected",
"besideClaim": "disagrees",
"evidence": "79f3d6a393d9a2ee442e94d60dce221bc8611333d33d53201388c8c288201ca0"
}
]
}
},
{
"name": "claims-without-verdicts",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [],
"requireEvidence": false,
"expect": {
"outcome": "accept",
"provenance": [
{
"link": "7aabad8f599ce873470e9ff21bbc8081a7b91af8dfb214e7e5499bf4585c780a",
"subject": "2b34fbe8a4c0564165ee285155f58c6ea0d94176a4ddcfb37addee8ba3ed570d",
"class": "captured"
},
{
"link": "4fce7174b35e8c77f94411b9112a44597f07d645c20d3ab2663a7c7301c9f460",
"subject": "b1977123372b40e480a7a180f4864db03e0c6faf768dd7182117228637f96a75",
"class": "synthesized"
},
{
"link": "ac7dcc6ffc997b44dad20d875de89dded09f471f99ea7db8475f63fdeaa92d93",
"subject": "a096aa2e742a53e846d51f9e711ac28177b68af12261c7322d831823d2530eb0",
"class": "captured"
},
{
"link": "fafad6b4cba193f238d1cb90e5d64e3d0657985f34e343043376b65aeab4c509",
"subject": "665e6508580ecdbc4e115d13859e1c3a618424ca3270453e2eea7fc0402d1c8f",
"class": "synthesized"
}
],
"verdicts": []
}
},
{
"name": "verdict-without-claim",
"provenance": [],
"robustness": [],
"verdicts": [
"records/verdict-5372287273b5fd8c.json"
],
"requireEvidence": false,
"expect": {
"outcome": "accept",
"provenance": [],
"verdicts": [
{
"link": "afc9a282b93e083add75748f5aecacb1cd7f948407371ef2b7d3c9c59f15f89b",
"subject": "22b36e0e56d23b4c0c49defd03d035ba756b627c20c68e62c7c24dea32304d1f",
"detector": "wai-detector:conformance",
"verdict": "synthetic",
"besideClaim": "no-claim",
"evidence": null
}
]
}
},
{
"name": "verdict-signature",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [
"records/verdict-9a0b2f547389b412.json"
],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "bad_signature",
"list": "verdicts",
"index": 0
}
},
{
"name": "verdict-bad-key",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [
"records/verdict-5dfd4b666ee91365.json"
],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "bad_key",
"list": "verdicts",
"index": 0
}
},
{
"name": "verdict-extra-member",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [
"records/verdict-27234c29870a0b2e.json"
],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "record_malformed",
"list": "verdicts",
"index": 0
}
},
{
"name": "verdict-rate-not-exact",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [
"records/verdict-c1b126527020a7c3.json"
],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "rate_not_exact",
"list": "verdicts",
"index": 0
}
},
{
"name": "verdict-threshold-not-its-definitions",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [
"records/verdict-be32a53bdb841d74.json"
],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "detector_digest_mismatch",
"list": "verdicts",
"index": 0
}
},
{
"name": "verdict-inconsistent",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [
"records/verdict-040bdfea8c317210.json"
],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "verdict_inconsistent",
"list": "verdicts",
"index": 0
}
},
{
"name": "robustness-not-held",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [],
"verdicts": [
"records/verdict-c3704b3c531a6b36.json"
],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "robustness_not_held",
"list": "verdicts",
"index": 0
}
},
{
"name": "evidence-required",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [
"records/verdict-8dd466efba2d4baa.json"
],
"requireEvidence": true,
"expect": {
"outcome": "refuse",
"reason": "robustness_not_held",
"list": "verdicts",
"index": 0
}
},
{
"name": "robustness-of-another-threshold",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [
"records/robustness-6b7f5f0848e1e513.json"
],
"verdicts": [
"records/verdict-86c470cd9c6d50f8.json"
],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "robustness_mismatch",
"list": "verdicts",
"index": 0
}
},
{
"name": "robustness-invalid",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [
"records/robustness-76bdfd078935b235.json"
],
"verdicts": [
"records/verdict-9cdc44acc1afe6fa.json",
"records/verdict-c3704b3c531a6b36.json",
"records/verdict-64b2cae238ae7a3a.json",
"records/verdict-9279383fa9ddcb60.json"
],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "robustness_invalid",
"list": "robustness",
"index": 0
}
},
{
"name": "provenance-unreadable",
"provenance": [
"records/provenance-649e2f716c22910c.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "provenance_invalid",
"list": "provenance",
"index": 0
}
},
{
"name": "provenance-signature",
"provenance": [
"records/provenance-f53dd4f58b342657.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "provenance_invalid",
"list": "provenance",
"index": 0
}
},
{
"name": "verdict-as-origin-claim",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/verdict-c3704b3c531a6b36.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "verdict_as_provenance",
"list": "provenance",
"index": 1
}
},
{
"name": "verdict-as-derivation",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-fd9313753fa50c99.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [
"records/verdict-c3704b3c531a6b36.json"
],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "verdict_as_provenance",
"list": "provenance",
"index": 1
}
},
{
"name": "verdict-as-input-origin",
"provenance": [
"records/provenance-5361a1d3d15e70d6.json",
"records/provenance-b143251733055d4e.json",
"records/provenance-5ee2b7e4fa9494f6.json",
"records/provenance-54b0a2d091823686.json",
"records/provenance-564bd7ba61e856e7.json"
],
"robustness": [
"records/robustness-03a5e79de687a232.json"
],
"verdicts": [
"records/verdict-c3704b3c531a6b36.json"
],
"requireEvidence": false,
"expect": {
"outcome": "refuse",
"reason": "verdict_as_provenance",
"list": "provenance",
"index": 4
}
}
]
}