open-standards/wai/research/ops-gpu-runs.txt
Transaction Science e71980901e determinism-tiers §5: the Vulkan run on PCI 0x1002, with both runs' reports committed (#452 review S7)
#452 review S7 asked for the hand-run evidence in the repository, or the claims
removed. The Metal and browser claims rest on the forge's run 10236 (job 46928);
this train ran the crate's tests with WAI_OPS_GPU_REQUIRE=1 on a Linux x86_64 host's
integrated GPU of PCI vendor 0x1002, device 0x1586 (Mesa 26.0.8), and its llvmpipe,
on this revision's kernels: the semantics suite (254,464 cases, none differing,
guarded or not), the probe, the corpus at both widths and the 18 mutants. Both
runs' WAI_OPS_GPU_REPORT lines are committed in wai/research/ops-gpu-runs.txt, each
as written but for its `adapter=` field, the device's product name. §5 claims the
0x1002 adapter and llvmpipe again; the §6 row and the CHANGELOG say what ran where,
and that the capability corpora did not run on the Vulkan adapters.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-10-24 21:20:06 -04:00

34 lines
3.9 KiB
Text

# The WAI_OPS_GPU_REPORT lines of the runs on which determinism-tiers §5 claims
# decode-equivalence for the wai-ops/1-i32 graphs of wai/wai-ops-gpu, on this revision's
# kernel text (wai/wai-ops-gpu/src/wgsl/). Each line is as the crate's tests wrote it,
# except that its `adapter="..."` field, the name the backend reports for the device, is removed;
# the backend, PCI vendor and device, driver and driver version are as reported.
#
# Run 1. The forge's run 10236, job 46928, of .github/workflows/wai-ops-gpu.yml, on the
# `macos` runner (arm64 desktop, macOS 27.0.1, Metal; the backend reports no PCI identity,
# vendor and device 0x0), 2026-10-22, on the kernel text of commit c47a58cca, which the
# kernels here are byte for byte. rustc 1.98.0, wgpu and naga 30.0.1, release.
# Run 2. `WAI_OPS_GPU_REQUIRE=1 cargo test --locked --release -- --nocapture
# --test-threads=1` in wai/wai-ops-gpu, a Linux x86_64 host (kernel 7.0), 2026-10-24, at
# commit 2aa4e54d3 of the change that added this file. rustc 1.98.0, wgpu and naga
# 30.0.1, release: every test of the crate ran and passed. The capability corpora (wai-rs
# tests/ops_gpu.rs) were not run on this host.
#
# Run 1
ops-gpu arith mutant: key=gpu-metal-0 refused: the probe's word 3 differs from the host's on ProbeIn { a: 340282366920938463463374607431768211455, b: 34028236692
ops-gpu arith: key=gpu-metal-0 backend=metal type=integrated vendor=0x0 device=0x0 driver="" driver_info="" cases=1051757 words=4207
ops-gpu corpus: key=gpu-metal-0 backend=metal type=integrated vendor=0x0 device=0x0 driver="" driver_info="" acc32 vectors=813 decodes=1104; acc64 vectors=1426 decodes=1921; refusals=212
ops-gpu mutants: key=gpu-metal-0 killed 18 of 18
ops-gpu semantics mutant: key=gpu-metal-0 refused: the WGSL semantics suite: rem_i32 (ia % ib) a=0x00000001 b=0x00000000 c=0x00000000 d=0x00000000: WGSL gives 0x0000
ops-gpu semantics: key=gpu-metal-0 backend=metal type=integrated vendor=0x0 device=0x0 driver="" driver_info="" committed=25088 cases
# Run 2
ops-gpu arith: key=gpu-vulkan-1002 backend=vulkan type=integrated vendor=0x1002 device=0x1586 driver="radv" driver_info="Mesa 26.0.8-1ubuntu0.3" cases=1051757 words=42070280 equal
ops-gpu arith: key=swgpu-vulkan-10005 backend=vulkan type=cpu vendor=0x10005 device=0x0 driver="llvmpipe" driver_info="Mesa 26.0.8-1ubuntu0.3 (LLVM 21.1.8)" cases=1051757 words=42070280 equal
ops-gpu corpus: key=gpu-vulkan-1002 backend=vulkan type=integrated vendor=0x1002 device=0x1586 driver="radv" driver_info="Mesa 26.0.8-1ubuntu0.3" acc32 vectors=813 decodes=1104; acc64 vectors=1426 decodes=1921; refusals=212; cpu=209 load_refused=95 mismatches=0 errors=0 secs=0.2
ops-gpu corpus: key=swgpu-vulkan-10005 backend=vulkan type=cpu vendor=0x10005 device=0x0 driver="llvmpipe" driver_info="Mesa 26.0.8-1ubuntu0.3 (LLVM 21.1.8)" acc32 vectors=813 decodes=1104; acc64 vectors=1426 decodes=1921; refusals=212; cpu=209 load_refused=95 mismatches=0 errors=0 secs=0.7
ops-gpu mutants: key=gpu-vulkan-1002 killed 18 of 18
ops-gpu mutants: key=swgpu-vulkan-10005 killed 18 of 18
ops-gpu semantics mutant: key=gpu-vulkan-1002 refused: the WGSL semantics suite: rem_i32 (ia % ib) a=0x00000001 b=0x00000000 c=0x00000000 d=0x00000000: WGSL gives 0x00000000, got 0x00000001
ops-gpu semantics mutant: key=swgpu-vulkan-10005 refused: the WGSL semantics suite: rem_i32 (ia % ib) a=0x00000001 b=0x00000000 c=0x00000000 d=0x00000000: WGSL gives 0x00000000, got 0x00000001
ops-gpu semantics: key=gpu-vulkan-1002 backend=vulkan type=integrated vendor=0x1002 device=0x1586 driver="radv" driver_info="Mesa 26.0.8-1ubuntu0.3" committed=25088 cases=254464 guarded=231690 differ=0 unguarded=22774 unguarded_differ=0 unguarded_ops=none
ops-gpu semantics: key=swgpu-vulkan-10005 backend=vulkan type=cpu vendor=0x10005 device=0x0 driver="llvmpipe" driver_info="Mesa 26.0.8-1ubuntu0.3 (LLVM 21.1.8)" committed=25088 cases=254464 guarded=231690 differ=0 unguarded=22774 unguarded_differ=0 unguarded_ops=none