3f9c3ef640
int_hyper `natural` (wai-rs/tests/vectors/int_hyper/natural_*, record natural_set.json): a mean-scale hyperprior, 64 synthesis and 64 latent channels, trained by tools/wai_int_hyper_train.py at661048492from seed 20261112 on the 599 training pictures of research/training-pictures/natural-1.json in 256 x 256 crops: 32,000 steps of 8, Adam 5e-4 then 5e-5 for the last quarter, lambda 0.0130, clip 1, deterministic algorithms, on the Linux x86_64 build host's integrated GPU (PCI 0x1002, gfx1151) through ROCm 7.2 and torch 2.14.0+rocm7.2, in 90 min (03:21:58-04:52:14Z); last logged step 0.5152 bpp at 26.23 dB (loss 2.53). Listing (its identity) 3b3b56053917bf0b4a49b7011f4c725e3d413da865caec2b6bd57b953c115fb2. Coded picture: the dead-leaves picture of that seed, stream 0, 128 x 128: 1,540 rANS bytes, 0.752 bpp, 18.74 dB, decode 08b6bf5b...; WIH1 7922be10.... int_mlicpp `natural` (wai-rs/tests/vectors/int_mlicpp_natural/, record natural_set.json): 64 channels in 4 slices, a 48-channel hyper-latent, a 3 x 3 entropy network, trained by tools/wai_int_mlicpp_train.py at661048492by the same recipe side by side on the same GPU, in 99 min (to 05:01:24Z); last logged loss 2.5833 (0.5009 bpp, 26.08 dB). model.wmb 27643187da6ba44cd5c8e3fc67ff4cf7e26026942414965cfcbd3a4b18bd4285 (1,988,549 B), listing f37e2302bb2b26bb9a5483bf1f17e0210ecc2cf88b2b55e8b0aaaa6f4e79964b, prior id int_mlicpp/natural. Coded picture: 1,512 rANS bytes, 0.7383 bpp, 18.65 dB, decode 1bbd9de6.... The synthetic vector is unchanged under its own identity. Both records read Open (check --open: tools at their blobs of661048492, the manifest by its digest under the licence rule); self-test 16 of 16 (int_hyper) and 14 of 14 (int_mlicpp). Held: int-payload-conformance `natural` (WIH1); byte-exact goldens wih1_natural_set_is_golden and int_mlicpp_golden::natural (by the sink's decode and through the lowering, reference and fast kernels); wai-ops goldens (stage operators); ops-conformance certificates, both acc64, first acc32 failure h_s input range at 43 bits, listed after the synthetic sets (committed_after) so the index only gains entries; module corpus 123 cases; the browser crate's Node check; the GPU capability test (ops_gpu.rs) with both mlicpp vectors. verifiers/trained-sets.sh runs the manifest's check and self-test and both records' check --open and self-test. Run through rb, macOS x86_64 (iMac): gens; wai_int_payload_vectors verify, wai-verify vectors verify, wai_ops_check.py, int_payload_verify.py, corpus.py --check, all 0; wai-rs tests int_hyper_ops, int_kernels_vectors, corpus_provenance, int_payload, int_mlicpp, int_mlicpp_ops (release, no-fail-fast) and int_hyper_ops, int_payload (debug) 0; byte-exact-conformance (release) 0; wai-ops tests 0; clippy -D warnings clean for neural_int and for the ops_gpu set (no new lint in any other set: the union set's and byte-exact's and wai-ops's are pre-existing, none in a touched line). Linux x86_64 (Framework): ops_gpu on gpu-vulkan-1002 and swgpu-vulkan-10005, int_hyper 15 cases and int_mlicpp 2, graphs_differ 0, errors 0; the 48 test-picture payloads decode by wai_det_cost to the trainers' recorded digests. Plants caught: the fast kernels' IGDN one off on 64-channel layers fails both trained sets' goldens (3 tests) while 116 pass; one byte changed in leaves_g_s.bin and in int_mlicpp/model.wmb (changed bytes under an existing set's name) each fail `wai breaking` as an unacknowledged wire break; wai breaking against88b0bdb4cpasses (25 compatible changes). Co-Authored-By: Claude Opus 5.5 <[email protected]>
1 line
No EOL
12 KiB
JSON
1 line
No EOL
12 KiB
JSON
{"capability":"wai.neural.int_mlicpp","certificate":"wai-ops/1 bounds","graphs":[{"graph_sha256":"21e6c2d1f54a8a1670bed5efe99ab492cfce4209ccf75f9f67639b0f667af348","inputs":[{"hi":"3754833104077","kind":"data","lo":"-3754833104077","max_h":"0","max_w":"0","policy":"check","tensor":"0"}],"name":"h_s","nodes":[{"acc32_params":[],"fits":["acc64"],"index":"0","intermediates":{"convT.acc":{"bits":"61","hi":"836047384120680743","lo":"-836047384120680743"},"convT.term":{"bits":"54","hi":"7686143364045619","lo":"-7686143364045619"},"rq.p":{"bits":"72","hi":"1398830728791527830722","lo":"-1398830728791527830722"},"rq.q":{"bits":"48","hi":"83376808690519","lo":"-83376808690520"},"rq.t":{"bits":"61","hi":"836047384120680743","lo":"-836047384120680743"},"rq.y":{"bits":"48","hi":"83376808690851","lo":"-83376808690188"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv_transpose","out":[{"bits":"48","hi":"83376808690851","lo":"-83376808690188","policy":"derived","result":{"bits":"48","hi":"83376808690851","lo":"-83376808690188"},"tensor":"1"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"1","intermediates":{},"npu_flags":[],"op":"relu","out":[{"bits":"43","hi":"2816124828057","lo":"0","policy":"check","result":{"bits":"48","hi":"83376808690851","lo":"0"},"tensor":"2"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"2","intermediates":{"convT.acc":{"bits":"61","hi":"331978875355499445","lo":"-765448073389345113"},"convT.term":{"bits":"54","hi":"5764607523032679","lo":"-5764607523032679"},"rq.p":{"bits":"72","hi":"532544806317126135780","lo":"-1388675861512676932932"},"rq.q":{"bits":"48","hi":"31742144007511","lo":"-82771531433623"},"rq.t":{"bits":"61","hi":"331978875355499445","lo":"-765448073389345113"},"rq.y":{"bits":"48","hi":"31742144007599","lo":"-82771531432667"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv_transpose","out":[{"bits":"48","hi":"31742144007599","lo":"-82771531432667","policy":"derived","result":{"bits":"48","hi":"31742144007599","lo":"-82771531432667"},"tensor":"3"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"3","intermediates":{},"npu_flags":[],"op":"relu","out":[{"bits":"44","hi":"5215045977884","lo":"0","policy":"check","result":{"bits":"46","hi":"31742144007599","lo":"0"},"tensor":"4"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"4","intermediates":{"conv.acc":{"bits":"62","hi":"1371202469056995888","lo":"-1342514501132656004"},"conv.term":{"bits":"55","hi":"10675199116728548","lo":"-10675199116728548"},"rq.p":{"bits":"73","hi":"2099983502025476669400","lo":"-2472911711086352359368"},"rq.q":{"bits":"49","hi":"125168770672409","lo":"-147397024100206"},"rq.t":{"bits":"62","hi":"1371202469056995888","lo":"-1342514501132656004"},"rq.y":{"bits":"49","hi":"125168770672545","lo":"-147397024100016"}},"k_c":"0","mac":{"a_bits":["44"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv","out":[{"bits":"49","hi":"125168770672545","lo":"-147397024100016","policy":"derived","result":{"bits":"49","hi":"125168770672545","lo":"-147397024100016"},"tensor":"5"}],"saturated":false}],"scalars":[]},{"graph_sha256":"f5e981298a2d608dc8cb6ed94f8b8c1c1a84941d196ff5935457812c69563b32","inputs":[{"hi":"2607522988942","kind":"data","lo":"-2607522988942","max_h":"0","max_w":"0","policy":"check","tensor":"0"}],"name":"entropy","nodes":[{"acc32_params":[],"fits":["acc64"],"index":"0","intermediates":{"conv.acc":{"bits":"62","hi":"1892185562247607488","lo":"-1892185562247607488"},"conv.term":{"bits":"54","hi":"5337599558364274","lo":"-5337599558364274"},"rq.p":{"bits":"74","hi":"8266620916856579678972","lo":"-8266620916856579678972"},"rq.q":{"bits":"50","hi":"492729003242050","lo":"-492729003242051"},"rq.t":{"bits":"62","hi":"1892185562247607488","lo":"-1892185562247607488"},"rq.y":{"bits":"50","hi":"492729003242059","lo":"-492729003242042"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv","out":[{"bits":"50","hi":"492729003242059","lo":"-492729003242042","policy":"check","result":{"bits":"50","hi":"492729003242059","lo":"-492729003242042"},"tensor":"1"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"1","intermediates":{"leaky.p":{"bits":"60","hi":"-655","lo":"-322737497123537510"}},"npu_flags":[],"op":"leaky","out":[{"bits":"47","hi":"35201560350722","lo":"-4924583391168","policy":"check","result":{"bits":"50","hi":"492729003242059","lo":"-4924583391168"},"tensor":"2"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"2","intermediates":{"conv.acc":{"bits":"62","hi":"2228023801168677360","lo":"-1395719904238961728"},"conv.term":{"bits":"57","hi":"72057594037927934","lo":"-72057594037927934"},"rq.p":{"bits":"75","hi":"12940156445116346833182","lo":"-13149032888721673784298"},"rq.q":{"bits":"51","hi":"771293428249141","lo":"-783743434472184"},"rq.t":{"bits":"62","hi":"2228023801168677360","lo":"-1395719904238961728"},"rq.y":{"bits":"51","hi":"771293428249249","lo":"-783743434472076"}},"k_c":"0","mac":{"a_bits":["47"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv","out":[{"bits":"51","hi":"771293428249249","lo":"-783743434472076","policy":"derived","result":{"bits":"51","hi":"771293428249249","lo":"-783743434472076"},"tensor":"3"}],"saturated":false}],"scalars":[]},{"graph_sha256":"a44f3a815edf9d5f3e39621b2771ce824107080537093e9d2ad83b08c8309dc1","inputs":[{"hi":"2816124828057","kind":"data","lo":"-2816124828057","max_h":"0","max_w":"0","policy":"check","tensor":"0"}],"name":"g_s","nodes":[{"acc32_params":[],"fits":["acc64"],"index":"0","intermediates":{"convT.acc":{"bits":"60","hi":"514108932485257863","lo":"-514108932485257863"},"convT.term":{"bits":"54","hi":"5764607523032679","lo":"-5764607523032679"},"rq.p":{"bits":"71","hi":"928386099009653673150","lo":"-928386099009653673150"},"rq.q":{"bits":"47","hi":"55336123645881","lo":"-55336123645882"},"rq.t":{"bits":"60","hi":"514108932485257863","lo":"-514108932485257863"},"rq.y":{"bits":"47","hi":"55336123645642","lo":"-55336123646121"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv_transpose","out":[{"bits":"39","hi":"246632640532","lo":"-246632640532","policy":"check","result":{"bits":"47","hi":"55336123645642","lo":"-55336123646121"},"tensor":"1"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"1","intermediates":{"igdn.N":{"bits":"72","hi":"1380168601864557969923","lo":"0"},"igdn.gx2":{"bits":"86","hi":"24026925453435758050994480","lo":"0"},"igdn.r":{"bits":"37","hi":"37150620477","lo":"206"},"igdn.term":{"bits":"70","hi":"366621787314388397994","lo":"0"},"igdn.x2":{"bits":"77","hi":"60827659375786729243024","lo":"0"},"igdn.xr":{"bits":"74","hi":"9162555625644699373764","lo":"-9162555625644699373764"}},"k_c":"0","npu_flags":[],"op":"igdn","out":[{"bits":"43","hi":"2816124828057","lo":"-2816124828057","policy":"check","result":{"bits":"62","hi":"2236952057042162933","lo":"-2236952057042162934"},"tensor":"2"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"2","intermediates":{"convT.acc":{"bits":"60","hi":"565742581207682958","lo":"-565742581207682958"},"convT.term":{"bits":"54","hi":"5764607523032679","lo":"-5764607523032679"},"rq.p":{"bits":"72","hi":"1269572547941720004780","lo":"-1269572547941720004780"},"rq.q":{"bits":"48","hi":"75672420736653","lo":"-75672420736654"},"rq.t":{"bits":"60","hi":"565742581207682958","lo":"-565742581207682958"},"rq.y":{"bits":"48","hi":"75672420737149","lo":"-75672420736158"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv_transpose","out":[{"bits":"37","hi":"66165240830","lo":"-66165240830","policy":"check","result":{"bits":"48","hi":"75672420737149","lo":"-75672420736158"},"tensor":"3"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"3","intermediates":{"igdn.N":{"bits":"74","hi":"8679191589020968214784","lo":"0"},"igdn.gx2":{"bits":"90","hi":"333840875798165948822247300","lo":"0"},"igdn.r":{"bits":"38","hi":"93162178962","lo":"4"},"igdn.term":{"bits":"74","hi":"5094007504244475537448","lo":"0"},"igdn.x2":{"bits":"73","hi":"4377839094091899088900","lo":"0"},"igdn.xr":{"bits":"74","hi":"6164098007268289418460","lo":"-6164098007268289418460"}},"k_c":"0","npu_flags":[],"op":"igdn","out":[{"bits":"43","hi":"2816124828057","lo":"-2816124828057","policy":"check","result":{"bits":"62","hi":"1504906740055734721","lo":"-1504906740055734722"},"tensor":"4"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"4","intermediates":{"convT.acc":{"bits":"61","hi":"576747997035729714","lo":"-576747997035729714"},"convT.term":{"bits":"54","hi":"5764607523032679","lo":"-5764607523032679"},"rq.p":{"bits":"72","hi":"1614175863082414111764","lo":"-1614175863082414111764"},"rq.q":{"bits":"48","hi":"96212378924036","lo":"-96212378924037"},"rq.t":{"bits":"61","hi":"576747997035729714","lo":"-576747997035729714"},"rq.y":{"bits":"48","hi":"96212378924088","lo":"-96212378923985"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv_transpose","out":[{"bits":"37","hi":"55798593669","lo":"-55798593669","policy":"check","result":{"bits":"48","hi":"96212378924088","lo":"-96212378923985"},"tensor":"5"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"5","intermediates":{"igdn.N":{"bits":"75","hi":"15453586154253368084468","lo":"0"},"igdn.gx2":{"bits":"90","hi":"469410499819246106232307287","lo":"0"},"igdn.r":{"bits":"38","hi":"124312453737","lo":"142"},"igdn.term":{"bits":"74","hi":"7162635800464570712773","lo":"0"},"igdn.x2":{"bits":"73","hi":"3113483055438166881561","lo":"0"},"igdn.xr":{"bits":"74","hi":"6936460094067223591053","lo":"-6936460094067223591053"}},"k_c":"0","npu_flags":[],"op":"igdn","out":[{"bits":"43","hi":"2816124828057","lo":"-2816124828057","policy":"check","result":{"bits":"62","hi":"1693471702653130759","lo":"-1693471702653130760"},"tensor":"6"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"6","intermediates":{"convT.acc":{"bits":"60","hi":"558491059775436183","lo":"-558491059775436183"},"convT.term":{"bits":"54","hi":"5764607523032679","lo":"-5764607523032679"},"rq.p":{"bits":"71","hi":"1160934238660430522385","lo":"-1160934238660430522385"},"rq.q":{"bits":"47","hi":"69197072902943","lo":"-69197072902944"},"rq.t":{"bits":"60","hi":"558491059775436183","lo":"-558491059775436183"},"rq.y":{"bits":"47","hi":"69197072903582","lo":"-69197072902305"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv_transpose","out":[{"bits":"47","hi":"69197072903582","lo":"-69197072902305","policy":"derived","result":{"bits":"47","hi":"69197072903582","lo":"-69197072902305"},"tensor":"7"}],"saturated":false},{"acc32_params":[],"fits":["acc32","acc64"],"index":"7","intermediates":{},"npu_flags":[],"op":"clamp","out":[{"bits":"14","hi":"4096","lo":"0","policy":"derived","result":{"bits":"14","hi":"4096","lo":"0"},"tensor":"8"}],"saturated":false},{"acc32_params":[],"fits":["acc32","acc64"],"index":"8","intermediates":{"rq.p":{"bits":"21","hi":"1046528","lo":"0"},"rq.q":{"bits":"9","hi":"255","lo":"0"},"rq.t":{"bits":"14","hi":"4096","lo":"0"},"rq.y":{"bits":"9","hi":"255","lo":"0"}},"npu_flags":[],"op":"rescale","out":[{"bits":"9","hi":"255","lo":"0","policy":"derived","result":{"bits":"9","hi":"255","lo":"0"},"tensor":"9"}],"saturated":false}],"scalars":[]}],"lowering":"wmb1/1","set_sha256":"27643187da6ba44cd5c8e3fc67ff4cf7e26026942414965cfcbd3a4b18bd4285","verdict":{"acc32":false,"acc32_first_failure":{"bits":"43","graph":"h_s","index":"0","key":"range","where":"input"},"acc64":true,"npu":false,"npu_flags":["rq_floor_mult","rq_post_bias"],"npu_reasons":["acc32","op:igdn"]}} |