int_hyper `natural` (wai-rs/tests/vectors/int_hyper/natural_*, record natural_set.json): a mean-scale hyperprior, 64 synthesis and 64 latent channels, trained by tools/wai_int_hyper_train.py at661048492from seed 20261112 on the 599 training pictures of research/training-pictures/natural-1.json in 256 x 256 crops: 32,000 steps of 8, Adam 5e-4 then 5e-5 for the last quarter, lambda 0.0130, clip 1, deterministic algorithms, on the Linux x86_64 build host's integrated GPU (PCI 0x1002, gfx1151) through ROCm 7.2 and torch 2.14.0+rocm7.2, in 90 min (03:21:58-04:52:14Z); last logged step 0.5152 bpp at 26.23 dB (loss 2.53). Listing (its identity) 3b3b56053917bf0b4a49b7011f4c725e3d413da865caec2b6bd57b953c115fb2. Coded picture: the dead-leaves picture of that seed, stream 0, 128 x 128: 1,540 rANS bytes, 0.752 bpp, 18.74 dB, decode 08b6bf5b...; WIH1 7922be10.... int_mlicpp `natural` (wai-rs/tests/vectors/int_mlicpp_natural/, record natural_set.json): 64 channels in 4 slices, a 48-channel hyper-latent, a 3 x 3 entropy network, trained by tools/wai_int_mlicpp_train.py at661048492by the same recipe side by side on the same GPU, in 99 min (to 05:01:24Z); last logged loss 2.5833 (0.5009 bpp, 26.08 dB). model.wmb 27643187da6ba44cd5c8e3fc67ff4cf7e26026942414965cfcbd3a4b18bd4285 (1,988,549 B), listing f37e2302bb2b26bb9a5483bf1f17e0210ecc2cf88b2b55e8b0aaaa6f4e79964b, prior id int_mlicpp/natural. Coded picture: 1,512 rANS bytes, 0.7383 bpp, 18.65 dB, decode 1bbd9de6.... The synthetic vector is unchanged under its own identity. Both records read Open (check --open: tools at their blobs of661048492, the manifest by its digest under the licence rule); self-test 16 of 16 (int_hyper) and 14 of 14 (int_mlicpp). Held: int-payload-conformance `natural` (WIH1); byte-exact goldens wih1_natural_set_is_golden and int_mlicpp_golden::natural (by the sink's decode and through the lowering, reference and fast kernels); wai-ops goldens (stage operators); ops-conformance certificates, both acc64, first acc32 failure h_s input range at 43 bits, listed after the synthetic sets (committed_after) so the index only gains entries; module corpus 123 cases; the browser crate's Node check; the GPU capability test (ops_gpu.rs) with both mlicpp vectors. verifiers/trained-sets.sh runs the manifest's check and self-test and both records' check --open and self-test. Run through rb, macOS x86_64 (iMac): gens; wai_int_payload_vectors verify, wai-verify vectors verify, wai_ops_check.py, int_payload_verify.py, corpus.py --check, all 0; wai-rs tests int_hyper_ops, int_kernels_vectors, corpus_provenance, int_payload, int_mlicpp, int_mlicpp_ops (release, no-fail-fast) and int_hyper_ops, int_payload (debug) 0; byte-exact-conformance (release) 0; wai-ops tests 0; clippy -D warnings clean for neural_int and for the ops_gpu set (no new lint in any other set: the union set's and byte-exact's and wai-ops's are pre-existing, none in a touched line). Linux x86_64 (Framework): ops_gpu on gpu-vulkan-1002 and swgpu-vulkan-10005, int_hyper 15 cases and int_mlicpp 2, graphs_differ 0, errors 0; the 48 test-picture payloads decode by wai_det_cost to the trainers' recorded digests. Plants caught: the fast kernels' IGDN one off on 64-channel layers fails both trained sets' goldens (3 tests) while 116 pass; one byte changed in leaves_g_s.bin and in int_mlicpp/model.wmb (changed bytes under an existing set's name) each fail `wai breaking` as an unacknowledged wire break; wai breaking against88b0bdb4cpasses (25 compatible changes). Co-Authored-By: Claude Opus 5.5 <[email protected]>
1 line
No EOL
9.7 KiB
JSON
1 line
No EOL
9.7 KiB
JSON
{"capability":"wai.neural.int_hyper","certificate":"wai-ops/1 bounds","graphs":[{"graph_sha256":"107d72c1610144dceb522df2963215290c752b972938142bde0a9d56cb3aa399","inputs":[{"hi":"2816124828057","kind":"data","lo":"-2816124828057","max_h":"0","max_w":"0","policy":"check","tensor":"0"}],"name":"h_s","nodes":[{"acc32_params":[],"fits":["acc64"],"index":"0","intermediates":{"convT.acc":{"bits":"61","hi":"815192102352143961","lo":"-815192102352143961"},"convT.term":{"bits":"54","hi":"5764607523032679","lo":"-5764607523032679"},"rq.p":{"bits":"72","hi":"1718987478324973511652","lo":"-1718987478324973511652"},"rq.q":{"bits":"48","hi":"102459638018904","lo":"-102459638018905"},"rq.t":{"bits":"61","hi":"815192102352143961","lo":"-815192102352143961"},"rq.y":{"bits":"48","hi":"102459638019051","lo":"-102459638018758"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv_transpose","out":[{"bits":"48","hi":"102459638019051","lo":"-102459638018758","policy":"check","result":{"bits":"48","hi":"102459638019051","lo":"-102459638018758"},"tensor":"1"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"1","intermediates":{"leaky.p":{"bits":"57","hi":"-655","lo":"-67111062902286490"}},"npu_flags":[],"op":"leaky","out":[{"bits":"43","hi":"2816124828057","lo":"-1024033552587","policy":"check","result":{"bits":"48","hi":"102459638019051","lo":"-1024033552587"},"tensor":"2"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"2","intermediates":{"convT.acc":{"bits":"61","hi":"368838122491052001","lo":"-887112490252955445"},"convT.term":{"bits":"54","hi":"5764607523032679","lo":"-5764607523032679"},"rq.p":{"bits":"73","hi":"1501116105603541746600","lo":"-3662000359764200076960"},"rq.q":{"bits":"49","hi":"89473492241116","lo":"-218272230611098"},"rq.t":{"bits":"61","hi":"368838122491052001","lo":"-887112490252955445"},"rq.y":{"bits":"49","hi":"89473492241514","lo":"-218272230610942"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv_transpose","out":[{"bits":"49","hi":"89473492241514","lo":"-218272230610942","policy":"check","result":{"bits":"49","hi":"89473492241514","lo":"-218272230610942"},"tensor":"3"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"3","intermediates":{"leaky.p":{"bits":"58","hi":"-655","lo":"-142968311050167010"}},"npu_flags":[],"op":"leaky","out":[{"bits":"44","hi":"5215045977884","lo":"-2181523300937","policy":"check","result":{"bits":"48","hi":"89473492241514","lo":"-2181523300937"},"tensor":"4"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"4","intermediates":{"conv.acc":{"bits":"62","hi":"1345183388180892880","lo":"-1301530996859625550"},"conv.term":{"bits":"55","hi":"10675199116728548","lo":"-10675199116728548"},"rq.p":{"bits":"76","hi":"22749741460915260386560","lo":"-22011492218889987301600"},"rq.q":{"bits":"52","hi":"1355990258509830","lo":"-1311987174683213"},"rq.t":{"bits":"62","hi":"1345183388180892880","lo":"-1301530996859625550"},"rq.y":{"bits":"52","hi":"1355990258511202","lo":"-1311987174681841"}},"k_c":"0","mac":{"a_bits":["44"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv","out":[{"bits":"52","hi":"1355990258511202","lo":"-1311987174681841","policy":"derived","result":{"bits":"52","hi":"1355990258511202","lo":"-1311987174681841"},"tensor":"5"}],"saturated":false}],"scalars":[]},{"graph_sha256":"f15aafd01af90938ea80d8a13848750b2a6d30df73d35e45a0bcade7133725aa","inputs":[{"hi":"2816124828057","kind":"data","lo":"-2816124828057","max_h":"0","max_w":"0","policy":"check","tensor":"0"}],"name":"g_s","nodes":[{"acc32_params":[],"fits":["acc64"],"index":"0","intermediates":{"convT.acc":{"bits":"61","hi":"601363744157775951","lo":"-601363744157775951"},"convT.term":{"bits":"54","hi":"5764607523032679","lo":"-5764607523032679"},"rq.p":{"bits":"71","hi":"961931941296708684456","lo":"-961931941296708684456"},"rq.q":{"bits":"47","hi":"57335611659092","lo":"-57335611659093"},"rq.t":{"bits":"61","hi":"601363744157775951","lo":"-601363744157775951"},"rq.y":{"bits":"47","hi":"57335611658464","lo":"-57335611659721"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv_transpose","out":[{"bits":"39","hi":"202684413953","lo":"-202684413953","policy":"check","result":{"bits":"47","hi":"57335611658464","lo":"-57335611659721"},"tensor":"1"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"1","intermediates":{"igdn.N":{"bits":"72","hi":"1770212768041181166752","lo":"0"},"igdn.gx2":{"bits":"86","hi":"35576121457101938900656994","lo":"0"},"igdn.r":{"bits":"37","hi":"42073896516","lo":"204"},"igdn.term":{"bits":"70","hi":"542848532975798628244","lo":"0"},"igdn.x2":{"bits":"77","hi":"41080971659471061086209","lo":"0"},"igdn.xr":{"bits":"74","hi":"8527723058064628487748","lo":"-8527723058064628487748"}},"k_c":"0","npu_flags":[],"op":"igdn","out":[{"bits":"43","hi":"2816124828057","lo":"-2816124828057","policy":"check","result":{"bits":"62","hi":"2081963637222809689","lo":"-2081963637222809690"},"tensor":"2"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"2","intermediates":{"convT.acc":{"bits":"60","hi":"558637498266495147","lo":"-558637498266495147"},"convT.term":{"bits":"54","hi":"5764607523032679","lo":"-5764607523032679"},"rq.p":{"bits":"72","hi":"1420866587348595743895","lo":"-1420866587348595743895"},"rq.q":{"bits":"48","hi":"84690248212134","lo":"-84690248212135"},"rq.t":{"bits":"60","hi":"558637498266495147","lo":"-558637498266495147"},"rq.y":{"bits":"48","hi":"84690248211305","lo":"-84690248212964"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv_transpose","out":[{"bits":"38","hi":"69344491468","lo":"-69344491468","policy":"check","result":{"bits":"48","hi":"84690248211305","lo":"-84690248212964"},"tensor":"3"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"3","intermediates":{"igdn.N":{"bits":"75","hi":"13352582773093711039336","lo":"0"},"igdn.gx2":{"bits":"89","hi":"303931260300073944669491920","lo":"0"},"igdn.r":{"bits":"38","hi":"115553376294","lo":"4"},"igdn.term":{"bits":"73","hi":"4637622990418608774864","lo":"0"},"igdn.x2":{"bits":"74","hi":"4808658496955524795024","lo":"0"},"igdn.xr":{"bits":"74","hi":"8012990116517876459592","lo":"-8012990116517876459592"}},"k_c":"0","npu_flags":[],"op":"igdn","out":[{"bits":"43","hi":"2816124828057","lo":"-2816124828057","policy":"check","result":{"bits":"62","hi":"1956296415165497182","lo":"-1956296415165497183"},"tensor":"4"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"4","intermediates":{"convT.acc":{"bits":"61","hi":"640597995262266075","lo":"-640597995262266075"},"convT.term":{"bits":"54","hi":"5764607523032679","lo":"-5764607523032679"},"rq.p":{"bits":"72","hi":"1380819475893111107130","lo":"-1380819475893111107130"},"rq.q":{"bits":"48","hi":"82303254359549","lo":"-82303254359550"},"rq.t":{"bits":"61","hi":"640597995262266075","lo":"-640597995262266075"},"rq.y":{"bits":"48","hi":"82303254359527","lo":"-82303254359572"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv_transpose","out":[{"bits":"37","hi":"60041196922","lo":"-60041196922","policy":"check","result":{"bits":"48","hi":"82303254359527","lo":"-82303254359572"},"tensor":"5"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"5","intermediates":{"igdn.N":{"bits":"75","hi":"17677356800490193943154","lo":"0"},"igdn.gx2":{"bits":"90","hi":"405415756512682776925760724","lo":"0"},"igdn.r":{"bits":"38","hi":"132956221368","lo":"256"},"igdn.term":{"bits":"74","hi":"6186153511240887099086","lo":"0"},"igdn.x2":{"bits":"73","hi":"3604945327826382274084","lo":"0"},"igdn.xr":{"bits":"74","hi":"7982850669161112229296","lo":"-7982850669161112229296"}},"k_c":"0","npu_flags":[],"op":"igdn","out":[{"bits":"43","hi":"2816124828057","lo":"-2816124828057","policy":"check","result":{"bits":"62","hi":"1948938151650662165","lo":"-1948938151650662166"},"tensor":"6"}],"saturated":false},{"acc32_params":[],"fits":["acc64"],"index":"6","intermediates":{"convT.acc":{"bits":"60","hi":"468248339660349618","lo":"-468248339660349618"},"convT.term":{"bits":"54","hi":"5764607523032679","lo":"-5764607523032679"},"rq.p":{"bits":"71","hi":"1094961451170754450899","lo":"-1094961451170754450899"},"rq.q":{"bits":"47","hi":"65264788339779","lo":"-65264788339780"},"rq.t":{"bits":"60","hi":"468248339660349618","lo":"-468248339660349618"},"rq.y":{"bits":"47","hi":"65264788340620","lo":"-65264788338939"}},"k_c":"0","mac":{"a_bits":["43"],"w_bits":"12"},"npu_flags":["rq_floor_mult","rq_post_bias"],"op":"conv_transpose","out":[{"bits":"47","hi":"65264788340620","lo":"-65264788338939","policy":"derived","result":{"bits":"47","hi":"65264788340620","lo":"-65264788338939"},"tensor":"7"}],"saturated":false},{"acc32_params":[],"fits":["acc32","acc64"],"index":"7","intermediates":{},"npu_flags":[],"op":"clamp","out":[{"bits":"14","hi":"4096","lo":"0","policy":"derived","result":{"bits":"14","hi":"4096","lo":"0"},"tensor":"8"}],"saturated":false},{"acc32_params":[],"fits":["acc32","acc64"],"index":"8","intermediates":{"rq.p":{"bits":"21","hi":"1046528","lo":"0"},"rq.q":{"bits":"9","hi":"255","lo":"0"},"rq.t":{"bits":"14","hi":"4096","lo":"0"},"rq.y":{"bits":"9","hi":"255","lo":"0"}},"npu_flags":[],"op":"rescale","out":[{"bits":"9","hi":"255","lo":"0","policy":"derived","result":{"bits":"9","hi":"255","lo":"0"},"tensor":"9"}],"saturated":false}],"scalars":[]}],"lowering":"whm1/1","set_sha256":"3b3b56053917bf0b4a49b7011f4c725e3d413da865caec2b6bd57b953c115fb2","verdict":{"acc32":false,"acc32_first_failure":{"bits":"43","graph":"h_s","index":"0","key":"range","where":"input"},"acc64":true,"npu":false,"npu_flags":["rq_floor_mult","rq_post_bias"],"npu_reasons":["acc32","op:igdn"]}} |