open-standards/jouleclaw/jouleclaw-rs/crates/jouleclaw-loader-gguf/examples
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Transaction Science 5e03008268 jouleclaw-loader-gguf: the stored reference names its math library, has its generator, and runs every configuration whatever the switch
The stored logit hashes depend on the platform's math library as well
as on the code, but a mismatch blamed only the code. Each platform's
lines now carry a `math-library` line naming the library they were
made with (macOS 27.2's libsystem_m, Ubuntu GLIBC 2.39 on Linux arm64,
2.43 on Linux x86_64). A mismatch names it, says whether the ways of
running the model agree with each other (if they do, this
environment's library may round differently), and says how to tell.

examples/cohere2_reference.rs is the generator: the test's checkpoints,
scenario and hash, through forward_prompt and forward_token only, so it
runs unchanged at 30c4cf1ee. Run there, with and without rayon, it
reproduces all 78 stored lines on all three platforms, and it prints
the `math-library` line for a new one.

With JOULECLAW_FABRIC=1 in the environment, the main check ran in a
child process and the 1- and 3-thread checks never ran at all. The
test process now checks nothing itself: it starts one child per
configuration, each with the fabric off, and each child must report
its check.

Tests failing first: the mismatch message did not name the library;
a test run with JOULECLAW_FABRIC=1 reported 0 of its 3 checks. Both
pass now, with the switch unset and set.

Co-Authored-By: Claude Opus 5.5 <[email protected]>
2026-11-06 07:18:22 -05:00
..
bf16_bringup.rs loader-gguf wave 46: real-checkpoint bring-up — Nemotron-3-Nano-4B-BF16 2026-06-10 01:56:49 -04:00
cohere2_reference.rs jouleclaw-loader-gguf: the stored reference names its math library, has its generator, and runs every configuration whatever the switch 2026-11-06 07:18:22 -05:00
devstral_resident_check.rs loader: make forward_prompt default to the fast fused prefill (~1.7x) 2026-06-20 02:56:42 -04:00
energy_autotune.rs jouleclaw-loader-gguf: a meter that did not measure records nothing and writes nothing 2026-09-30 01:50:18 -04:00
fabric_calibrate.rs jouleclaw-loader-gguf: 0 warnings, and -D warnings now gates it 2026-10-21 20:40:32 -04:00
falcon_decode.rs loader-gguf wave 80: attention block reaches Falcon-H1 via rotate-half + per-kind scale 2026-06-12 22:03:26 -04:00
gguf_types.rs runtime: Q6_K packed GPU GEMV — 2x warm decode on Devstral (372→189 ms/tok) 2026-06-16 01:23:04 -04:00
granite_decode.rs loader-gguf wave 81: attention block reaches Granite-H — all five families on-device 2026-06-12 22:22:28 -04:00
load_model.rs jouleclaw-loader-gguf: apply clippy's own suggestions, 81 -> 40 2026-10-21 20:30:31 -04:00
load_onnx.rs loader-gguf wave 36: ONNX initializer tensor extraction 2026-06-09 09:50:08 -04:00
load_openvino.rs jouleclaw-loader-gguf: apply clippy's own suggestions, 81 -> 40 2026-10-21 20:30:31 -04:00
load_safetensors.rs jouleclaw-loader-gguf: apply clippy's own suggestions, 81 -> 40 2026-10-21 20:30:31 -04:00
load_tflite.rs loader-gguf wave 38: TFLite (Google FlatBuffers) reader 2026-06-09 11:01:25 -04:00
mellum_decode.rs loader-gguf wave 68: fabric attribution — every run carries its breakdown 2026-06-11 12:17:28 -04:00
mpp_bt_bench.rs jouleclaw-loader-gguf: 0 warnings, and -D warnings now gates it 2026-10-21 20:40:32 -04:00
mpp_energy.rs jouleclaw-loader-gguf: 0 warnings, and -D warnings now gates it 2026-10-21 20:40:32 -04:00
nemotron_decode.rs loader-gguf wave 78: attention block reaches NemotronH (NoPE) + encode race fix 2026-06-12 12:48:35 -04:00
north_bench.rs jouleclaw: North decode 3-6x and prefill 6-11x on the CPU, bit-identical 2026-11-05 10:17:04 -05:00
north_decode.rs loader-gguf wave 79: attention block reaches Cohere2/North via interleaved rope 2026-06-12 13:33:37 -04:00