# The model harness's task set

What `wai-quantum eval run` asks a model, and the corpus the answer view
layer's token cost is measured on.

| Path | What |
|---|---|
| `tasks.json` | The tasks, in the conformance format: each what a model is asked (`ask`), the intent its program is held to, the run, and a reference program a test holds to the intent by proof. Built from the intent conformance set's cases ([`../intents/`](../intents/)) and the worked examples (`wai_quantum::engine::guide::examples`), each named in `from`, with a few more of the first states of a circuits course. |
| `answers.json` | Each task's answer written four ways (`wai-quantum eval corpus`): the program alone in a fenced block, the answer view layer whole (the circuit, a sample, a verdict for each intent, a seal) and with the request alone (the sample and the verdicts), and the request an agent sends a run tool as JSON. The last two carry the same program and the same request. A test holds it to the task set, and every answer in the layer reads with no diagnostic and runs to its intents. |
| `token_cost.py` | Counts the tokens of each answer in each form with a model's own vocabulary (read from its GGUF file by a tokenizer tool), and reports the totals, the means and each form against the program alone. Standard library only. |
| `token-cost.json` | Its report on `answers.json` for three open-weight models' vocabularies; the answer view layer's specification records it (§9). |

```sh
wai-quantum eval run --tasks tasks.json --model http://127.0.0.1:8080/v1 --energy-pid PID --out report.json
wai-quantum eval corpus --tasks tasks.json --out answers.json
python3 -I token_cost.py answers.json --tokenizer A=MODEL.gguf --tokenizer B=… --tool TOKENIZER --out token-cost.json
```

A report is one model on one task set and ranks nothing; reports are kept
where they are written, not here.