open-standards/eoc/eoc-bench/crates/eoc-bench-mt/data/cases.json
Transaction Science a437feb8ab Parallel ingest: 9 issues' worth of work across openpay / smart-byte / eoc
openpay/
  compliance/                     PCI-DSS readiness package (scope-map,
                                  pci-zero-architecture, hsm-kms-guidance,
                                  qsa-checklist), citing PCI-DSS v4.0.1
                                  requirements. (#1)
  examples/pci-zero/              Runnable example demonstrating a deployment
                                  where merchant code never touches a PAN. (#1)
  crates/op-core/                 Tokenized<Card> typestate + NetworkToken
                                  + CardNetwork + Cryptogram. (#2)
  crates/op-rails-card/network_token/
                                  NetworkTokenProvider trait + VTS adapter
                                  + MDES adapter, with deterministic stubs
                                  behind a 'live' feature flag. (#2)
  crates/op-driver-sdk/conformance/network_token.rs
                                  Conformance harness for third-party
                                  NetworkTokenProvider implementations. (#2)
  crates/op-cli/src/ledger/       'openpay ledger as-of' subcommand for
                                  bi-temporal queries. (#3)
  crates/op-orchestrator/src/telemetry.rs
                                  OpenTelemetry span emission per
                                  Payment<S> transition with semantic-
                                  conventions tags. (#3)
  docs/observability/             Grafana dashboard JSON + wiring guide
                                  for the bi-temporal ledger lens. (#3)

smart-byte/
  smart-byte-rs/                  Rust reference implementation: envelope
                                  encode/decode (canonical CBOR + BLAKE3
                                  content addressing), Ed25519 sign +
                                  verify, lockstep BFT commit MVP, Iroh
                                  transport scaffold, CLI. (#4)
  spec/identity_and_key_rotation.md
                                  Adopts KERI SAIDs + key-event log
                                  format; explicitly does not adopt ACDC
                                  chaining wholesale. (#5)
  conformance/v1/                 21 test vectors covering canonicalisation,
                                  SAID computation, signature verification,
                                  lockstep commit, gossip propagation.
                                  CI gate enforces spec/vector coupling. (#6)

eoc/
  eoc-rs/                         Rust + WASM reference implementation:
                                  4-stage cascade (cache -> kv -> graph ->
                                  neural), joule counters via RAPL / NVML /
                                  powermetrics, CLI, wasm-bindgen surface.
                                  18 tests pass. (#7)
  eoc-bench/                      Benchmark harness, MT-Bench and Router
                                  case sets, 'joules per MT-Bench point'
                                  metric, 'eoc-bench run | compare' CLI. (#8)
  standards/sci-for-ai-submission.md
                                  Submission proposal mapping EOC's
                                  receipt schema to GSF SCI-for-AI. (#9)
  cookbook/                       HuggingFace-style cookbook (markdown +
                                  runnable Python) demonstrating EOC's
                                  cascade with HF AI Energy Score. (#9)
  docs/bench-v0.md                Reproducibility doc for eoc-bench.

Workspace state:
- openpay clippy -- -D warnings: clean across all touched crates
- smart-byte-rs cargo test --workspace + clippy: clean
- eoc-rs cargo test --workspace + clippy: clean (18 tests)
- eoc-bench cargo check --workspace + clippy + 15 tests: clean

Rust 1.95.0 edition 2024 pinned at the open-standards root via
rust-toolchain.toml; every workspace inherits.

Closes #1 #2 #3 #4 #5 #6 #7 #8 #9.
2026-05-23 13:24:05 -04:00

122 lines
3.2 KiB
JSON

[
{
"id": "mt-arith-01",
"prompt": "What is 2+2?",
"expected": "4",
"dataset": "mt"
},
{
"id": "mt-arith-02",
"prompt": "Compute 17 times 23 and show the result.",
"expected": "391",
"dataset": "mt"
},
{
"id": "mt-arith-03",
"prompt": "If a train leaves at 09:15 and arrives 2 hours 50 minutes later, what time does it arrive?",
"expected": "12:05",
"dataset": "mt"
},
{
"id": "mt-reason-01",
"prompt": "Alice is taller than Bob. Bob is taller than Carol. Who is the shortest of the three?",
"expected": "Carol",
"dataset": "mt"
},
{
"id": "mt-reason-02",
"prompt": "A bat and a ball cost $1.10 in total. The bat costs $1.00 more than the ball. How much does the ball cost?",
"expected": "5 cents",
"dataset": "mt"
},
{
"id": "mt-multi-01",
"prompt": "I have a meeting at 3pm tomorrow.\nFollow-up: What is the local time three hours before that meeting?",
"expected": "12pm",
"dataset": "mt"
},
{
"id": "mt-multi-02",
"prompt": "Pick a fruit and a colour.\nFollow-up: Write one sentence that names both.",
"expected": null,
"dataset": "mt"
},
{
"id": "mt-multi-03",
"prompt": "Define an isosceles triangle.\nFollow-up: Give a real-world example of one.",
"expected": "isosceles",
"dataset": "mt"
},
{
"id": "mt-code-01",
"prompt": "Write a Python function that returns True if a string is a palindrome and False otherwise.",
"expected": "def",
"dataset": "mt"
},
{
"id": "mt-code-02",
"prompt": "In Rust, how do you turn a Vec<u8> into a String when the bytes are guaranteed to be valid UTF-8?",
"expected": "String::from_utf8",
"dataset": "mt"
},
{
"id": "mt-code-03",
"prompt": "Explain quicksort in two sentences.",
"expected": "pivot",
"dataset": "mt"
},
{
"id": "mt-writing-01",
"prompt": "Write a short, professional one-paragraph apology email for a late delivery.",
"expected": null,
"dataset": "mt"
},
{
"id": "mt-writing-02",
"prompt": "Compose a two-line haiku about a quiet datacenter.",
"expected": null,
"dataset": "mt"
},
{
"id": "mt-fact-01",
"prompt": "What is the capital of France?",
"expected": "Paris",
"dataset": "mt"
},
{
"id": "mt-fact-02",
"prompt": "Which planet is the fourth from the Sun?",
"expected": "Mars",
"dataset": "mt"
},
{
"id": "mt-fact-03",
"prompt": "Who wrote the novel 'Pride and Prejudice'?",
"expected": "Jane Austen",
"dataset": "mt"
},
{
"id": "mt-explain-01",
"prompt": "Explain the difference between latency and throughput in one paragraph.",
"expected": "latency",
"dataset": "mt"
},
{
"id": "mt-explain-02",
"prompt": "What is a hash table, in two sentences?",
"expected": "hash",
"dataset": "mt"
},
{
"id": "mt-summary-01",
"prompt": "Summarise the plot of 'Romeo and Juliet' in three sentences.",
"expected": "Romeo",
"dataset": "mt"
},
{
"id": "mt-summary-02",
"prompt": "In one sentence, what is the second law of thermodynamics?",
"expected": "entropy",
"dataset": "mt"
}
]