01d4ad9c7b
openpay/ (+3 crates, ~8400 LOC, 162 tests)
op-iso8583/ ISO 8583 messages for direct acquirer / card-network
connectivity. MTIs, primary+secondary bitmaps, full
DE catalogue, BCD/ASCII/EBCDIC/LLVAR/LLLVAR codecs,
five dialects (Visa Base I, Mastercard MDS, Amex GNS,
Discover, JCB), network-management messages
(sign-on/echo/cutover), DE 55 EMV TLV.
op-mobile-wallets/ Apple Pay (ECDH-P256 + AES-256-GCM), Google Pay ECv2
(ECDH + HKDF + AES-256-CTR + HMAC), Samsung Pay. PAN
never leaves the decryption boundary as a String;
lands in VaultRef. No-PAN-leakage assertions per
wallet.
op-routing/ Least-cost routing + MCC-aware routing + intelligent
retry / soft-decline recovery. 231-MCC catalogue.
Real ISO 8583 DE-39 soft/hard decline taxonomies.
smart-byte/smart-byte-rs/ (+3 crates, ~7100 LOC, 96 tests)
smart-byte-vc/ W3C Verifiable Credentials 2.0: VCDM, presentations,
Data Integrity proofs (eddsa-jcs-2022), VC-JWT,
SD-JWT (selective disclosure), Bitstring Status
List 2021. Cargo-bridge maps VCs to Smart Byte
envelopes with SAID stability.
smart-byte-did/ W3C DID resolution: did:key (Ed25519/P-256/secp256k1),
did:web (HTTPS), did:peer (numalgo 2+4), did:jwk,
did:ion (feature-gated stub). DID URL dereferencer.
smart-byte-pq/ Post-quantum signatures: ML-DSA-44/65/87 (FIPS 204),
SLH-DSA across 12 parameter sets (FIPS 205), FN-DSA
(draft FIPS 206, feature-gated). Hybrid Ed25519 +
ML-DSA pattern for the transition. Secret-key
zeroize-on-drop.
eoc/eoc-rs/ (+3 crates, ~6450 LOC, 76 tests)
eoc-vendor-api/ NeuralBackend implementations: Anthropic, OpenAI,
Google, Mistral, Cohere, Groq, Together, Fireworks.
SSE streaming. Prompt-caching where supported.
Joule estimates per published energy coefficient
(12-model curated table).
eoc-embeddings/ 21 embedding models behind one Embedder trait:
OpenAI v3 (3), Cohere v3 (3), Voyage (5), Mistral,
Jina, plus local ONNX (BGE x3, nomic, mxbai, GTE,
E5) behind 'local' feature. Matryoshka-style
dimension projection. Per-content-hash cache.
eoc-route-learned/ RouteLLM-style matrix-factorisation router +
multinomial-logreg classifier + LinUCB / Thompson
bandits for online learning. LearnedCascade wraps
the rule-based cascade with a confidence-threshold
skip policy. Synthetic-eval accuracy: MF 0.935,
LogReg 0.980.
Quality:
- cargo check across all three workspaces: clean
- cargo clippy --all-targets -- -D warnings on every new crate: clean
- 334 new tests total; all passing
- #![forbid(unsafe_code)] across every new crate
- No unwrap/expect outside #[cfg(test)]
Rust 1.95.0 edition 2024 (inherited via root rust-toolchain.toml).
56 lines
1.9 KiB
Rust
56 lines
1.9 KiB
Rust
//! EOC vendor LLM API backends.
|
|
//!
|
|
//! This crate ships [`eoc_neural::NeuralBackend`] implementations for the
|
|
//! major commercial inference endpoints — Anthropic, OpenAI, Google
|
|
//! (Gemini), Mistral, Cohere, Groq, Together, Fireworks — together with
|
|
//! the shared joule estimator that attributes energy cost to each
|
|
//! inference.
|
|
//!
|
|
//! Each backend:
|
|
//!
|
|
//! * Issues a single HTTP request (or SSE stream) per [`Query`](eoc_core::Query).
|
|
//! * Returns a [`Response`](eoc_core::Response) tagged with the resolving
|
|
//! stage (`Stage::Neural`) and a [`JouleCost`](eoc_core::JouleCost).
|
|
//! * Reports `JouleSource::Estimated` because no commercial vendor today
|
|
//! exposes per-call hardware energy counters; the estimator multiplies
|
|
//! token counts by the per-model coefficients in
|
|
//! [`data/model_energy_profiles.json`](../../data/model_energy_profiles.json).
|
|
//!
|
|
//! API keys are *never* logged. Structured tracing uses
|
|
//! [`tracing::field::Empty`] for credential fields.
|
|
//!
|
|
//! ## WASM
|
|
//!
|
|
//! `reqwest` is built with `rustls-tls`, so the crate compiles for
|
|
//! `wasm32-unknown-unknown`. Vendor endpoints do not set permissive CORS
|
|
//! headers, so direct browser calls require a same-origin proxy.
|
|
|
|
#![forbid(unsafe_code)]
|
|
#![warn(missing_docs)]
|
|
|
|
pub mod anthropic;
|
|
pub mod auth;
|
|
pub mod cohere;
|
|
pub mod config;
|
|
pub mod error;
|
|
pub mod fireworks;
|
|
pub mod google;
|
|
pub mod groq;
|
|
pub mod joule_estimator;
|
|
pub mod mistral;
|
|
pub mod openai;
|
|
pub mod openai_compat;
|
|
pub mod together;
|
|
|
|
pub use anthropic::AnthropicBackend;
|
|
pub use auth::Auth;
|
|
pub use cohere::CohereBackend;
|
|
pub use config::{RetryPolicy, VendorConfig};
|
|
pub use error::{VendorError, VendorResult};
|
|
pub use fireworks::FireworksBackend;
|
|
pub use google::GoogleBackend;
|
|
pub use groq::GroqBackend;
|
|
pub use joule_estimator::{DefaultEstimator, JouleEstimator, ModelEnergyProfile};
|
|
pub use mistral::MistralBackend;
|
|
pub use openai::OpenAiBackend;
|
|
pub use together::TogetherBackend;
|