Skip to content

Guardrail cost

Not populated

Real per-node latency and token cost need a live LLM -- evals/canonical.py stands in a deterministic oracle for exactly that reason, so its cost is always $0.0000 (see docs/evidence/evaluation.md). The table below is the design, not a measurement; it fills in once A3 has a live key.

"What does all this safety cost me?" is the second question every buyer asks, and it usually gets an opinion for an answer. This page gives it a number: added p50 and p95 latency, and added tokens, per layer.

The layers are not equally expensive, and the ordering is deliberate:

Layer Model calls Expected cost
screen_rules 0 Microseconds, free
classify_intent 1 (small model) Low, and it runs in parallel with the screen
resolve_policy 0 Free
critical_value 0 Free — a table comparison
citation_coverage 0 Free — a reference check
scope_judge 1 (larger model) The only expensive control

Because the two deterministic post-flight checks run first and can short-circuit the judge, a run that escalates on a critical value costs less than one that passes cleanly. Safety here is not a tax applied uniformly to every request.

This page is also the direct precursor to A4's guardrail cost accounting.