Authentication and sessions
Token validation, issuer and audience checks, session expiry, protected routes, and revocation behavior.
test_auth.py, test_session_cookie.py, test_gateway_routes.pyIdentity proofing, operator device security, production key custody, or complete access governance.
Authorization and boundaries
Action scopes, admin exposure defaults, trusted-proxy handling, and route-level access decisions.
test_scope_enforcement.py, test_audit_fixes_standard_path.py, test_gateway_routes.pyNetwork segmentation, infrastructure IAM, privileged-access operations, or every integration path.
Tool and sandbox policy
Path containment, allowed tool behavior, preservation rules, egress policy, and external-tool protocol handling.
test_tool_sandbox.py, test_external_tool_protocol.py, task-specific testsOperating-system isolation, container escape resistance, tenant separation, or deployment hardening.
Evidence integrity
Audit-chain validation, signed public records, JWKS verification, canonicalization, revocation, and tamper rejection.
test_audit_chain.py, test_leaderboard.py, test_independent_verify.pyImmutable retention, complete event capture, legal non-repudiation, evaluator independence, or behavioral validity.
Run validity and scoring
Provider-failure suppression, battery integrity, task governance, adaptive trials, security gates, and result expiry.
test_task_governance.py, test_anti_gaming.py, test_evidence_context.pyMeasurement validity, production predictive value, scorer correctness outside reviewed fixtures, or cross-version comparability.
Web delivery
Security headers, content policy, static routing, protected pages, injection sinks, and withdrawn-claim behavior.
test_security_headers.py, test_gateway_routes.py, test_public_claim_language.pyClient device security, extension behavior, upstream compromise, CDN configuration, or every browser implementation.
Storage and concurrency
Supported storage backends, atomic mutations, registration claims, replay controls, and concurrent state updates.
test_storage_backend.py, test_storage_concurrency.py, route transaction testsProduction backup recovery, capacity, multi-region consistency, database administration, or disaster recovery.