AI Runtime Governance Learning Guide
204 source-grounded lessons across six core papers, with direct links to each source and its Check Your Knowledge quiz.
This guide consolidates the 204 source-grounded lessons used to structure the six paper-specific Check Your Knowledge quizzes on AI runtime governance. The lessons are grouped by paper in the recommended reading sequence. Each lesson includes its curriculum identifier, lesson title, a concise statement of the principle, and the section/page reference in the source paper.
This page is designed as a study companion and navigation aid; the source papers remain the authoritative treatment of each topic.
Reading Sequence
Work through the six papers in order. Each paper section below summarizes the lessons used in its corresponding knowledge check and links directly to the authoritative source.
How to use this guide: use the lesson statements to identify the concepts to understand, follow the source references back to the paper when you need the full argument or technical context, and use the quiz after completing each paper to check your understanding.
Runtime Execution Governance for AI Systems: A Cross-Platform Synthesis and Architectural Framework
Runtime governance as execution architecture
AI governance is fundamentally a runtime control problem over state transitions and should be treated as a first-class architectural layer.
Source: Sections 1-2 and 14 (pp. 1-4, 9)
Runtime governance decision function
Runtime governance can be modeled as a decision function f(s, a, c) -> d over system state, a proposed action, and context.
Source: Section 3 (p. 4)
State transition as the governance object
The fundamental object of runtime governance is the proposed state transition rather than the model, prompt, or actor in isolation.
Source: Sections 1 and 3 (pp. 2-4)
Governance compilation
Governance compilation transforms human-readable policy, regulation, and risk intent into executable constraints, schemas, policy artifacts, and invariants.
Source: Figure 1 and Section 2, Contribution 3 (pp. 3-4)
Deterministic enforcement around probabilistic AI
Probabilistic reasoning can remain flexible, but consequential governance enforcement must be deterministic and reproducible.
Source: Sections 11-11.1 (pp. 6-7)
Execution-bound authorization
Authorization for consequential action should be validated at the moment of execution against the state and context that actually govern commitment.
Source: Sections 4 and 11 (pp. 5-7)
Non-bypassable enforcement path
Runtime governance can provide non-bypassability only when governed execution paths are forced through the governance enforcement point.
Source: Section 11.1 (p. 7) and Section 12.3 (p. 8)
Limits of individual governance technologies
IAM, policy engines, guardrails, and monitoring each contribute capabilities but do not individually provide a complete runtime-governance architecture.
Source: Sections 12.1-12.4 (pp. 7-8)
Regulatory intent versus runtime mediation
Regulatory and risk frameworks establish governance intent and lifecycle obligations but do not themselves mediate individual runtime actions.
Source: Section 6 (p. 5) and Section 12.1 (p. 7)
Monitoring is not mediation
Observability can show what happened, but runtime governance must decide whether a consequential action is permitted before it happens.
Source: Sections 5-6 (p. 5)
Control plane between proposal and execution
Governance should be separated from agent logic and placed between proposed actions and consequential execution to intercept, evaluate, gate, and record transitions.
Source: Section 4 (p. 5) and Section 14 (p. 9)
Integrated governance stack responsibilities
The integrated stack separates governance compilation, RGA runtime semantics, AGCP deterministic enforcement, and PBSAI operational realization into distinct responsibilities.
Source: Figure 1 and Section 11 (pp. 3, 6-7)
Evidence follows governed execution
Evidence should connect governance intent, compiled constraints, runtime evaluation, authorization, action, and outcome; evidence supports accountability but does not replace enforcement.
Source: Figure 1 and Sections 11-14 (pp. 3, 6-9)
Check Your Knowledge
After studying this paper and its lessons, use the paper-specific quiz to check your understanding.
Take the Paper 1 QuizRuntime Governance Architecture: Consistent Governance Execution for Enterprise Systems and Autonomous Agents
Runtime governance before operational state transition
Distributed and automated enterprise systems require governance enforcement to occur at runtime before operational state transitions are applied.
Source: Section 1 (p. 2). https://doi.org/10.5281/zenodo.19286845
Governance as a runtime mediation problem
RGA reframes governance as an execution-time mediation problem rather than a purely procedural or documentation-based process.
Source: Section 1 (p. 2). https://doi.org/10.5281/zenodo.19286845
Complete mediation extended to operational mutations
RGA applies the classical complete-mediation principle to operational system mutations, not only to access to protected objects.
Source: Sections 1 and 2.1 (p. 2). https://doi.org/10.5281/zenodo.19286845
Control-plane separation of governance and execution
RGA separates governance decision logic into a control plane while operational systems perform actions only after governance authorization.
Source: Sections 2.2 and 4 (pp. 2-5). https://doi.org/10.5281/zenodo.19286845
Distributed authorization is narrower than state-transition governance
Distributed authorization systems demonstrate consistent access decisions at scale, but they primarily address identity authorization and access control rather than the broader governance of operational state transitions.
Source: Section 2.3 (p. 3). https://doi.org/10.5281/zenodo.19286845
Platform admission control is insufficient across heterogeneous systems
Admission-control and scheduling mechanisms can govern actions within individual platforms, but RGA generalizes governance mediation across heterogeneous enterprise systems.
Source: Section 2.4 (p. 3). https://doi.org/10.5281/zenodo.19286845
Policy-as-code is a component, not the whole architecture
Declarative policy engines provide useful machine-evaluable policy evaluation, but they do not by themselves define the broader governance execution architecture required for consistent mediation of state transitions.
Source: Section 2.5 (pp. 3-4). https://doi.org/10.5281/zenodo.19286845
RGA is implementation-technology neutral
RGA defines an architectural framework for representing governance intent and evaluating constraints without prescribing a particular implementation technology or enforcement mechanism.
Source: Section 4 (pp. 4-5). https://doi.org/10.5281/zenodo.19286845
Governance intent is compiled into canonical runtime artifacts
Governance intent from policy processes, compliance frameworks, regulation, and governance boards is compiled into canonical artifacts that can be evaluated consistently at runtime.
Source: Section 4 (p. 4) and Conclusion (p. 15). https://doi.org/10.5281/zenodo.19286845
Canonical governance artifacts cover five model categories
RGA identifies canonical identity/context models, action models, policy/constraint models, authorization artifacts, and lifecycle evidence records as core governance representations.
Source: Section 4 (p. 4) and Figure 1 (p. 6). https://doi.org/10.5281/zenodo.19286845
Identity and context resolution spans human and machine actors
Governance evaluation must resolve actors and execution context across user identities, service accounts, workload identities, machine-generated credentials, and autonomous software agents.
Source: Section 5.1 (p. 5). https://doi.org/10.5281/zenodo.19286845
Runtime context is part of governance evaluation
RGA treats runtime attributes such as network location, device posture, execution-environment metadata, and tenant-specific policy context as relevant governance inputs.
Source: Section 5.1 (p. 5). https://doi.org/10.5281/zenodo.19286845
Action normalization creates a canonical governance object
Platform-specific API calls, orchestration commands, and configuration updates must be normalized into a canonical action representation before consistent governance evaluation.
Source: Section 5.2 (p. 5). https://doi.org/10.5281/zenodo.19286845
Governance evaluation is deterministic across rules, constraints, and invariants
RGA requires proposed mutations to be deterministically evaluated against applicable governance rules, policy constraints, and system invariants before execution.
Source: Section 5.3 (pp. 5, 7). https://doi.org/10.5281/zenodo.19286845
Authorization artifact is the execution gate
After governance evaluation, a valid authorization artifact determines whether the proposed operational transition may proceed and functions as the execution gate.
Source: Section 5.4 (p. 7) and Section 5.6 (p. 8). https://doi.org/10.5281/zenodo.19286845
Authorization artifact provides verifiable decision evidence
Authorization artifacts may carry references to evaluated rules, resolved identity context, normalized action representation, and the resulting decision, providing verifiable evidence of the governance evaluation.
Source: Section 5.4 (p. 7). https://doi.org/10.5281/zenodo.19286845
Lifecycle evidence is ordered and reconstructable
Governance evaluation must produce ordered lifecycle evidence describing evaluation inputs, policy results, authorization decisions, and execution outcomes so decisions can be reconstructed later.
Source: Section 5.5 (p. 7). https://doi.org/10.5281/zenodo.19286845
Append-only lifecycle ledger supports governance-state reconstruction
Recording lifecycle events in an append-only ledger allows governance state to be reconstructed directly from system history.
Source: Section 5.5 (p. 7) and Section 7.2 (p. 10). https://doi.org/10.5281/zenodo.19286845
Diverse operational actions are governed as proposed state transitions
Kubernetes admissions, CI/CD promotions, cloud configuration changes, and autonomous remediation actions are all examples of proposed state transitions whose admissibility must be evaluated before execution.
Source: Section 5.5 (p. 7). https://doi.org/10.5281/zenodo.19286845
Identity Validity Invariant
Every proposed operational transition must have a resolved identity and execution context so the responsible actor or system and relevant contextual attributes are known.
Source: Section 5.6 (pp. 7-8). https://doi.org/10.5281/zenodo.19286845
Canonical Action Representation Invariant
Every proposed operational mutation must be represented in the canonical action model before governance evaluation occurs.
Source: Section 5.6 (p. 8). https://doi.org/10.5281/zenodo.19286845
Policy Evaluation Invariant
Every proposed state transition must be evaluated against all applicable governance rules, constraints, and policy artifacts before execution and may not bypass that decision pipeline.
Source: Section 5.6 (p. 8). https://doi.org/10.5281/zenodo.19286845
Authorization Artifact Invariant
Operational execution may proceed only when the governance control plane generates a valid authorization artifact confirming successful governance evaluation.
Source: Section 5.6 (p. 8). https://doi.org/10.5281/zenodo.19286845
Lifecycle Evidence Invariant
All governance decisions and execution outcomes must be recorded as ordered lifecycle evidence supporting reconstruction, audit, compliance verification, and incident investigation.
Source: Section 5.6 (p. 8). https://doi.org/10.5281/zenodo.19286845
Distributed governance challenge: policy interpretation drift
Different systems can interpret the same policy differently because of implementation language or execution-environment differences, creating policy interpretation drift.
Source: Section 6.1 (p. 8). https://doi.org/10.5281/zenodo.19286845
Distributed governance challenge: inconsistent enforcement points
Governance becomes inconsistent when some systems mediate actions before execution while others rely on monitoring or alerts after execution.
Source: Section 6.2 (p. 8). https://doi.org/10.5281/zenodo.19286845
Distributed governance challenge: identity representation mismatch
Incompatible identity formats across enterprise systems make consistent governance evaluation difficult.
Source: Section 6.3 (p. 9). https://doi.org/10.5281/zenodo.19286845
Distributed governance challenge: fragmented authorization logic
Authorization logic implemented independently across multiple platforms can produce inconsistent decisions for equivalent governance conditions.
Source: Section 6.4 (p. 9). https://doi.org/10.5281/zenodo.19286845
Distributed governance challenge: incomplete audit evidence
Distributed enforcement mechanisms can generate fragmented or incomplete audit trails that prevent reliable reconstruction of governance decisions.
Source: Section 6.5 (p. 9). https://doi.org/10.5281/zenodo.19286845
Threat model includes unsafe or unauthorized proposed mutations
RGA assumes operational systems and automation agents may propose transitions that violate governance constraints because of configuration errors, defects, compromise, or malicious automation logic.
Source: Section 7.1 (p. 9). https://doi.org/10.5281/zenodo.19286845
Threat model covers bypass, identity/context manipulation, automation error, and audit tampering
RGA explicitly considers policy-bypass attempts, identity spoofing or context manipulation, incorrect autonomous actions, and attempts to alter governance evidence.
Source: Section 7.1 (pp. 9-10). https://doi.org/10.5281/zenodo.19286845
Trust assumptions require control-plane and policy-artifact integrity
RGA assumes the governance control plane executes deterministically and correctly, while governance rules, policy definitions, and invariants are produced through trusted processes and stored in tamper-resistant registries.
Source: Section 7.2 (p. 10). https://doi.org/10.5281/zenodo.19286845
Trust assumptions require enforcement-point integrity
Operational enforcement points such as admission controllers, API gateways, or orchestrators must enforce control-plane decisions and prevent execution when authorization artifacts are absent or invalid.
Source: Section 7.2 (p. 10). https://doi.org/10.5281/zenodo.19286845
Trust assumptions require append-only ledger integrity
RGA assumes the lifecycle evidence ledger provides append-only guarantees sufficient to prevent unauthorized modification of historical governance records.
Source: Section 7.2 (p. 10). https://doi.org/10.5281/zenodo.19286845
AGCP is the reference implementation of RGA governance execution
AGCP is presented as a reference implementation of the governance execution model defined by RGA, providing canonical submission, deterministic evaluation, authorization artifact generation, and lifecycle recording.
Source: Sections 8-9 (pp. 10-11) and Figure 2 (p. 12). https://doi.org/10.5281/zenodo.19286845
Enterprise systems and autonomous agents are state-machine proposers
Within RGA, enterprise systems and autonomous agents operate as operational state machines that propose mutations, while governance evaluation remains a separate architectural concern.
Source: Section 10 (p. 11), Figure 2 (p. 12), and Section 11 (p. 13). https://doi.org/10.5281/zenodo.19286845
Five-stage governance invocation pipeline
RGA summarizes governance invocation as five stages: collect identity/context, construct canonical action, evaluate rules/constraints/invariants, generate authorization artifact or rejection, and record lifecycle/execution evidence.
Source: Section 11 (p. 13). https://doi.org/10.5281/zenodo.19286845
Deterministic commit point resolves governance authority before execution
RGA identifies the boundary between governance evaluation and authorization artifact generation as the deterministic commit point at which governance authority is resolved prior to execution.
Source: Section 11 (p. 13). https://doi.org/10.5281/zenodo.19286845
RGA generalizes across heterogeneous operational domains
RGA applies the same governance-mediation model across infrastructure orchestration, financial transactions, security automation, and industrial control systems, despite different operational consequences and latency needs.
Source: Sections 12.1-12.4 and Conclusion (pp. 14-15). https://doi.org/10.5281/zenodo.19286845
Check Your Knowledge
After studying this paper and its lessons, use the paper-specific quiz to check your understanding.
Take the Paper 2 QuizAGCP: A Deterministic Execution-Layer Governance Control Plane for Autonomous and Programmatic Systems
Reasoning, governance, and execution separation
AGCP separates reasoning, governance, and execution: reasoning proposes, governance decides, and execution commits.
Source: Section 5 (p. 8)
Govern state mutation, not merely access
AGCP governs whether a proposed state mutation may be committed, not merely whether an actor has permission to request it.
Source: Sections 3-5 (pp. 6-8)
Admissibility versus commit eligibility
A proposal can be admissible during governance evaluation yet still fail to be eligible for commitment under current conditions.
Source: Sections 8 and 14.3 (pp. 12-13, 20-23)
Commit boundary defines execution
In AGCP, execution means a state transition has crossed the commit boundary; authorization alone is not execution.
Source: Section 8.2 (p. 13)
Commit-time revalidation and TOCTOU
AGCP revalidates execution eligibility against current canonical state at commit time to mitigate time-of-check/time-of-use inconsistencies.
Source: Sections 14.2.7 and 14.3 (pp. 19-23)
Deterministic governance
Under identical proposal, state, ledger, policy, invariant, and configuration inputs, AGCP governance evaluation must produce the same result.
Source: Sections 11 and 14.2.1 (pp. 14-18)
Canonical representation
Stage 2 canonicalization creates a deterministic schema-constrained representation that supports idempotency, replay, and consistent evaluation.
Source: Section 6.2 (p. 9)
Artifact-mediated governance
AGCP interactions are mediated through structured governance artifacts that are immutable, identifiable, context-bound, and replayable.
Source: Section 7 (pp. 10-11)
Governance Action Envelope
The Governance Action Envelope is the canonical input artifact representing a proposed state transition with identity, mutation, policy context, and provenance.
Source: Section 7.1 (p. 11)
Authorization Reference
An Authorization Reference is action-specific, non-reusable, context-bound, and verifiable proof of a completed admissibility evaluation.
Source: Section 7.2 (p. 11)
Ledger-derived lifecycle state
AGCP derives lifecycle state deterministically from ordered ledger history using State(a) = Phi(L_a) instead of trusting a mutable status field.
Source: Section 9 (pp. 13-14)
Ledger as governance system of record
The append-only ledger is part of the governance mechanism and is the canonical source for lifecycle reconstruction, not merely an after-the-fact audit log.
Source: Section 9.3 (p. 14)
Machine-verifiable HITL
Human-in-the-loop approval must be represented by verifiable, tenant-scoped, action- and context-bound tokens, with quorum support where required.
Source: Section 7.4 (p. 12)
Five-stage governance pipeline
AGCP evaluates governed actions through five ordered stages: Identity and Context Formation, Canonical Representation, Rule Evaluation, Commit Semantics, and Audit and Lifecycle Recording.
Source: Figure 1 and Section 6 (pp. 7-10)
Policy Evaluation Contract beyond a PDP
The Policy Evaluation Contract combines policy constraints, invariants, attributes, and HITL conditions into a deterministic admissibility decision rather than acting as a simple allow/deny PDP.
Source: Section 6.3 (p. 9) and Section 14.2.4 (pp. 18-19)
Commit-ordered concurrency
Concurrent proposals may be independently AUTHORIZED, but execution is resolved by commit order and validation against current canonical state.
Source: Sections 14.3.6-14.3.9 (pp. 22-23)
Binding validation
Optional binding validation is distinct from admissibility and determines which already-admissible proposals can be reconciled with current state and competing proposals.
Source: Sections 14.3.5-14.3.6 (pp. 21-22)
Conditional non-bypassability
AGCP non-bypassability holds only when external architecture ensures that every consequential execution path is mediated through the control plane.
Source: Section 14.2.3 (p. 18)
Deterministic failure taxonomy
AGCP distinguishes structural failures, evaluated governance failures, and commit-time failures and handles each in a defined deterministic way.
Source: Section 14.4.3 (pp. 24-25)
Composition with existing security technologies
AGCP composes identity, policy, provenance, execution, and logging technologies rather than replacing their specialized functions.
Source: Sections 2.7 and 12 (pp. 5, 15-17)
Applicability beyond AI
AGCP applies to any human-initiated or programmatic system that proposes consequential state transitions, not only to AI agents.
Source: Sections 1 and 4 (pp. 2, 8)
Governance compilation is upstream of AGCP
AGCP assumes governance intent has already been compiled into executable artifacts; it enforces those artifacts rather than interpreting human policy at runtime.
Source: Section 6 introduction (p. 8) and Section 13 (p. 17)
Layered governance stack positioning
PBSAI defines the governance ecosystem, RGA provides governance architecture and compilation, formal semantics define correctness properties, and AGCP provides deterministic execution-layer enforcement.
Source: Sections 2.2-2.6 and 13 (pp. 3-4, 16-17)
Performance trade-off for governance guarantees
Artifact processing, ledger interaction, pipeline ordering, and commit-time validation add bounded latency in exchange for determinism, auditability, replayability, and safer execution.
Source: Section 15 (pp. 27-29)
Limits of AGCP correctness guarantees
AGCP cannot make incorrect policies or invariants correct and depends on a deterministic environment, ledger integrity, correct specifications, and full execution mediation.
Source: Section 16 (p. 29) and Section 14.2 (pp. 18-20)
Check Your Knowledge
After studying this paper and its lessons, use the paper-specific quiz to check your understanding.
Take the Paper 3 QuizFormal Execution Semantics and Safety Invariants for Governance Control Planes in Autonomous Systems
Controlled state-transition model
The governance problem is modeled as a controlled state transition S' = T(S, A), where a proposed action A would transform canonical state S into resulting state S'.
Source: Section 5.1 (pp. 13-14)
Separation of reasoning and authorization
The formal model separates agent reasoning from action authorization so the agent may propose actions without controlling whether they become operationally real.
Source: Sections 1 and 4 (pp. 2-7)
Adversarial agent assumption
The model does not require the agent to be trusted; an adversarial or compromised agent is still constrained by the governance control plane.
Source: Sections 5.2-5.5 and Corollary 1 (pp. 14-19)
Govern both actions and resulting states
Governance must constrain both the proposed action and the state that would result from applying it.
Source: Sections 5.1 and 5.6-5.8 (pp. 13, 16-18)
Action-space restrictions alone are insufficient
Restricting the form of allowed actions is insufficient if an otherwise permitted action can still produce a state that violates required invariants.
Source: Sections 5.1 and 5.6-5.8 (pp. 13, 16-18)
Validation combines Cspec and invariants
V(S, A) authorizes only when the compiled action constraints Cspec(A) are satisfied and every invariant holds over T(S, A).
Source: Sections 5.1 and 5.6-5.8 (pp. 13, 16-18)
Governance compilation makes policy executable
Governance compilation translates human-readable policy sources into structured, machine-interpretable rules and specifications for deterministic runtime evaluation.
Source: Section 3 (pp. 5-6)
Human interpretation remains authoritative in compilation
Software or generative AI may assist governance compilation, but the authoritative specification reflects deliberate human interpretation of policy intent.
Source: Section 3 (p. 6)
Agent Operating Specification as governance contract
The compiled Agent Operating Specification defines the governance envelope within which an agent's proposed mutations are evaluated and serves as the formal contract with the control plane.
Source: Section 4 (pp. 6-8)
Agent behavior and governance are decoupled
The control plane need not understand the agent's internal reasoning; it governs the structured operational mutation produced by that reasoning.
Source: Sections 4 and 6 (pp. 6-8, 20-21)
Trusted event provenance
Events that trigger governed behavior must carry provenance sufficient to establish that they originated from trusted sources.
Source: Section 4.2 (pp. 8-9)
Explicit authoritative sources
The operating specification identifies which enterprise systems are authoritative for governance-relevant facts such as lifecycle events or role mappings.
Source: Sections 4.2-4.4 (pp. 8-12)
Schema validation precedes policy evaluation
A proposed mutation must conform to its deterministic canonical schema before governance rules are evaluated.
Source: Section 6.2 and Appendix A.4 (pp. 21-23, 35-37)
Canonicalization supports deterministic governance
Canonicalization ensures semantically equivalent actions have a consistent representation for repeatable validation.
Source: Sections 5.10 and 6.2 (pp. 18-23)
Execution target is part of the governed action
The execution target is part of the canonical governed action because the meaning and authorization of a mutation depend on where it will be applied.
Source: Section 5.1 and Appendix A.4 (pp. 13, 35-37)
Authorization is bound to execution target
Authorization for action A at target t does not authorize the same mutation redirected to a different target t'.
Source: Theorem 4, Section 5.11 (pp. 19-20)
Invariant preservation theorem
If a valid state S admits action A under V(S, A)=1, then the resulting state S'=T(S,A) remains valid because all invariants are preserved.
Source: Lemma 1 and Theorem 1, Sections 5.7-5.8 (pp. 17-18)
Non-bypassability theorem is conditional
The non-bypassability result depends on the system constraint that every state transition is mediated by the governance control plane.
Source: Theorem 2, Section 5.9 (p. 18)
Adversarial mutation containment
A compromised agent can cause a real transition only if its adversarial action still satisfies the control plane's validation function.
Source: Corollary 1, Section 5.9 (pp. 18-19)
Deterministic evaluation consistency
For fixed canonical state S and action A, repeated evaluations of V(S,A) yield the same result; canonical equivalent actions must also evaluate consistently.
Source: Theorem 3, Section 5.10 (p. 19)
TOCTOU safety requires execution-state validation
Avoiding time-of-check/time-of-use inconsistencies requires validation against the state that governs the actual execution, not a stale earlier snapshot.
Source: Section 5.12 (pp. 19-20)
TOCTOU elimination has explicit conditions
The paper's TOCTOU-elimination result requires commit-time validation against canonical state and no intervening state transition between validation and execution.
Source: Theorem 5, Section 5.12 (pp. 19-20)
Canonical state is security-critical
Because admissibility is computed from canonical state, corruption or inconsistency in that state undermines the safety argument.
Source: Sections 5.1-5.5 (pp. 13-16)
Trusted computing base
The safety model depends on a trusted computing base that includes the governance control plane, policy registry, canonical-state source, and audit mechanisms.
Source: Sections 5.2-5.5 (pp. 14-16)
Formal guarantees stop at the trust boundary
The formal results do not provide end-to-end safety under arbitrary control-plane compromise, state corruption, malicious policy artifacts, or audit tampering.
Source: Sections 5.2-5.6 (pp. 14-17)
Policy completeness assumption
Safety depends on the compiled constraints and invariant set being sufficiently complete to express the governance conditions that matter.
Source: Sections 5.2-5.5 and 5.7 (pp. 14-18)
Deterministic governance does not make AI deterministic
The model constrains the execution decision deterministically while allowing upstream AI reasoning to remain probabilistic.
Source: Sections 1, 4, and 7 (pp. 2-7, 25-27)
Governance as a guarded transition system
The model can be represented as a guarded transition system in which action constraints restrict admissible inputs and invariants constrain reachable states.
Source: Section 5.6 (pp. 16-17)
Amenable to standard formal methods
Because transitions, guards, and invariants are explicit, the governance model can be encoded for model checking or theorem proving using standard formal-methods techniques.
Source: Section 5.6 (pp. 16-17)
Five-stage control-plane execution pipeline
The formal architecture realizes governance through Identity and Context Validation, Action Schema Evaluation, Governance Rule Evaluation, Commit Authorization, and Audit and Lifecycle Recording.
Source: Section 6 and Figure 4 (pp. 20-21)
Identity is only the first governance stage
Authenticating the requesting agent establishes identity and provenance context but does not itself authorize the operational mutation.
Source: Section 6.1 (pp. 20-21)
Schema validation differs from governance-rule validation
Schema evaluation determines whether a mutation is structurally valid and canonical, while governance-rule evaluation determines whether that valid mutation is policy-admissible.
Source: Sections 6.2-6.3 (pp. 21-23)
Runtime enforcement uses compiled rules
The governance control plane evaluates precompiled rules at runtime and does not reinterpret human-readable governance policy for each mutation.
Source: Section 4.5 and Section 5 introduction (pp. 11-13)
Versioned policy artifacts support reproducibility
Governance decisions are reproducible only when the exact compiled specification and policy artifacts used during evaluation can be identified and replayed.
Source: Sections 4-6 and audit examples (pp. 6-25)
Audit records reconstruct lifecycle
Audit and lifecycle recording preserve the original request, canonical mutation, rule results, authorization decision, context, and execution outcome for reconstruction.
Source: Section 6.5 (pp. 24-25)
Governance Action Envelope as canonical interface
Every agent-proposed operational mutation is encapsulated in a Governance Action Envelope carrying identity, mutation, policy context, evidence, provenance, and submission metadata.
Source: Appendix A.1-A.8 (pp. 35-38)
Execution systems verify authorization before mutation
Operational execution systems must verify the governance authorization associated with a mutation before applying the state change.
Source: Section 6.4 and Appendix A (pp. 23-24, 35-38)
Governance consistency over decentralized interpretation
The architecture favors consistent deterministic evaluation of compiled governance over letting distributed agents independently reinterpret policy.
Source: Sections 3-7 (pp. 5-27)
Distributed-systems control-plane foundations
The architecture borrows deterministic processing, canonical state, staged validation, and transaction-style commitment from distributed-systems control-plane design.
Source: Sections 1, 6, and 7 (pp. 2-4, 20-27)
Bounded execution is the security objective
The core security objective is to bound what autonomous reasoning can make operationally real, not to prove that the reasoning process will always be correct.
Source: Sections 1, 5, and 8 (pp. 1-4, 13-20, discussion)
Check Your Knowledge
After studying this paper and its lessons, use the paper-specific quiz to check your understanding.
Take the Paper 4 QuizAGCP Operating Model and Semantic Architecture: Proposal Schemas, Governance Context, Canonical State, and Commit-Bound Execution Semantics for Autonomous Systems
Operational legitimacy at commit
Governance determines whether a proposed operation may become operationally real, not merely whether an authorized actor requested it.
Source: Sections 1-2.1 (pp. 6-10)
Explicit execution-governance lifecycle
The operating lifecycle is proposal -> context association -> canonical-state resolution -> invariant evaluation -> commit/refusal/escalation -> governance receipt.
Source: Sections 2.1-2.7 (pp. 9-14)
Proposal is not authority
A governed proposal represents requested operational intent; it is the object evaluated by governance and does not itself confer authority.
Source: Sections 2.2 and 3.1-3.2 (pp. 10, 16)
Proposal validity does not imply commit admissibility
A structurally valid proposal may still be inadmissible at the commit boundary because governance state, invariants, or other conditions do not permit it.
Source: Sections 2.6 and 10.2 (pp. 13, 58)
Governance context is not authoritative state
The Governance Context Envelope preserves coordination metadata and lineage but does not itself constitute authoritative operational truth.
Source: Sections 2.3 and 4.2-4.6 (pp. 11, 22-24)
Context and canonical state remain separate
Dynamic context and canonical state are distinct governance inputs: context describes coordination circumstances while canonical state represents authoritative governance reality.
Source: Sections 4.6 and 5.6 (pp. 24, 30)
Canonical state as a first-class governance primitive
Canonical state is the authoritative reference against which operational admissibility is evaluated and is itself a primary governance primitive.
Source: Sections 2.4 and 5 (pp. 11-12, 26-32)
Canonical state resolved at commit evaluation
Authoritative canonical state must be resolved at or immediately before commit evaluation so admissibility reflects current governance reality.
Source: Sections 2.4 and 5.3 (pp. 11-12, 28)
Identity is an input, not operational legitimacy
Authenticated identity contributes governance context but does not by itself prove that a proposed operational transition is legitimate.
Source: Sections 2.6 and 10.1 (pp. 13, 57)
Stable invariant sets
Governance constraints are represented as stable invariant sets established for the control plane and governed agents while dynamic operational context changes around them.
Source: Sections 2.5 and 8.2 (pp. 12-13, 46)
Control-plane invariants
Control-plane invariants apply across governed transitions as global constraints on operational admissibility.
Source: Section 6.4 (p. 35)
Agent-bound invariants
Agent-bound invariants constrain the operational scope and behavior of a specific agent in addition to global control-plane invariants.
Source: Section 6.5 (p. 36)
Admissibility uses five inputs
Admissibility evaluates the ProposedTransition, CanonicalState, DynamicContext, ControlPlaneInvariantSet, and AgentInvariantSet together.
Source: Section 2.5 (pp. 12-13)
Commit boundary is the enforcement point
The commit boundary is where governance determines whether the proposal becomes operationally real, is structurally refused, or is escalated.
Source: Sections 2.6 and 6.2 (pp. 13, 34)
Authorization belongs at operational commit time
Operational authorization is determined at commit time after current state and invariants have been evaluated, not merely when the request originated.
Source: Sections 2.6 and 6.1-6.3 (pp. 13, 33-34)
Refusal is a first-class governance outcome
A refused transition is an explicit governance outcome that should be represented and retained, not treated as an absence of activity.
Source: Sections 2.7 and 7.3 (pp. 14, 41)
Structural refusal is a security mechanism
Structural refusal rejects proposals that cannot safely enter or continue the governance lifecycle because required structure, provenance, or conditions are missing.
Source: Sections 6.6, 7.4, and 10.6 (pp. 36, 41, 61)
Escalation is a governed state
Escalation is an explicit governance outcome/state used when additional human or governance adjudication is required before commitment.
Source: Sections 6.7 and 9.7 (pp. 37, 55)
Every governance decision produces a durable artifact
Commit, refusal, escalation, deferred authorization, and conditional outcomes should all produce durable governance artifacts.
Source: Sections 2.7 and 7.1 (pp. 14, 39)
Commit receipts preserve admission conditions
A commit receipt records the governance conditions and references that explain why a transition was admitted and committed.
Source: Section 7.2 (p. 40)
Refusal records are as important as commit receipts
Refusal records preserve why an operation was not admitted and are required for accountability, replay, and forensic reconstruction.
Source: Section 7.3 (p. 41)
Cryptographically attributable governance outcomes
Governance outcomes should be attributable to identifiable governance authorities or components through cryptographic signatures or attestations.
Source: Section 7.5 (p. 42)
Replayability as an operating property
Replayability allows a prior governance decision to be reconstructed from the proposal, state, invariants, context, and recorded outcomes under the same governing conditions.
Source: Sections 7.6 and 8.4 (pp. 43, 47)
Deterministic admissibility
The same proposal, canonical state, and invariant bindings should produce the same admissibility result.
Source: Sections 2.8 and 8.1 (pp. 14-15, 46)
Deterministic governance versus heuristic runtime control
Deterministic governance is distinct from heuristic runtime control because governance outcomes must remain reproducible under the same authoritative inputs.
Source: Section 8.7 (p. 49)
Governance continuity across multi-agent delegation
Governance continuity should preserve mission, workflow, evidence, provenance, and constraint lineage as work moves across agents.
Source: Sections 4.4-4.7 and 9.2 (pp. 23-25, 52)
Delegation does not transfer governance authority
Delegating a task passes work and lineage, not authority to bypass independent admissibility evaluation for the delegated agent's consequential actions.
Source: Section 9.3 (p. 52)
Coordination does not require centralized orchestration
Governance continuity can be maintained across distributed coordination without requiring one centralized orchestrator to control all agents.
Source: Section 9.1 (p. 51)
Transport neutrality
Governance semantics should survive transport choices such as APIs, message buses, or event streams rather than being tied to one protocol.
Source: Sections 3.6 and 11.1 (pp. 19, 64)
Implementation independence
The operating model specifies governance semantics without requiring a single product, programming language, policy engine, or infrastructure implementation.
Source: Section 11.2 (p. 64)
Five modular governance primitives
The protocol is decomposed into the Governed Action Proposal Schema, Governance Context Envelope, Canonical State Model, Commit-Bound Execution Semantics, and Governance Receipt and Refusal Record Model.
Source: Introduction and Section 11.8 (pp. 7, 68)
Incremental protocol adoption
Organizations can adopt governance primitives progressively rather than replacing the full orchestration and execution stack at once.
Source: Section 11.7 (p. 67)
Different governance layers have different responsibilities
Broader governance frameworks define objectives and obligations while the AGCP operating model supplies execution-level primitives for deterministic operational admissibility.
Source: Section 11.3 and conclusion (pp. 65, 74)
Interoperability through common primitives
Governance interoperability requires shared meanings for proposals, context, canonical state, commit semantics, and outcomes rather than identical platforms.
Source: Sections 8.6 and 11.8 (pp. 49, 68)
Governance as an operational execution layer
The operating model treats governance as an active operational execution discipline integrated into the commit lifecycle rather than as external oversight.
Source: Sections 11.9 and 12.8-12.9 (pp. 68, 73-74)
Check Your Knowledge
After studying this paper and its lessons, use the paper-specific quiz to check your understanding.
Take the Paper 5 QuizThe PBSAI Governance Ecosystem: A Multi-Agent AI Reference Architecture for Securing Enterprise AI Estates
AI estate as the unit of governance
PBSAI treats the AI estate – models, agents, data pipelines, tools, human workflows, and compute – as the relevant system-of-systems for governance and defense.
Source: Sections 1-1.2 (pp. 1-4)
AI governance implementation gap
High-level governance and security frameworks state principles and obligations but often leave organizations to design the concrete multi-agent architecture and evidence mechanisms needed to implement them.
Source: Section 1.1 and Section 2.4 (pp. 2-3, 8-9)
Fragmentation from tool-by-tool AI adoption
Adding proprietary AI features independently to SIEM, EDR, SOAR, and other tools can create a fragmented estate with incompatible schemas, evidence, and governance semantics.
Source: Sections 1.1-1.3 and 2.5 (pp. 3-4, 9-11)
PBSAI is an overlay, not rip-and-replace
PBSAI is designed as a tool-agnostic management, coordination, and evidence overlay that can sit above and around existing SOC, MLOps, cloud, identity, and security systems.
Source: Section 2.5 and Section 3.1 (pp. 9-13)
Core tools remain sensing and enforcement planes
Existing systems such as SIEM, EDR, IAM, SOAR, cloud security, and data platforms remain primary sensing or enforcement planes while PBSAI coordinates governance and evidence above them.
Source: Section 3.1 (pp. 12-13)
Twelve-domain taxonomy
PBSAI organizes the estate into twelve domains: A GRC/Oversight, B Asset/Configuration/Change, C ICAM, D Threat Intelligence/Situational Awareness/Monitoring, E Protective Technologies/Hardening, F Data Security/Privacy, G Incident Response/DFIR, H Resilience/Continuity/Recovery, I Security Architecture/Systems Engineering, J Physical/Environmental Security, K Supply Chain/Lifecycle Security, and L Security Program Enablement/Knowledge/AI Validation.
Source: Section 3.2 (pp. 15-17) and Appendix A (pp. 44-47)
Domains form an ecosystem, not silos
PBSAI domains are intentionally interconnected through shared schemas, context, and evidence so that governance and defensive controls reinforce one another across domain boundaries.
Source: Sections 3.2, 4, and 7.4 (pp. 15-24, 39-40)
Domains A, I, and L provide coordinating roles
Governance/Oversight (A), Security Architecture/Systems Engineering (I), and Security Program Enablement/AI Validation (L) provide important cross-cutting coordination, architecture, validation, and oversight functions.
Source: Section 3.2 (pp. 15-17) and Section 5.2 (p. 29)
Many small bounded agents
PBSAI behavior emerges from many small, role-bounded agents rather than one monolithic AI brain with broad authority across the estate.
Source: Section 4 and Section 4.1 (p. 20)
Agents sit between tools and policies
PBSAI agents act as small software workers between operational tools and governance policies, transforming events under constraints rather than replacing either side.
Source: Section 4.1 (pp. 20-21)
Strongly typed boundaries
PBSAI requires strongly typed agent boundaries so inputs and outputs conform to agreed schemas and can be validated by other components.
Source: Sections 4.2 and 4.5 (pp. 21, 24-25)
MCP-style context envelope carries governance
The MCP-style context envelope carries mission, thread, task, role, intent, policy references, constraints, decision basis, provenance, classification, legal-hold, and related governance context across agent invocations.
Source: Section 4.3 (pp. 22-24)
Context preserves operational continuity
Shared context preserves mission, thread, task, policy, constraint, and provenance continuity as work moves among agents and tools.
Source: Section 4.3 (pp. 22-24)
Evidence is structured and reusable
PBSAI favors machine-readable, schema-constrained evidence objects that can be validated, queried, reused, and linked across domains.
Source: Sections 1.3, 3.3, and 4.5 (pp. 4-5, 17-19, 24-25)
Evidence graph as a central architecture element
A queryable evidence graph links policies, assets, controls, events, models, agents, incidents, decisions, and outcomes across the AI estate.
Source: Section 1.2 (p. 4) and Section 7.1 (p. 36)
Evidence answers who, what, policy, and basis
The evidence model should let an assessor reconstruct who or what acted, what occurred, under which policies, and on the basis of which evidence.
Source: Sections 4.3-4.5 and Hypothesis H1 (pp. 22-25, 38)
Ecosystem-level invariants
PBSAI identifies ecosystem invariants for traceability, human oversight on high-impact actions, and provenance/integrity of agent behavior and outputs.
Source: Section 4.2 (pp. 21-22)
Traceability requires policy and evidence links
A security-relevant agent action is traceable when it is linked to both the governing policy/constraint context and the evidence that justified it.
Source: Sections 4.2-4.5 (pp. 21-25)
Human oversight is machine-readable
PBSAI models HITL requirements as explicit context fields, constraints, states, and approval references rather than informal side-channel review.
Source: Sections 3.3 and 4.5 (pp. 18-19, 24-25)
Stronger governance for Crown Jewels and high-impact actions
Actions affecting Crown Jewels or high-impact business functions require stronger constraints and human oversight than routine low-impact activity.
Source: Sections 3.3, 4.2, and 6.3 (pp. 18-19, 21-22, 34-35)
Provenance covers agent implementation and deployment
PBSAI provenance extends beyond individual outputs to the identity, code/build, signing, deployment, and attestation of the agent that produced them.
Source: Section 4.5 and Section 4.6 (pp. 24-27)
Deterministic-first, LLM-second
PBSAI applies deterministic logic wherever possible and uses LLMs only for bounded judgment or language tasks where they add value.
Source: Section 4.4 (pp. 24-25)
LLMs assist rather than define critical decision logic
LLMs may summarize, classify, explain, or support judgment, but critical governance decision logic should remain explicit and deterministic.
Source: Section 4.4 (pp. 24-25)
LLM outputs are constrained and post-validated
When PBSAI uses an LLM, its outputs are checked against schemas, ranges, policy constraints, and other deterministic post-conditions before downstream use.
Source: Section 4.4 (pp. 24-25)
Secure baseline before high-assurance automation
PBSAI assumes foundational identity, telemetry, attestation, segmentation, resilience, policy libraries, HITL thresholds, Crown Jewel inventories, and evidence/schema registries before high-assurance automation.
Source: Section 3.3 (pp. 17-19)
Weak foundations reduce assurance
PBSAI can operate partially when baseline capabilities are missing, but fragmented identity, missing attestation, weak telemetry, or absent schemas reduce its coverage and assurance.
Source: Section 3.3 and Section 7.1 (pp. 17-19, 36-37)
Identity integration is a hard deployment problem
PBSAI deployments often struggle to unify user, service, agent, cloud, and directory identities well enough to answer who acted and with what authority.
Source: Section 6.3 (pp. 34-35)
Telemetry normalization is a hard deployment problem
PBSAI depends on normalizing diverse telemetry and event sources into consistent analyzable forms across relevant domains.
Source: Section 6.3 (pp. 34-35)
Schemas are interoperability mechanisms
Output Contracts and context-envelope schemas let agents and tools exchange machine-verifiable information consistently across vendors and domains.
Source: Sections 4.5 and 6.3 (pp. 24-25, 34-35)
PBSAI bridges systems security engineering and AI governance
PBSAI connects systems security engineering techniques and estate-level operational responsibilities to AI governance functions and regulatory objectives.
Source: Sections 1.3-1.4 and Section 5 (pp. 4-6, 27-31)
Analytic Monitoring
PBSAI realizes Analytic Monitoring through continuous evidence-backed analysis of telemetry and system behavior, especially in monitoring and AI-validation domains, rather than raw log collection alone.
Source: Section 5.1 (pp. 27-28)
Substantiated Integrity
PBSAI realizes Substantiated Integrity by supporting claims about running assets, configurations, components, and suppliers with reconciled inventories, baselines, attestations, and provenance.
Source: Section 5.1 (p. 28)
Coordinated Defense
PBSAI realizes Coordinated Defense by making controls and agents across identity, monitoring, protection, response, resilience, supply chain, and governance reinforce one another through shared evidence and context.
Source: Section 5.1 (pp. 28-29)
Adaptive Response remains governed
PBSAI permits adaptation to evidence and changing conditions, but policy changes and automation adjustments remain explicit, reviewable, and encoded as governed constraints rather than ad hoc model behavior.
Source: Sections 5.1-5.2 (pp. 28-29)
NIST AI RMF mapping
PBSAI maps Govern primarily to A/I/L, Map to B/C/F/K, Measure to D/L, and Manage to E/G/H/L, while recognizing that domains can contribute to multiple functions.
Source: Section 5.2 and Table 3 (pp. 29-30)
Regulatory obligations tied to operational evidence
PBSAI supports regulatory obligations by linking data governance, human oversight, robustness, incident response, continuity, supply chain, and documentation to structured operational evidence.
Source: Section 5.3 (pp. 30-31)
Incremental PBSAI adoption
PBSAI can begin as a thin overlay in selected domains and expand over time instead of requiring a complete twelve-domain implementation on day one.
Source: Sections 1.3, 6.1, and 6.3 (pp. 4-5, 31-35)
Automation maturity grows from evidence
PBSAI increases or reduces automation based on measured agent performance, evidence quality, policy outcomes, and operational trust rather than assuming maximum autonomy from the start.
Source: Sections 4.6 and 6.3 (pp. 26-27, 34-35)
Agents require lifecycle governance
PBSAI agents follow a secure lifecycle from development and testing through CI/CD signing, canary deployment, promotion, monitoring, and rollback.
Source: Section 4.6 (pp. 26-27)
Agent SLOs and KPIs
PBSAI tracks measurable objectives such as acknowledgement latency, false-alert rate, and coverage so governance and engineering teams can judge whether agents perform as intended.
Source: Section 4.6 (pp. 26-27) and Appendix B.6 (pp. 52-53)
Rollback criteria are pre-established
PBSAI defines rollback triggers in advance, such as unacceptable false-alert rates, degraded timeliness, policy conflicts, repeated human overrides, or lost dependency trust.
Source: Section 4.6 (pp. 26-27)
Historical evidence survives agent replacement
Signed outputs, provenance, contracts, and context allow historical agent decisions to remain traceable even after an agent is rolled back, upgraded, or replaced.
Source: Section 4.6 (p. 27)
Scale-invariant architecture
PBSAI keeps the same domain, agent, context, and evidence architecture across enterprise, hyperscale, and HPC-backed deployments.
Source: Figure 1 and Sections 3.1, 6.2-6.3 (pp. 12-14, 33-35)
HPC changes scale, not architecture
HPC and accelerators expand the scale of analytics, replay, hunting, and validation but do not change PBSAI's fundamental governance structure or invariants.
Source: Sections 6.2-6.3 (pp. 33-35)
AI-aware but not AI-exclusive
PBSAI coordinates LLMs, classical ML, deterministic logic, non-AI telemetry, conventional controls, and human workflows; domains can still function where AI adoption is limited.
Source: Section 3.1 (pp. 12-14)
AI-specific and conventional threats
PBSAI's threat model includes AI-specific risks such as prompt injection and model misuse alongside classic cyber threats such as credential theft, privilege escalation, supply-chain compromise, and physical disruption.
Source: Section 3.1 threat model (pp. 13-15)
Threats are estate-level concerns
PBSAI maps threat categories to coordinated responsibilities across multiple domains rather than assigning each threat to one isolated control or tool.
Source: Section 3.1 threat model and Table 2 (pp. 14-15)
C1 Identity Provisioning worked example
The C1 example shows how a PBSAI identity-provisioning agent can implement joiner/mover/leaver governance using authoritative HRIS events, role mappings, Output Contracts, context, HITL, and measurable SLOs.
Source: Appendix B (pp. 48-54)
Agent workflows can use explicit state machines
PBSAI agent workflows can be represented as explicit states and transitions, making approvals, provisioning, verification, rollback, SLA breach, and contest paths inspectable and governable.
Source: Appendix B.5 (pp. 51-52)
Reference architecture, not a product
PBSAI is a tool-agnostic reference architecture and shared vocabulary intended to guide implementations, integrations, and open ecosystem work rather than a monolithic commercial product.
Source: Section 7.2 (pp. 37-38)
Not yet empirically validated at scale
The paper presents a conceptual and pattern-based architecture whose effects on operational and governance outcomes still require systematic empirical validation and benchmarks.
Source: Section 7.2 (p. 37)
PBSAI defines testable hypotheses
The paper proposes empirical hypotheses about auditability, investigation latency and coverage, bounded LLM/HITL safety, HPC scaling, and quantum-assisted analysis that can be tested in future studies.
Source: Section 7.3 (pp. 37-39)
Check Your Knowledge
After studying this paper and its lessons, use the paper-specific quiz to check your understanding.
Take the Paper 6 QuizContinue the Runtime Governance Learning Pathway
Use this guide alongside the six core papers, narrated briefings, companion slides, and knowledge checks on the AGCP Training page. After completing the series, use the AGCP Runtime Governance Assessment Readiness Check to evaluate whether an organization or system is ready for deeper assessment.
