All field notes

Governed runtime

Can an Autonomous Organization Prove It Has Forgotten?

Deletion is not a database operation when knowledge has become embeddings, summaries, caches, agent memory and model inputs. Forgetting needs to be a governed runtime protocol.

MP
Max PerfiljevFounder & CEO, AES · Architect of Autonomous Organizations
Read in Russian

An autonomous organization does not merely store information. It continuously turns it into other forms: embeddings for retrieval, summaries for handoffs, working context for agents, cached responses, business records, prompts sent to models, and copies held by processors. A request to erase a source record therefore raises a more difficult question than “was the row deleted?” It asks whether that record can still shape a future organizational decision.

The useful architectural concept is influence revocation. An organization has forgotten a piece of knowledge only to the extent that it has stopped that knowledge from being used again, traced and handled its known derivatives, and recorded what remains unresolved. This is not a promise of perfect erasure. It is a disciplined, bounded claim that can be inspected.

A delete is an action; forgetting is a protocol

GDPR Article 17 establishes a right to erasure on specified grounds and requires reasonable steps concerning links, copies and replications when personal data has been made public. Its exceptions matter just as much: legal obligations, public-interest archiving and legal claims can limit erasure. Article 19 separately addresses communicating erasure or processing restrictions to recipients, unless that is impossible or disproportionate.

These provisions do not prescribe an agent-runtime design. But they expose why a simple deletion endpoint is inadequate. The operational task is a coordinated state transition across systems with different retention rules, technical controls and owners. A database may confirm deletion while a retrieval index still returns an embedding, a cache serves an old summary, or an external service retains a copy under a processor arrangement.

This distinction becomes sharper with AI. The UK ICO notes that transformed training data may still be personal data if a person can be singled out. It also distinguishes deleting training records from deleting models derived from them. Removing training records does not automatically require deletion of every trained model; the relevant question is whether the model contains the data or permits it to be inferred. Some situations may require model deletion or retraining. NIST describes machine unlearning as selectively removing the influence of particular training data, potentially without full retraining. That makes unlearning a distinct remediation class, not a synonym for deleting a file.

Model the organization’s knowledge as a provenance graph

Forgetting begins before an erasure request arrives. The runtime needs to know where knowledge came from, which transformations touched it, and where the results travelled. A provenance graph provides that map. W3C PROV-O supplies relations for entities that were used, generated, derived, revised or copied into alternate forms; its example of a backup as an alternate entity is directly relevant to deletion scope.

The graph should connect a governed source object to its embeddings, chunks, summaries, derived records, agent-memory entries, indexes, caches, model-training datasets, exports and processor destinations. It should also record the transformations and responsible services that created those objects. PROV-O is useful representation machinery, not a complete erasure protocol. Nor is provenance harmless by default: it can itself contain personal or sensitive information, so it needs minimization, access controls and an independent retention policy.

Completeness is an architectural property. If a system creates a summary without recording its parent objects, it has created an untraceable derivative. If an agent stores a conclusion as durable memory without a source lineage, that memory cannot be reliably withdrawn. The right response is not to hope that a later search finds every copy. It is to make lineage capture a condition of writing durable knowledge.

Make every forgetting request a typed operation

An erasure or retention-expiry request should enter the runtime as a governed operation, not an ad hoc ticket. It needs a stable identifier, a requested scope, the governing basis, applicable exceptions, an owner, deadlines and a policy version. The operation should first place the affected source and known derivatives under a use restriction. This is the immediate safety move: new retrieval, agent-memory reads, exports and downstream processing should be denied or constrained while remediation proceeds.

The runtime then traverses derivation and replication edges and dispatches target-specific work. There is no universal “delete” instruction because the targets are different technical objects. A source system may delete a record; a vector service may remove entries and rebuild an index; a cache may invalidate keys; encrypted storage may support cryptographic erasure where the organization controls the relevant data and keys; a recipient may need a notification and acknowledgement; a model may require an assessment for retraining, deletion or an unlearning method.

  • Classify the request and record its governing basis, scope and exceptions.
  • Restrict new use immediately, including retrieval and agent-memory rehydration.
  • Discover reachable derivatives, alternate copies, recipient systems and unresolved graph gaps.
  • Issue an action suited to each target rather than applying a generic deletion call.
  • Obtain completion evidence from internal services and acknowledgements from external processors.
  • Test whether the knowledge can still be retrieved, reintroduced through a derivative, or influence the defined decision paths.
  • Close with an assurance level, residual risks and any required follow-up.

Verification must test future influence

A completion signal from a storage service is necessary but insufficient. The organization should verify the property it actually cares about: can this knowledge still affect later work? The answer will vary by system. For retrieval, test that source-linked chunks and embeddings no longer appear in defined retrieval paths. For caches, test invalidation and expiry behavior. For agent memory, test that a new session cannot rehydrate the withdrawn conclusion. For processor copies, retain acknowledgement status and escalation paths. For models, separate an assessment of residual exposure from claims about ordinary data deletion.

Verification also needs declared boundaries. A graph may not cover an unmanaged export. A processor may not yet acknowledge a request. A model-level mitigation may be approximate and require a method-specific evaluation. In these cases, the honest result is not “forgotten.” It is bounded assurance: use has been restricted in named systems, identified actions have completed, and specified residuals remain open. The system should expose those residuals to the people accountable for accepting or resolving them.

Keep evidence without keeping the content

A deletion protocol must not destroy its own accountability. The EDPB’s May 2026 case digest considers how regulators assess internal processes for erasure and objection rights. That is a reminder that operational design is subject to scrutiny, not just a published privacy statement. Yet retaining full deleted content in an audit log simply recreates the problem.

The evidence record should therefore be content-free where possible. It can preserve the operation identifier; pseudonymous or otherwise minimized references; the requested and resolved scope; legal or policy basis; exceptions; target classes; timestamps; service attestations; recipient acknowledgements; verification results; the applicable policy version; and residual-risk decisions. That record needs its own access controls and retention rules. It demonstrates that a governed action occurred without becoming an undeclared shadow archive.

NIST frames media sanitization as making access infeasible for a defined level of effort, using techniques and controls chosen for information sensitivity. The same discipline belongs here. Forgetting is not one irreversible primitive. It is a portfolio of controls, evidence and assurance matched to the data, the derivative and the decision risk.

The operating consequence

An autonomous organization cannot responsibly claim to forget if its agents can silently restore withdrawn knowledge from an overlooked summary, cache or external copy. The necessary control is not a larger deletion queue. It is a runtime protocol that makes knowledge lineage, use restriction, remediation and verification first-class operational capabilities.

That protocol changes system design upstream. Teams must attach lineage when they create durable derivatives. Procurement must treat downstream rights support and processor assistance as architectural requirements, consistent with ICO guidance. Product teams must decide which decision paths can be tested for residual influence. Governance owners must accept that some outcomes are conditional, with explicit exceptions and unresolved copies.

A mature organization will not say it has achieved metaphysical forgetting. It will say exactly what it restricted, what it removed or remediated, what it verified, which recipients confirmed action, and what uncertainty remains. For a system that acts on knowledge, that is the only credible form of proof.

BUILD WITH AES

Turn architecture into an operating company.

AES connects strategy, tasks, organizational memory, knowledge, agents, people and approvals in one execution environment.