Compliance Guide

Algorithmic Disgorgement and FTC Enforcement Against AI Systems

Algorithmic disgorgement is an FTC remedy that requires a company to delete not just improperly collected data but also any models, algorithms, or derived work product built from that data. The FTC has ordered this remedy in prior settlements involving facial recognition, targeted advertising, and children's data, grounded in Section 5 of the FTC Act. There is no codified legal test for when a model itself must be destroyed rather than just the underlying dataset; outcomes have been negotiated on a case-by-case basis. Enterprises reduce exposure primarily through documented data provenance, consent verification, and model lineage tracking that can demonstrate a model was not built on unlawfully obtained data.

Algorithmic Disgorgement at a Glance

DimensionSummary
Remedy scopeDeletion of models and derived work product, not just source data
Legal basisSection 5 of the FTC Act (unfair or deceptive practices)
Trigger patternConsent decree violations or misrepresented data collection practices
Legal standardFact-specific settlement terms, no fixed bright-line test

What Algorithmic Disgorgement Is and Is Not

Algorithmic disgorgement is distinct from standard data disgorgement. Data disgorgement requires deletion of a dataset obtained in violation of law or a prior order. Algorithmic disgorgement goes further: it requires deletion of any model, algorithm, or other derived work product that was built using that data, even after the source dataset itself has been deleted. The FTC's rationale, as expressed in staff commentary, is that a company should not retain the economic value created by unlawfully collected data simply because the raw data has been removed. If a model trained on that data continues to operate, the underlying violation continues to generate benefit for the company.

This matters for AI governance because model weights, embeddings, and fine-tuned checkpoints can persist and continue delivering value long after a dataset has been purged. A governance program that only tracks dataset deletion, without tracking which models were trained on that data, has not addressed the actual exposure the FTC has targeted in past enforcement matters.

The Enforcement Record Behind the Remedy

The FTC has applied algorithmic disgorgement in a small number of settlements, each grounded in specific factual conduct rather than a general AI risk theory. In the Everalbum matter, the FTC required deletion of facial recognition models built from photos collected without proper user consent. In the WW International/Kurbo settlement, the FTC required disgorgement of algorithms derived from children's personal data collected without verifiable parental consent under COPPA. The Rite Aid settlement included deletion of algorithms tied to facial recognition technology found to produce discriminatory outcomes.

In each case, the trigger was not the use of AI itself but a violation tied to how the underlying data was collected, represented, or used relative to an existing consent decree or statutory obligation. The legal authority in these matters has consistently been Section 5 of the FTC Act, applied to unfair or deceptive practices, not a standalone AI-specific statute. No enforcement action identified in current research has ordered destruction of a large language model or generative AI system; the confirmed precedents involve facial recognition, targeted advertising, and health or child data algorithms. This distinction matters for governance leaders assessing how directly these precedents apply to generative AI deployments.

Why There Is No Fixed Legal Test

The FTC has not published a codified standard specifying when a model, rather than only the data behind it, must be destroyed. Every instance of algorithmic disgorgement to date has been a negotiated settlement term, shaped by the specific facts of the case, including whether the company violated an existing consent order, misrepresented its data collection practices, or processed sensitive categories of data such as biometric or children's information without consent.

This means algorithmic disgorgement risk cannot be assessed against a fixed checklist. It is a fact-dependent determination made during settlement negotiations, and the absence of a bright-line rule is itself a governance challenge. Enterprises cannot point to a statute and confirm compliance; they must instead be able to demonstrate, with documentation, that the factual predicates the FTC has relied on in past cases (unlawful collection, absent consent, consent decree violations) do not apply to their own training data and model lineage.

Runtime Auditability as a Governance Gap

Model lineage documentation addresses the training pipeline, but enforcement scrutiny does not necessarily stop at training. If a deployed AI agent produces outputs or takes actions based on a model whose training data provenance is disputed, the organization needs a way to trace which model version, training data snapshot, and consent basis underlie that specific agent's behavior at runtime, not just at the point the model was built.

This is where audit logging and runtime monitoring intersect with algorithmic disgorgement risk. A governance program that can only answer provenance questions about a model in the abstract, without connecting that model to the specific agents and tool calls operating in production, has a gap between its compliance documentation and its actual deployed footprint. Runtime governance platforms that log agent identity, model version, and permission scope at the point of execution give compliance and legal teams a concrete record to produce if an inquiry extends beyond the training pipeline to deployed systems. Trussed AI provides runtime governance and audit logging for AI agents, which supports this kind of traceability between model lineage and live agent behavior, though it does not substitute for the underlying data provenance and consent verification work that must happen upstream.

Technical Prerequisites for Demonstrating Lawful Model Lineage

Organizations reduce algorithmic disgorgement exposure by building the following controls into their data and model pipelines before an inquiry begins.

  1. 1

    Data provenance metadata

    Source, consent basis, collection date, and applicable regulatory basis captured as required fields at data ingestion, not reconstructed after the fact.

  2. 2

    Model version control

    Training runs and checkpoints versioned so that models trained partly or wholly on flagged data can be isolated and remediated without discarding unaffected model versions.

  3. 3

    Lineage mapping

    Training datasets mapped to their original collection consent and licensing terms, enabling selective removal of non-compliant sources where feasible.

  4. 4

    Rollback capability

    Retraining workflows designed to support rollback to a known-compliant checkpoint if a data source is later found improperly obtained.

  5. 5

    Third-party data verification

    Logging for licensed or vendor-supplied datasets used in fine-tuning, including verification of the licensor's own collection consent practices.

Governance Questions to Answer Before Regulatory Inquiry

These questions reflect the documentation the FTC has expected in prior settlements. Answering them in advance narrows the gap between compliance records and actual exposure.

  • Can we produce documentation showing the provenance and consent basis for data used to train current production models?
  • Can we isolate or retrain a model if a subset of its training data is later found non-compliant, without discarding the entire model?
  • Have we verified that third-party data providers had lawful consent for data used in training or fine-tuning?
  • Are we currently subject to, or in violation of, any existing FTC consent decree or order?
  • Do our records link specific model versions to specific training data snapshots and their consent status?
  • Have we reviewed vendor and data broker agreements for representations about data collection legality?

Frequently Asked Questions

Does algorithmic disgorgement apply automatically to any AI model trained on questionable data?

No. Every instance to date has been a negotiated settlement term tied to specific violations, such as consent decree breaches or unlawful collection of sensitive data, not a general rule applied to all AI models.

Has the FTC ordered destruction of a large language model?

Confirmed precedents involve facial recognition, targeted advertising, and children's or health data algorithms. No identified enforcement action has ordered destruction of a generative AI or large language model specifically.

What is the legal basis for algorithmic disgorgement?

The FTC has grounded these remedies in Section 5 of the FTC Act, addressing unfair or deceptive acts or practices, rather than a separate statute written specifically for AI or algorithms.

Can a company avoid full model destruction if only part of the training data is non-compliant?

This depends on the specific settlement and the organization's technical ability to isolate affected data and retrain. Version-controlled training pipelines that support selective remediation improve this possibility but are not a guaranteed outcome.

Connect Model Lineage to Runtime Accountability

Governance leaders need documentation that spans training data provenance through deployed agent behavior. Explore how runtime governance supports audit logging and traceability for AI agents in production.

Explore Runtime Governance