Comparison

    Hard vs Soft AI Spend Limits: Which Should You Enforce?

    Soft limits notify people and rely on a human response after the threshold is crossed. Hard limits act at the threshold by blocking or throttling. Most platform teams should use neither alone. A tiered model that alerts first, then rate limits, then escalates for human approval, and blocks only at a defined ceiling, scoped to the workload, lets you protect critical work while keeping overruns from continuing unchecked.

    A tiered enforcement pattern

    1. 1

      1. Alert

      At the first threshold, notify the named owner of the scope. Traffic is unchanged. This tier is advisory by design.

    2. 2

      2. Rate limit

      At the next threshold, slow requests within the affected scope. Work continues, but runaway consumption is constrained.

    3. 3

      3. Escalate for approval

      Near the ceiling, hold the action and route it to a pre-assigned human authority who can approve, deny or adjust the limit.

    4. 4

      4. Block

      At the ceiling, stop the action for that scope, with scoped and time-bound exceptions for workloads that cannot be interrupted.

    5. 5

      5. Record

      At every tier, write down what was decided, for which scope, under which policy and at what time.

    What an auditor expects to see

    • The policy in force, with its thresholds, scope and the version that applied at the time
    • Each decision to permit, throttle, escalate or block, with timestamp and the scope affected
    • For escalations, the named authority, the decision taken and when it was taken
    • Exceptions granted, who granted them, their scope and when they expired
    • The usage figure that triggered the action and how current it was when evaluated
    • Retention that matches your records requirements, stored where residency rules require

    What hard, soft and hybrid limits actually mean

    A soft limit is an advisory threshold. When usage or spend crosses it, the system sends an alert, a warning or a notification, and the traffic keeps flowing. Its effect depends entirely on someone noticing the message and acting on it. A hard limit is an enforced threshold. When usage crosses it, the system blocks or throttles the request, regardless of whether anyone is watching.

    A hybrid, or tiered, approach combines the two. Advisory thresholds sit below enforced ones, and the actions escalate as usage approaches a ceiling. The useful question is not which type is better in the abstract. It is which action should happen at each threshold, for which scope, and who is accountable for the outcome.

    Framing this as a runtime policy question rather than a reporting question changes the design. A report tells you what happened. A policy decision made in the request path determines what is allowed to happen next.

    Soft limits and hard limits across six criteria

    The differences are easiest to see when each criterion is held constant. Tiered models take a different position on each row depending on the tier.

    • Enforcement timing: Soft: after the threshold is crossed, once a person responds. Hard: at the moment the threshold is crossed, in the request path.
    • Blast radius: Soft: overruns can continue until someone intervenes. Hard: an unscoped block can interrupt every workload sharing the limit.
    • Workload criticality: Soft: safe for critical work but offers no protection. Hard: protects against runaway usage but can stop business-critical processes if criticality is ignored.
    • Exception handling: Soft: informal, usually through a message or a ticket. Hard: needs defined, scoped and time-bound exceptions or it creates outages.
    • Human escalation: Soft: assumes a person is reachable and attentive. Hard: needs an explicit path to a named authority when a block is wrong.
    • Evidence generated: Soft: a record that a notification was sent. Hard: a record of each decision to permit, throttle or stop, with the policy that applied.

    Choosing a model by criticality, scope and failure tolerance

    Start with failure tolerance. Ask which failure is worse for a given workload: continued unchecked usage, or an interrupted process. An experimental coding assistant used by a small team can tolerate a hard stop, and an uncapped overrun there has little operational justification. A customer-facing or regulated process often cannot tolerate an abrupt block, so it should be protected by earlier tiers and a human escalation step before any stop.

    Then define scope. A limit can apply to an organization, a team, a user, an application, an agent or an individual tool call. Broad scopes are simple to administer but have the largest blast radius, because one team's runaway agent can exhaust a limit that other teams depend on. Narrow scopes contain the impact, but they depend on accurate attribution, meaning each request must be reliably tied to the right user, agent or application. Where attribution is weak, a hard limit at a narrow scope will act on the wrong party.

    Finally, consider metering freshness. A hard limit is only as precise as the usage data behind it. If usage is aggregated with a delay, enforcement will lag the true figure, so teams often set the enforced ceiling with headroom below the point they cannot tolerate. This is a design consideration to verify in your own environment, not an assumption to carry over from another platform.

    Enforcement in the execution path

    Soft limits can live in a billing or reporting layer. Hard and tiered limits cannot. They must sit where requests and tool calls pass, so that a decision is made before the action completes. In practice that means an enforcement point in the execution path that evaluates each interaction or tool call and returns one of a small set of outcomes: allow, block, rate limit or escalate for human approval.

    NIST guidance on agent identity, published in a blog in October 2026, supports several design principles that apply here by analogy. It says organizations define risk thresholds and tolerances that, when reached, initiate human review of agentic actions, and that these are supported by technology able to trigger escalation to the correct authority. It also calls for least privilege to limit the scope of agentic actions, architectural separation of policy from reasoning, and deterministic access decisions. That material concerns risk thresholds rather than spend. Still, the engineering implication carries over: the policy check should sit outside the model or agent, should not depend on model output, and should produce the same decision for the same inputs.

    Trussed enforces policy in the execution path across models, agents, tools, MCP servers, AI sites and coding assistants, at the level of individual interactions and tool calls. Its actions are allow, redact, block, rate limit and escalate for human approval, so the tiers above map onto enforcement outcomes that are enforced at runtime, not reviewed after the fact.

    Tiered enforcement at a usage threshold

    Alert

    Notify the owner. No change to the request.

    Rate limit

    Slow traffic within the defined scope.

    Escalate

    Hold the action for approval by a named authority.

    Block

    Stop the action at the ceiling and record the decision.

    See how enforcement decisions become evidence

    Trussed enforces policy in the execution path and produces audit-ready evidence of what was allowed, rate limited, escalated or blocked, for the regulated enterprise.

    See How Evidence Is Produced