How to Verify an AI Control Plane Vendor Never Receives Bank Customer Data
To verify that an AI vendor never receives customer data, define the claim in technical terms, then test it. Confirm the deployment runs in your own cloud, restrict and inspect every outbound path, review telemetry and metadata field by field, check that redaction happens in the execution path before data crosses a boundary, test support and update channels, and set retention and residency yourself. Keep the test results and configuration records as durable evidence for third-party risk, model risk management and examiners.
A six-step verification process
- 1
1. Confirm the deployment model
Verify the software runs in your cloud account, under your identity and access management, with no vendor-operated service in the data path. Ask whether the product calls other services, including fourth-party models, and what data could reach them.
- 2
2. Test network egress
Apply a default-deny outbound policy and allow-list only the destinations you approve. Review DNS and proxy logs, and use packet capture at the boundary while running marker data through the system. Any unexpected destination is a finding.
- 3
3. Review telemetry and metadata
Obtain the full list of fields the software can emit, including license checks, health pings and error reports. Inspect actual payloads. Disable or route anything that carries identifiers, free text or prompt content.
- 4
4. Test redaction in the execution path
Send marker NPI and account numbers through each path, including agent and tool calls. Confirm sensitive values are redacted or blocked before they leave a boundary, and that the enforcement decision is recorded.
- 5
5. Test support and update channels
Confirm how vendor staff gain access, whether access is off by default, time-bound and approved by you, and whether updates are pulled by you from a reviewed artifact rather than pushed. Record administrative access.
- 6
6. Set and check retention and residency
Verify where evidence and any stored content are held, in which region, and for how long. Confirm you can change both and that deletion works. Check backups and replicas.
Evidence to retain
- Written contract terms and vendor commitments on data use, retention, telemetry and training
- Architecture and configuration attestations showing deployment location, identity controls and the outbound allow-list
- Egress test results: DNS and proxy logs, packet capture summaries and marker-search outcomes
- Enforcement decision records showing each allow, redact or block action with the policy applied
- Redaction records and telemetry field inventories, including what was disabled
- Support access logs, update records, and retention and residency settings with change history
Define the claim before you test it
"The vendor never receives customer data" is too loose to test. Write it as a set of statements that a network engineer and an examiner would both read the same way.
Start with the data. Name the categories in scope: nonpublic personal information, account data, other personally identifiable information, and anything derived from them, such as embeddings, summaries or prompt fragments. Then name the boundary. In most cases it is your cloud account or virtual network, and the claim is that none of these categories, in any form, cross it toward the vendor or any service the vendor operates or calls.
Then cover every channel, not just prompts and responses. Customer data can travel in telemetry, error reports, crash dumps, license checks, update requests, support sessions and metadata fields such as user identifiers or free-text tags. A claim that covers only "model traffic" leaves most of these open.
Finally, write the claim into the contract. Third-party risk due diligence for community banks includes asking whether the contract specifies limits on the third party's use and retention of data, including customer data. The FTC has also said that companies must abide by their privacy commitments to customers however and wherever those commitments were made, including terms of service and promotional material. A written commitment gives you something to hold the vendor to. It does not replace testing.
Deployment model decides what you can verify yourself
The architecture determines whether verification is an inspection you perform or a report you receive. Where a vendor can supply only outputs or limited monitoring data, the bank's independent visibility is limited, and that gap has been recognized in discussions of vendor model risk. Self-managed deployment in your own cloud makes the claim testable because the traffic, the configuration and the logs sit in an environment you control.
- Traffic inspection: Self-managed: you can capture and inspect traffic in your own network. Vendor-hosted: customer data reaches the vendor by design, so you rely on its controls and reports.
- Egress control: Self-managed: you set the allow-list and block everything else. Vendor-hosted: the destination is the vendor, so egress control cannot show separation.
- Evidence custody: Self-managed: enforcement records are written to storage you own. Vendor-hosted: evidence is typically produced and held by the vendor.
- Retention and residency: Self-managed: you set region and retention in your own accounts. Vendor-hosted: you depend on the vendor's settings and attestations.
- Fourth parties: Self-managed: outbound calls from the software are visible and blockable. Vendor-hosted: downstream services are largely opaque to you.
Why redaction position matters
Egress controls show that nothing unexpected leaves. Redaction shows that what is permitted to leave contains no customer data. The two answer different questions, and the second only holds if the control sits where the data moves.
A review that happens after the fact, such as sampling logs weeks later, can find a leak but cannot stop one. Policy enforced in the execution path acts on each interaction or tool call before it completes: allow it, redact specific values, or block it. That makes the boundary a property of the running system rather than a periodic finding.
Encryption is a related but separate point. Encrypting customer information in transit over external networks is a named safeguard in the FTC Safeguards Rule, 16 CFR 314.3, along with access limited to authorized users and a risk assessment, where the rule applies to your institution. Encrypted traffic to a vendor is still traffic to a vendor. Encryption protects data in transit; only egress and redaction evidence shows that the data never went.
Examiner, third-party risk and model risk framing
Three review audiences will ask for related but different things, and one body of evidence can serve all of them.
Third-party risk teams work from the interagency third-party risk management guidance issued in June 2023, which, as of November 2026, is the reference point for questions on contract limits on a third party's use and retention of customer data. Your test results and contract language answer that directly.
Model risk teams apply due diligence, validation, ongoing monitoring and contingency planning to vendor models much as they do to in-house models. Where a vendor offers limited monitoring data or little visibility into its own components, record that as a model risk issue rather than an accepted gap.
Examiners and internal audit want proof that is current, not a snapshot. NIST's draft SP 800-239 argues that point-in-time auditing is insufficient for AI and calls for automated, real-time logging at every data touchpoint, with the ability to report on data residency, processing logs and administrative access. Because it is a draft, treat it as direction rather than a requirement. It still supports a practical rule: schedule the tests, and retain continuous records alongside them.
Where runtime enforcement fits
Trussed is the control, provenance and evidence infrastructure for consequential AI, built for regulated enterprises that must show what their AI was allowed to do and what it did. It supports self-managed deployment in the customer cloud, enforces policy in the execution path with allow, redact and block decisions, offers configurable retention and data residency, and produces audit-ready evidence from enforcement, mapped to frameworks including NYDFS and NIST. These map to the deployment, redaction, retention and evidence steps above.
Trussed has operated for more than 18 months in continuous production in a regulated enterprise, and insurance, a regulated financial sector, is where it is deepest. The same tests apply to it as to any vendor. Run them, keep the results, and let the evidence settle the question.
Six areas to test and evidence
Deployment model
Where the software runs and who operates it.
Network egress
Which outbound destinations are permitted and observed.
Telemetry and metadata
What leaves the environment besides prompts and responses.
In-path redaction
Whether sensitive data is removed before it crosses a boundary.
Support and updates
How vendor staff and software changes reach your environment.
Retention and residency
Where evidence lives and who controls how long it stays.
Turn the verification plan into evidence
Talk through your deployment model, egress controls and evidence requirements with a Trussed expert.
Talk to an ExpertHow does your AI governance program compare?
See where your program has gaps in less than 2 minutes.