Why Generic AI Ethics Principles Are Insufficient
Most published AI governance guidance for financial services describes principles: fairness, transparency, accountability. These principles do not, by themselves, prevent an AI agent from querying a credit bureau data source it was not authorized to access, or from issuing a collections action without a documented basis. In insurance premium finance and lending, governance has to operate at the point where an AI agent reads data, generates a score, or triggers an action, not only in a policy document reviewed annually.
Regulators have been explicit that using AI or machine learning does not change the underlying legal obligations. The CFPB's Circular 2023-03 states that creditors relying on complex or black-box algorithms in credit decisions must still provide specific and accurate reasons for adverse action under the Equal Credit Opportunity Act and Regulation B. The FTC has separately stated that use of AI does not exempt a business from existing consumer protection law. Governance frameworks that stop at model documentation, without runtime enforcement of data access and decision traceability, do not satisfy these obligations in practice.
Where AI Introduces the Greatest Governance Risk
Risk concentrates in the stages where agents touch sensitive data or affect consumer outcomes. The table below summarizes exposure by function.
Applicable Regulatory Obligations
Several overlapping obligations apply to AI-driven decisioning in premium finance and lending, and their applicability does not depend on whether a human or an AI system made the decision. ECOA and Regulation B prohibit discrimination in credit transactions based on protected characteristics regardless of underwriting methodology, and liability for a discriminatory outcome remains with the lender.
The NAIC adopted a Model Bulletin on the Use of Artificial Intelligence Systems by Insurers in December 2023, directing insurers to maintain AI governance programs, including risk management frameworks and AI system inventories, and extending governance expectations to third-party AI vendors and data providers rather than only internally built systems. Colorado has gone further, enacting a framework under SB21-169 requiring insurers to test predictive models and external consumer data for unfair discriminatory outcomes against protected classes, initially applied to life insurance underwriting. Other states have not adopted comparable requirements, and the NAIC Model Bulletin functions as guidance rather than binding law in most jurisdictions, so requirements vary significantly by state.
NIST's AI Risk Management Framework, organized around Govern, Map, Measure, and Manage functions, is a voluntary reference many organizations use to structure AI governance roles and accountability. The EU AI Act classifies credit-scoring AI as high-risk, with logging and human oversight requirements, but this applies to US-domiciled lenders only where an EU market or data nexus exists, and should not be assumed as a blanket requirement.
Human review: Human-in-the-loop review is a recommended control for adverse credit decisions and escalated collections actions, supporting both explainability obligations and oversight of automated outcomes affecting borrowers.