Home Live Demo Demo Brief Capabilities Pilot Architecture Implementation

CAIBots

CONFIDENTIAL · FOR AUTHORIZED PERSONNEL ONLY
SYNTHETIC DEMO DATA · NOT LEGAL OR CREDIT ADVICE

Pilot Documentation · Credit Underwriting AI

90-Day Pilot
Structure

Credit Underwriting Agentic AI · V1.1

Pilot Duration90 Days (3 Phases · 30 Days Each) Loan ScopePhase 1: Consumer/HELOC · Phase 2: SBA + CRE · Phase 3: Full Suite Success Gate≥85% Agent Accuracy · ≤5% Exception Rate · SR 11-7 Sign-Off Go-Live CriteriaSR 11-7 Validation Complete · Fair Lending Review Clear · LOS Bi-Directional Confirmed VersionV1.1 · March 2026

Pilot Overview

A Structured Path from Demo to Production

Three 30-day phases with clear entry/exit criteria, success metrics, and governance gates at each milestone.

Total Pilot
Duration (Days)

Structured
Phases

Loan Types
Activated

Pilot Design Principle

The pilot is designed as a shadow-mode parallel run during Phase 1 — the agent pipeline processes live applications alongside existing manual workflows but does not replace them. Decision authority shifts to the AI-assisted Credit Officer Workbench only after SR 11-7 validation sign-off at end of Phase 2.

Pilot Engagement Model

CAIBots assigns a dedicated Customer Success Engineer and Compliance Integration Specialist for the full pilot duration. Weekly steering committee check-ins with institution credit leadership. Full documentation package provided at each phase gate.

Prerequisite Checklist

✓

LOSLOS API credentials and sandbox access provisioned to CAIBots integration layer

✓

BureauMCO permissible purpose agreement executed · Test credentialed access confirmed

✓

PolicyCredit policy matrix (Excel/PDF) provided for agent configuration upload

✓

LegalBAA executed · Data Processing Agreement signed · Information Security questionnaire complete

✓

ComplianceFair Lending officer briefed · Model Risk Management notified of SR 11-7 project

✓

TeamPilot team roles assigned (see Section 4) · Calendar holds placed for weekly check-ins

Phase Timeline

Three 30-Day Sprint Phases

Each phase has defined scope, deliverables, and exit criteria before advancement.

Phase 1

Days
1–30

Foundation & Shadow Mode

Integration, Configuration & Shadow Run

LOS integration, data source connectivity, policy matrix upload, and parallel shadow-mode processing of Consumer/HELOC applications. Zero impact to existing decisioning workflow. CAIBots outputs logged for comparison.

LOS bi-directional API integration and field mapping validation

MCO bureau, CoreLogic AVM, and Credit Policy Engine connectivity verified

Agent pipeline configured for Consumer/HELOC loan type

Shadow-mode run on 100 live applications — outputs compared to manual decisions

HITL threshold calibration workshop with credit leadership

Phase 1 accuracy report: target ≥85% decision alignment

Phase 2

Days
31–60

Expanded Scope & Validation

SBA 7(a) + CRE&I Expansion & SR 11-7 Validation

Expand pipeline to SBA 7(a) and CRE&I loan types. Run parallel with manual workflow. Model Risk Management conducts SR 11-7 validation review. Fair Lending officer completes ECOA/HMDA compliance review.

GSFA/EDGAR financial spreading agent activated for commercial loans

SBA SBSS and D&B Paydex bureau integrations tested on live SBA pipeline

CoStar CRE valuation agent validated against 25 in-process CRE appraisals

SR 11-7 model validation package delivered to Model Risk Management

Fair Lending parallel test: 200 applications reviewed for disparate treatment signal

Credit Officer Workbench UAT with 5 credit officers — feedback incorporated

Phase 2 gate: SR 11-7 validation sign-off required to advance to Phase 3

Phase 3

Days
61–90

Full Suite & Go-Live Prep

Full Loan Suite Activation & Production Readiness

Activate Construction, ABL, DSCR Alert, and Maturity Renewal loan types. Credit Officer Workbench moves to primary workflow for validated loan types. Prepare production cutover, training, and ongoing governance framework.

Construction draw analysis and ABL borrowing base agent configurations activated

DSCR Alert portfolio monitoring engine connected to existing portfolio system

Maturity renewal pipeline configured and tested on upcoming renewal queue

Full credit staff training sessions (2 hours per cohort · 4 cohorts planned)

Production cutover plan reviewed and approved by Credit and IT leadership

Ongoing model monitoring framework established — KPI dashboard live

Go-live authorization obtained from CRO and Chief Compliance Officer

Success Criteria

Pilot Success Metrics & Go-Live Gates

Quantified success thresholds required for production authorization at each phase gate.

Phase 1 Exit Criteria (Day 30)

≥85%

Decision Alignment
vs Manual

Consumer/HELOC · Shadow run

≤5%

Policy Exception
Rate

Below institution baseline

100%

ECOA Screen
Coverage

Zero unscreened decisions

Phase 2 Exit Criteria (Day 60)

SR 11-7

Model Validation
Sign-Off

MRM approval required

≥90%

Financial Spread
Accuracy

vs CPA/manual benchmark

4.5/5

Credit Officer
UAT Score

Workbench usability rating

Production Go-Live Gate (Day 90)

Go-Live Authorization Checklist

All of the following must be confirmed before production authorization: (1) SR 11-7 Model Validation complete and signed by Model Risk Management Officer; (2) Fair Lending review complete — no disparate treatment signal in parallel test sample; (3) LOS bi-directional integration verified in production environment; (4) Credit staff training completion ≥90% of eligible users; (5) CRO and Chief Compliance Officer sign-off; (6) Incident response and escalation runbook approved by IT Security.

Team Structure

Pilot Team Roles & Responsibilities

Required institution roles and corresponding CAIBots counterparts for the 90-day pilot.

Institution · Sponsor

Chief Risk Officer / CRO

Executive sponsor. Approves pilot scope, phase gates, and production go-live. Reviews SR 11-7 validation results and Fair Lending findings. Final authorization signatory.

Institution · Operations

VP Credit / Chief Credit Officer

Operational owner. Defines HITL thresholds. Reviews shadow-mode accuracy reports. Participates in weekly steering. Approves Credit Officer Workbench design.

Institution · Compliance

Fair Lending Officer / CCO

ECOA/HMDA/CRA compliance review. Reviews fair lending parallel test results. Signs off on Reg B adverse action notice template. Completes Phase 2 compliance gate.

Institution · Risk

Model Risk Management Officer

Leads SR 11-7 model validation. Reviews agent documentation package. Completes validation testing protocol. Issues Phase 2 MRM sign-off for production authorization.

Institution · Technology

IT / LOS Integration Lead

Owns LOS API integration. Provisions credentials for bureau and collateral sources. Manages data security review. Validates production environment pre-cutover.

CAIBots · Engagement

Customer Success Engineer + Compliance Integration Specialist

Dedicated team for full pilot. Owns technical integration, policy configuration, SR 11-7 package preparation, training delivery, and weekly steering facilitation.