Enterprise Agentic AI —
Architecture, Retrieval
& Compliance Reference
The complete technical knowledge base for CAIBots' agentic AI platform — from RAG pipeline internals and agent data-source mix, to provider stack decisions and EU AI Act risk classification. Every section is analytically linked: architecture choices determine retrieval design, which determines compliance tier.
Where Does the RAG Pipeline & Memory Sit Inside the Agent?
RAG = one of five peer tools at Source Selection · Memory = personalization + continuity + audit
FS · Capital Markets
CAIBots © 2025
- HTTP client + auth
- Request / response cycle
- JSON parsing
- Live systems data
- DB connection pool
- Query builder
- Result set formatting
- Data tables / DB
- Graph DB connect
- Entity resolution
- Path traversal
- Relationship links
A Trading Desk Copilot runs 65% API / 8% RAG. An Investment Research Assistant runs 45% RAG / 15% API. The mix determines infrastructure cost, latency, and data residency requirements. The agent architecture table below maps the exact breakdown for all 10 agents, with model selection and HITL requirements.
Explore Agent Data-Source Mix → Module 02 ↓Expanded Data Source & Reasoning Mix Across 10 FS Agents
API · RAG · Knowledge Graph · Fine-Tuning · Memory · LLM Reasoning · Human-in-the-Loop. % allocations = relative data source dependency per agent (sum = 100% input mix).
FS Capital Markets
CAIBots © 2025
| AGENT TYPE | Structured Input | Unstructured / Knowledge | LLM | Governance | What the Agent Actually Does | |||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| API Live Sys |
SQL Structured |
RAG Docs |
KG Graph |
Fine- Tune |
Mem Personal. |
LLM Reason. |
Model Type | HITL Required | Data Sources Used | KG + FT + Memory Focus | Agent Action Summary | |
💛 Customer Service Agent |
35% |
5% |
30% |
5% |
10% |
15% |
25% |
Azure OAI | Escalation Only | Account info, transaction history · FAQs, support manuals, complaint scripts | Product → entitlement graph · Support tone & complaint handling · Sentiment trend | Retrieves account data via API, pulls policy docs via RAG, generates conversational response with personalized history |
🔍 Fraud Detection Agent |
55% |
15% |
10% |
12% |
5% |
3% |
20% |
Open-Weight | Mandatory (SAR) | Transaction streams, card alerts, device fingerprints, velocity checks · Fraud typology playbooks | Fraud ring networks, mule account graphs · Pattern recognition · Customer risk profile | Analyzes real-time transactions via API, traverses fraud graph, explains suspicious activity, drafts SAR narrative |
📋 Insurance Claims Processing Agent |
40% |
15% |
25% |
8% |
7% |
5% |
20% |
Azure OAI | Mandatory (high-value) | Claims database, reserve calculations · Policy documents, coverage schedules, exclusion clauses | Claim → policy → coverage relationships · Adjudication rules · Prior settlements | Accesses claims systems, retrieves policy terms via RAG, interprets narrative, flags coverage gaps |
🛡️ KYC / AML Compliance Agent |
35% |
15% |
25% |
15% |
5% |
5% |
20% |
Open-Weight | Mandatory (onboarding) | Identity records, sanctions DBs, PEP lists · FATF / FinCEN regulatory guidance | UBO ownership chains, entity networks · Compliance rules, jurisdiction thresholds | Retrieves identity data, traverses ownership graph, references regulatory docs, summarizes compliance risk for human sign-off |
📊 Wealth Mgmt Advisor Copilot |
25% |
10% |
35% |
8% |
7% |
15% |
25% |
Azure OAI | Mandatory (suitability) | Portfolio holdings, account balances · Research reports, fund factsheets, ESG ratings | Asset correlations, sector exposure maps · Suitability rules · Goals, risk appetite, life events | Retrieves portfolio data, pulls research insights, checks suitability rules, generates investment summary with citations |
🏛️ Credit Underwriting Agent |
45% |
20% |
20% |
5% |
5% |
5% |
15% |
Fine-tuned OW | Mandatory (credit decision) | Credit bureau scores, financial statements · Underwriting policies, credit appetite statements | Borrower risk relationships, sector concentration · Policy-grounded reasoning | Pulls financial data via APIs, retrieves underwriting rules, drafts credit memo, flags policy exceptions for underwriter |
📈 Regulatory Reporting Agent |
40% |
20% |
25% |
5% |
5% |
5% |
15% |
Azure OAI | Mandatory (CFO sign-off) | Financial ledgers, GL data, trade repos · BCBS / IFRS / CCAR reporting templates | Regulatory mapping relationships, line-item hierarchies · Disclosure language norms | Low autonomy — mostly templated; LLM handles narrative sections only. Generates disclosure narratives |
🔬 Investment Research Assistant |
15% |
5% |
45% |
10% |
10% |
15% |
25% |
Azure OAI | Optional (analyst review) | Market data feeds, earnings APIs, consensus estimates · SEC filings, research reports, transcripts | Company → sector → macro graph · Sector valuation norms · Analyst workflow preferences | Retrieves filings via RAG, cross-references sector graph, synthesizes investment thesis with analyst context |
⚠️ Risk Management Agent |
50% |
20% |
15% |
8% |
4% |
3% |
15% |
Open-Weight | Mandatory (limit breach) | Exposure metrics, VaR outputs, limit utilization · Risk policies, stress test frameworks | Counterparty contagion graph, risk dependency chains · Scenario calibration | Pulls risk metrics via APIs, traverses counterparty graph, references policy docs, drafts risk narrative for CRO |
📉 Trading Desk Copilot |
65% |
10% |
8% |
7% |
5% |
5% |
15% |
Azure OAI | Mandatory (execution) | Market feeds, live positions, order books, P&L streams · Market commentary, research notes, macro reports | Market correlation graph · Trading strategies, execution heuristics · Trader mandates, desk preferences | Streams market data via APIs, summarizes signals, pulls commentary via RAG — execution stays with trader |
The Investment Research Assistant at 45% RAG and the Wealth Advisor at 35% RAG both need a production-grade vector retrieval stack. Do you self-host for data sovereignty, or use a managed cloud service? The provider breakdown below maps every layer — chunking, embedding, vector store, and LLM — with FS-specific guidance on each choice.
Explore RAG Provider Stack → Module 03 ↓What Is RAG, Who Provides It & What Does Each Layer Do?
From concept to managed service — open-source vs commercial options across every component. Your stack decision directly determines data residency, latency, and compliance posture.
FS · Capital Markets
CAIBots © 2025
Whether your Wealth Advisor auto-executes vs. human-decides is not just a UX choice. It's the difference between HIGH RISK and LIMITED RISK under Annex III. Four of the ten agents above are HIGH Risk by default. The EU AI Act classification below maps every agent and shows exactly how HITL design can downgrade your risk tier before August 2026 enforcement.
View EU AI Act Classification → Module 04 ↓EU AI Act — Risk Tiers, FS Agent Classification & Implications
Not all Financial Services AI Agents are High Risk — classification depends on decision impact, not industry. The HITL architecture column in your agent design is your primary EU AI Act compliance lever.
FS · Capital Markets
CAIBots © 2025
SR 11-7 is already in force for every AI model your firm runs. GDPR Art 22 covers automated decisions on individuals — affecting Credit Underwriting, Fraud, and KYC right now. SEC/FINRA guidance hits Wealth Mgmt and Trading Desk. DORA makes Azure, AWS, and OpenAI designated Critical Third Parties subject to BoE/ECB oversight — impacting every agent using a managed RAG stack. The matrix below shows exactly which regulation hits which of your 10 agents, and at what severity.
View Full Regulatory Stack → Module 05 ↓AI, Data & Model Risk — All 5 Regulatory Frameworks
SR 11-7 · EU AI Act · GDPR Art 22 · SEC AI / FINRA · DORA — mapped to every agent with impact severity. Your compliance architecture must satisfy all five simultaneously, not one at a time.
FS · Capital Markets
CAIBots © 2025
- HITL workflow built into every HIGH Risk agent
- Conformity assessment documentation package
- Immutable decision audit trail
- Explainability layer on model outputs
- EU AI Act database registration support
- Model inventory registration for all agents
- Independent validation documentation
- Challenger model framework for critical agents
- Ongoing performance monitoring dashboards
- Model risk narrative for OCC/Fed examination
- Human review pathway on all individual decisions
- Explanation generation at point of decision
- Contestation workflow for declined decisions
- Data subject rights logging and audit trail
- DPIA documentation for automated processing
- Reg BI best-interest controls for Wealth Advisor
- Algo trading disclosure documentation
- Conflicts of interest detection and logging
- Research fairness and distribution controls
- FINRA supervisory procedures for AI systems
- CTP dependency mapping for all cloud AI vendors
- Concentration risk assessment (Azure/AWS/GCP)
- Exit plan and fallback architecture documentation
- ICT resilience testing schedule per DORA Annex
- BoE/ECB oversight readiness package
Build your enterprise AI agent workforce
on the CAIBots platform.
From RAG pipeline architecture to a 5-framework regulatory compliance stack — CAIBots engineers your agentic platform end-to-end. Live in 14–30 days, SR 11-7 compliant and EU AI Act HITL-ready from day one.
See the Architecture In Production
Seven production-ready agentic AI blueprints for regulated financial institutions — from Credit Underwriting and Investment Research to KYC/AML, Regulatory Reporting, Wealth Management, Insurance Claims, and Fraud Detection.