BFSI· Custom AI agents

Mutual fund query chatbot

Real-time

streaming

WS

protocol

Full

audit log

System Architecture

Web UI
WebSocket
FastAPI Server
LLM w/ Qdrant DB
Live Financial API Validation

Engineering Deep Dive

Real-time Streaming

Built a custom WebSocket architecture over FastAPI to stream tokens directly to the client interface, delivering sub-second time-to-first-token (TTFT).

Zero-Hallucination Guardrails

Before any numerical data (NAV, returns) is streamed to the user, the agent intercepts the payload, validates it against live financial APIs, and aborts if a discrepancy is found.

Audit Logging

Implemented an asynchronous background task to securely log every interaction pair to a compliant datastore to meet SEBI guidelines for financial advisory interactions.

Business Impact

Provided thousands of investors with instant, accurate portfolio insights 24/7 without risking regulatory violations due to AI hallucinations.

Technologies Used

FastAPI
WebSockets
OpenAI
QdrantDB
Calendly API

Want results like these for your business?

30 minutes. Free. I'll tell you upfront if it's not a fit.