Session

Responsible AI at Scale: Balancing Democratization and Regulation in the Financial Sector

Overview

ExperienceIn Person
TypeBreakout
TrackArtificial Intelligence
IndustryFinancial Services
TechnologiesMLFlow, Mosaic AI, Unity Catalog
Skill LevelAdvanced
Duration40 min
We partnered with Databricks to pioneer a new standard in financial sector's enterprise AI, balancing rapid AI democratization with strict regulatory and security requirements. At the core is our Responsible AI Gateway, enforcing jailbreak prevention and compliance on every LLM query. Real-time observability, powered by Databricks, calculates risk and accuracy metrics, detecting issues before escalation. Leveraging Databricks' model hosting ensures scalable LLM access, fortifying security and efficiency. We built frameworks to democratize AI without compromising guardrails. Operating in a regulated environment, we showcase how Databricks enables democratization and responsible AI at scale, offering best practices for financial organizations to harness AI safely and efficiently.

Session Speakers

IMAGE COMING SOON

Aman Thind

/Executive Vice President and Chief Architect for State Street
State Street