Session
Building Trustworthy AI at Northwestern Mutual: Guardrail Technologies and Strategies
Overview
Experience | In Person |
---|---|
Type | Lightning Talk |
Track | Data and AI Governance |
Industry | Enterprise Technology, Retail and CPG - Food, Financial Services |
Technologies | MLFlow, Llama, Unity Catalog |
Skill Level | Intermediate |
Duration | 20 min |
This intermediate-level presentation will explore the various methods we've leveraged within Databricks to deliver and evaluate guardrail models for AI safety. From prompt engineering with custom built frameworks to hosting models served from the market place and beyond. We've utilized GPU within clusters to fine-tune and run large open sourced models at inference such as Llama Guard 3.1 and generate synthetic datasets based on questions we've received from production.
Session Speakers
Nicholas Brathwaite
/Data Science
Northwestern Mutual