Session
Unity Catalog Implementation & Evolution at Edward Jones
Overview
| Experience | In Person |
|---|---|
| Type | Lightning Talk |
| Track | Data and AI Governance |
| Industry | Financial Services |
| Technologies | Delta Lake, Unity Catalog |
| Skill Level | Intermediate |
| Duration | 20 min |
This presentation outlines the evolution of Databricks and its integration with cloud analytics at Edward Jones. It focuses on the transition from Cloud V1.x to Cloud V2.0, which highlights the challenges faced with initial setup, Unity Catalog implementation and the improvements planned for the future particularly in terms of Data Cataloging, Architecture and Disaster Recovery.
Highlights:
- Cloud Analytics Journey
- Current Setup (Cloud V1.x)
- Utilizes Medallion architecture customized to Edward Jones need.
- Challenges & limitations identified with integration, limited catalogs, Disaster Recovery etc.
- Cloud V2.0 Enhancements
- Modifications in storage and compute in Medallion layers
- Next level integration with enterprise suites
- Disaster Recovery readiness
- Future outlook
Session Speakers
Dattatri Rao
/Technical Architect
Edward Jones