Session

Unity Catalog Implementation & Evolution at Edward Jones

Overview

ExperienceIn Person
TypeLightning Talk
TrackData and AI Governance
IndustryFinancial Services
TechnologiesDelta Lake, Unity Catalog
Skill LevelIntermediate
Duration20 min

This presentation outlines the evolution of Databricks and its integration with cloud analytics at Edward Jones. It focuses on the transition from Cloud V1.x to Cloud V2.0, which highlights the challenges faced with initial setup, Unity Catalog implementation and the improvements planned for the future particularly in terms of Data Cataloging, Architecture and Disaster Recovery.

Highlights:

  • Cloud Analytics Journey
  • Current Setup (Cloud V1.x)
    • Utilizes Medallion architecture customized to Edward Jones need.
    • Challenges & limitations identified with integration, limited catalogs, Disaster Recovery etc.
  • Cloud V2.0 Enhancements
    • Modifications in storage and compute in Medallion layers
    • Next level integration with enterprise suites
    • Disaster Recovery readiness
    • Future outlook

Session Speakers

Dattatri Rao

/Technical Architect
Edward Jones