Session

HP's Data Platform Migration Journey: Redshift to Lakehouse

Overview

ExperienceIn Person
TypeBreakout
TrackData Warehousing
IndustryManufacturing
TechnologiesDelta Lake, Databricks SQL, Unity Catalog
Skill LevelIntermediate
Duration40 min

HP Print's data platform team took on a migration from a monolithic, shared resource of AWS Redshift, to a modular and scalable data ecosystem on Databricks lakehouse.​

 

The result was 30–40% cost savings, scalable and isolated resources for different data consumers and ETL workloads, and performance optimization for a variety of query types.​

 

Through this migration, there were technical challenges and learnings relating to the ETL migrations with DBT, new Databricks features like Liquid Clustering, predictive optimization, Photon, SQL serverless warehouses, managing multiple teams on Unity Catalog, and others.​

 

This presentation dives into both the business and technical sides of this migration. Come along as we share our key takeaways from this journey.​

Session Speakers

IMAGE COMING SOON

Isaac Chan

/Data Engineer
HP Inc.

IMAGE COMING SOON

Kavya Atmakuri

/Data Engineer
HP Inc.