HP's Data Platform Migration Journey: Redshift to Lakehouse
Overview
| Experience | In Person |
|---|---|
| Type | Breakout |
| Track | Data Warehousing |
| Industry | Manufacturing |
| Technologies | Delta Lake, Databricks SQL, Unity Catalog |
| Skill Level | Intermediate |
| Duration | 40 min |
HP Print's data platform team took on a migration from a monolithic, shared resource of AWS Redshift, to a modular and scalable data ecosystem on Databricks lakehouse.
The result was 30–40% cost savings, scalable and isolated resources for different data consumers and ETL workloads, and performance optimization for a variety of query types.
Through this migration, there were technical challenges and learnings relating to the ETL migrations with DBT, new Databricks features like Liquid Clustering, predictive optimization, Photon, SQL serverless warehouses, managing multiple teams on Unity Catalog, and others.
This presentation dives into both the business and technical sides of this migration. Come along as we share our key takeaways from this journey.
Session Speakers
Isaac Chan
/Data Engineer
HP Inc.
Kavya Atmakuri
/Data Engineer
HP Inc.