Session
Performance Tuning the Data Platform at Databricks
Overview
| Experience | In Person |
|---|---|
| Track | Data Engineering & Streaming |
| Industry | Enterprise Technology |
| Technologies | Databricks SQL, Lakeflow, Unity Catalog |
| Skill Level | Beginner |
Even on the world's fastest data platform, inefficient code can bring pipelines to a crawl. In this technical deep dive, the Data Platform team shares the specific optimization techniques we use to tune our heaviest, most complex internal workloads. From optimizing file sizing and Z-ordering to leveraging predictive I/O and materialized views, we will share the "power user" tips and tricks that we use to shave hours off our runtimes. If you want to know how the experts tune Databricks for maximum performance, this is the session to attend.
Session Speakers
Bruce Wong
/Sr. Director, Data Platform
Databricks