Session

Top Performance and Cost Optimizations for Lakeflow Declarative Pipelines

Register or Login

Overview

Tuesday

June 10

10:20 am

ExperienceIn Person
TypeBreakout
TrackData Engineering and Streaming
IndustryEnterprise Technology
TechnologiesDLT
Skill LevelAdvanced
Duration40 min

Lakeflow Declarative Pipelines simplifies pipeline development and management — but how do you optimize for performance and cost? In this session, we’ll explore practical strategies for tuning Lakeflow Declarative Pipelines, including when and how to use autoscaling, Photon and different node types. We'll also cover how to monitor resource usage and decide when serverless is the right choice. You'll learn best practices drawn from real-world customer implementations, along with an overview of the latest performance enhancements available in serverless Lakeflow Declarative Pipelines.

Session Speakers

Steven Yu

/Principal Solutions Architect
Databricks