Serverless as the New "Easy Button": How HP Inc. Used Serverless to Turbocharge Their Data Pipeline
Overview
Wednesday
June 11
12:40 pm
Experience | In Person |
---|---|
Type | Breakout |
Track | Data Engineering and Streaming |
Industry | Enterprise Technology |
Technologies | Apache Spark, DLT, Unity Catalog |
Skill Level | Intermediate |
Duration | 40 min |
How do you wrangle over 8TB of granular “hit-level” website analytics data with hundreds of columns, all while eliminating the overhead of cluster management, decreasing runtime and saving money? In this session, we’ll dive into how we helped HP Inc. use Databricks serverless compute and Lakeflow Declarative Pipelines to streamline Adobe Analytics data ingestion while making it faster, cheaper and easier to operate. We’ll walk you through our full migration story — from managing unwieldy custom-defined AWS-based Apache Spark™ clusters to spinning up Databricks serverless pipelines and workflows with on-demand scalability and near-zero overhead. If you want to simplify infrastructure, optimize performance and get more out of your Databricks workloads, this session is for you.
Session Speakers
Jason Hart
/Senior Databricks Engineer
Zahlen Solutions
Matthew Wright
/CEO
Zahlen Solutions LLC