Session
Sponsored by: definity | How You Could Be Saving 50% of Your Spark Costs
Overview
Experience | In Person |
---|---|
Type | Lightning Talk |
Track | Data Engineering and Streaming |
Industry | Enterprise Technology, Media and Entertainment, Financial Services |
Technologies | Apache Spark, Apache Iceberg, Unity Catalog |
Skill Level | Intermediate |
Duration | 20 min |
Enterprise lakehouse platforms are rapidly scaling – and so are complexity and cost. After monitoring over 1B vCore-hours across Databricks and other Apache Spark™ environments, we consistently saw resource waste, preventable data incidents, and painful troubleshooting. Join this session to discover how definity’s unique full-stack observability provides job-level visibility in-motion, unifying infrastructure performance, pipeline execution, and data behavior, and see how enterprise teams use definity to easily optimize jobs and save millions – while proactively ensuring SLAs, preventing issues, and simplifying RCA.
Session Speakers
Roy Daniel
/CEO & Co-Founder
definity