SESSION

Ditch Your Data Warehouse for Superior Lakehouse Performance

OVERVIEW

EXPERIENCEIn Person
TYPELightning Talk
TRACKData Lakehouse Architecture
INDUSTRYMedia and Entertainment
TECHNOLOGIESApache Spark, Delta Lake, SQL Analytics / BI / Visualizations
SKILL LEVELIntermediate
DURATION20 min

Data lakehouses promise flexibility, scalability, and cost-effectiveness but often fail to deliver these benefits due to the shortcomings of query engines. This has forced users to copy their data from the lakehouse into proprietary data warehouses to achieve their desired query performance—through a complex, costly ingestion pipeline that undermines data governance and freshness. In this talk, we will dive into the latest developments in data lakehouse querying and how you can ensure your data lakehouse realizes its full potential. This talk will cover:

 

  • Why you should avoid using proprietary data warehouses purely for accelerating queries
  • The latest technical developments in query engines that will empower data lakehouse performance
  • How Tencent's A/B testing platform ditched data warehouses with only open source technologies like Delta Lake.

SESSION SPEAKERS

Sida Shen

/Product Manager
CelerData

IMAGE COMING SOON

Eric Sun

/Head of Data Platform
Coinbase