Skip to main content
Page 1
Engineering blog

Adaptive Query Execution in Structured Streaming

In Databricks Runtime, Adaptive Query Execution (AQE) is a performance feature that continuously re-optimizes batch queries using runtime statistics during query execution. Starting...
Engineering blog

Faster SQL: Adaptive Query Execution in Databricks

October 21, 2020 by MaryAnn Xue and Allison Wang in Engineering Blog
Earlier this year, Databricks wrote a blog on the whole new Adaptive Query Execution framework in Spark 3.0 and Databricks Runtime 7.0. The...
Engineering blog

Adaptive Query Execution: Speeding Up Spark SQL at Runtime

Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Engineering blog

SQL Pivot: Converting Rows to Columns

November 1, 2018 by MaryAnn Xue in Engineering Blog
Try this notebook in Databricks Check out the Why the Data Lakehouse is Your Next Data Warehouse ebook to discover the inner workings...