Adaptive Query Execution in Structured Streaming
In Databricks Runtime, Adaptive Query Execution (AQE) is a performance feature that continuously re-optimizes batch queries using runtime statistics during query execution. Starting...
Announcing the General Availability of Databricks SQL Serverless !
Today, we are thrilled to announce that serverless compute for Databricks SQL is Generally Available on AWS and Azure! Databricks SQL (DB SQL)...
Latency goes subsecond in Apache Spark Structured Streaming
Apache Spark Structured Streaming is the leading open source stream processing platform. It is also the core technology that powers streaming on the...
Actioning Customer Reviews at Scale with Databricks SQL AI Functions
Every morning Susan walks straight into a storm of messages, and doesn't know where to start! Susan is a customer success specialist at...
Unifying Your Data Ecosystem with Delta Lake Integration
As organizations are maturing their data infrastructure and accumulating more data than ever before in their data lakes, Open and Reliable table formats...
Announcing Terraform Databricks modules
The Databricks Terraform provider reached more than 10 million installations, significantly increasing adoption since it became generally available less than one year ago...
Understanding Caching in Databricks SQL: UI, Result, and Disk Caches
Caching is an essential technique for improving the performance of data warehouse systems by avoiding the need to recompute or fetch the same...
Securing Databricks cluster init scripts
This blog was co-authored by Elia Florio, Sr. Director of Detection & Response at Databricks and Florian Roth and Marius Bartholdy, security researchers...
Databricks ❤️ Hugging Face
Generative AI has been taking the world by storm. As the data and AI company, we have been on this journey with the...
Announcing the General Availability of Predictive I/O for Reads
Today, we are excited to announce the general availability of Predictive I/O for Databricks SQL (DB SQL) : a machine learning powered feature...