Introducing Spark Connect – The Power of Apache Spark, Everywhere
At last week’s Data and AI Summit, we highlighted a new project called Spark Connect in the opening keynote. This blog post walks…
Open Sourcing All of Delta Lake
The theme of this year’s Data + AI Summit is that we are building the modern data stack with the lakehouse. A fundamental…
Connect From Anywhere to Databricks SQL
Today we are thrilled to announce a full lineup of open source connectors for Go, Node.js, Python, as well as a new CLI…
Project Lightspeed: Faster and Simpler Stream Processing With Apache Spark
Streaming data is a critical area of computing today. It is the basis for making quick decisions on the enormous amounts of incoming…
Databricks SQL Serverless Now Available on AWS
We are excited to announce the availability of serverless compute for Databricks SQL (DBSQL) in Public Preview on AWS today at the Data…
Apache Spark and Photon Receive SIGMOD Awards
This week, many of the most influential engineers and researchers in the data management community are convening in-person in Philadelphia for the ACM…
Introducing Apache Spark™ 3.3 for Databricks Runtime 11.0
Today we are happy to announce the availability of Apache Spark™ 3.3 on Databricks as part of Databricks Runtime 11.0. We want to…
Introducing Databricks SQL on Google Cloud – Now in Public Preview
Today we’re pleased to announce the availability of Databricks SQL in public preview on Google Cloud. With this announcement, customers can further adopt…
Announcing General Availability of Databricks SQL
Today, we are thrilled to announce that Databricks SQL is Generally Available (GA)! This follows our earlier announcements about Databricks SQL’s world record-setting…
Announcing Databricks Seattle R&D Site
Today, we are excited to announce the opening of our Seattle R&D site and our plan to hire hundreds of engineers in Seattle…
