Unity Catalog Lakeguard: Industry-first and only data governance for multi-user Apache™ Spark clusters
We are thrilled to announce Unity Catalog Lakeguard , which allows you to run Apache Spark™ workloads in SQL, Python, and Scala with...
Page 1
Introducing Apache Spark™ 3.5
Today, we are happy to announce the availability of Apache Spark™ 3.5 on Databricks as part of Databricks Runtime 14.0. We extend our...
Shared Clusters in Unity Catalog for the win: Introducing Cluster Libraries, Python UDFs, Scala, Machine Learning and more
We are thrilled to announce that you can run even more workloads on Databricks’ highly efficient multi-user clusters thanks to new security and...
Spark Connect Available in Apache Spark 3.4
Last year Spark Connect was introduced at the Data and AI Summit. As part of the recently released Apache SparkTM 3.4, Spark Connect...
Use Databricks from anywhere with Databricks Connect “v2”
We are thrilled to announce the public preview of Databricks Connect "v2", which enables developers to use the power of Databricks from any...
Introducing Apache Spark™ 3.4 for Databricks Runtime 13.0
Today, we are happy to announce the availability of Apache Spark™ 3.4 on Databricks as part of Databricks Runtime 13.0 . We extend...
Power to the SQL People: Introducing Python UDFs in Databricks SQL
We were thrilled to announce the preview for Python User-Defined Functions (UDFs) in Databricks SQL (DBSQL) at last month's Data and AI Summit...
Introducing Spark Connect - The Power of Apache Spark, Everywhere
At last week's Data and AI Summit, we highlighted a new project called Spark Connect in the opening keynote. This blog post walks...