How to Seamlessly Upgrade Your Hive Metastore Objects to the Unity Catalog Metastore Using SYNC
In this blog, we explore how you can seamlessly upgrade your Hive metastore* schemas and external tables to the Unity Catalog metastore using...
Simplify Access Policy Management With Privilege Inheritance in Unity Catalog
Unity Catalog , now generally available on AWS and Azure, provides a unified governance solution for data, analytics and AI on the lakehouse...
Building a Data Mesh Based on the Databricks Lakehouse, Part 2
In the last blog " Databricks Lakehouse and Data Mesh ," we introduced the Data Mesh based on the Databricks Lakehouse. This blog...
Deloitte’s Guide to Declarative Data Pipelines With Delta Live Tables
This post was written in collaboration with Deloitte. We thank Mani Kandasamy, Strategy and Analytics, AI and Data Engineering at Deloitte Consulting, for...
Faster MERGE Performance With Low-Shuffle MERGE and Photon
At Databricks, one of our key goals is to provide our customers with an industry-best price/performance experience out of the box. From ETL...
Reduce Overhead and Get Straight to Work With Personal Compute in Databricks
The Databricks Lakehouse enables organizations to use a single, unified platform for all their data, analytics, and AI workloads. These projects often start...
Databricks Lakehouse and Data Mesh, Part 1
This is the first blog in a two-part series. In this post we will introduce the data mesh concept and the Databricks capabilities...
Using Streaming Delta Live Tables and AWS DMS for Change Data Capture From MySQL
In this article we will walk you through the steps to create an end-to-end CDC pipeline with Terraform using Delta Live Tables, AWS...
Navigating the Databricks Lakehouse Like a Pro
At Databricks, we love helping you be as efficient as possible—whether through simplifying the modern data stack with the Lakehouse or saving costs...
Mitigating Bias in Machine Learning With SHAP and Fairlearn
Try this notebook in Databricks. With good reason, data science teams increasingly grapple with questions of ethics, bias and unfairness in machine learning...