Efficient CI/CD with Databricks Asset Bundles + Unity Catalog

This talk explores the latest CI/CD technology on Databricks utilizing Databricks Asset Bundles with a special emphasis on Unity Catalog and a look at potential third party integrations. We explore the configuration and benefits of Databricks Asset Bundles for managing dependencies and deploying code across multiple environments seamlessly. Additionally, we examine how Unity Catalog can be leveraged with DABs in order to control access to certain artifacts across environments by programmatically controlling account group access. The integration of these Databricks features with third-party tools is discussed to demonstrate enhanced workflow automation and data management, providing a robust framework for developers to streamline development cycles and improve efficiency in data projects. Attendees will gain insights into best practices for leveraging these technologies to foster a more integrated and efficient CI/CD pipeline in Databricks.