Databricks SQL: Delivering a Production SQL Development Experience on the Data LakeSeptember 30, 2021 by Miranda Luna and Cyrielle Simeone in Platform Blog Databricks SQL is now generally available on AWS and Azure. Databricks SQL (DB SQL) is a simple and powerful SQL analytics platform for...
Part 1: Implementing CI/CD on Databricks Using Databricks Notebooks and Azure DevOpsSeptember 20, 2021 by Michael Shtelma and Piotr Majer in Platform Blog Discussed code can be found here . This is the first part of a two-part series of blog posts that show how to...
Timeliness and Reliability in the Transmission of Regulatory ReportsSeptember 17, 2021 by Antoine Amend and Fahmid Kabir in Security and Trust Managing risk and regulatory compliance is an increasingly complex and costly endeavour. Regulatory change has increased 500% since the 2008 global financial crisis...
Announcing Public Preview of Low Shuffle MergeSeptember 8, 2021 by Himanshu Raja in Platform Blog Today, we are excited to announce the public preview of Low Shuffle Merge in Delta Lake , available on AWS, Azure, and Google...
5 Steps to Implementing Intelligent Data Pipelines With Delta Live TablesSeptember 8, 2021 by Awez Syed and Amit Kara in Platform Blog Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake Many IT organizations are...
New Performance Improvements in Databricks SQLSeptember 8, 2021 by Reynold Xin, Can Efeoglu and Cyrielle Simeone in Platform Blog Databricks SQL is now generally available on AWS and Azure. Originally announced at Data + AI Summit 2020 Europe, Databricks SQL lets you...
Implementing More Effective FAIR Scientific Data Management With a LakehouseSeptember 7, 2021 by Greg Wood and Amir Kermany in Platform Blog Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Announcing the Launch of Delta Live Tables on Google CloudSeptember 2, 2021 by Awez Syed and Sam Steiny in Platform Blog Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. Today, we are excited...
How Incremental ETL Makes Life Simpler With Data LakesAugust 30, 2021 by John O'Dwyer in Platform Blog Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. Incremental ETL (Extract, Transform...
Frequently Asked Questions About the Data LakehouseAugust 30, 2021 by Michael Armbrust, Bharath Gowda, Reynold Xin, Matei Zaharia and Ali Ghodsi in Platform Blog Question Index What is a Data Lakehouse? What is a Data Lake? What is a Data Warehouse? How is a Data Lakehouse different...