Data Quality Monitoring on Streaming Data Using Spark Streaming and Delta LakeMarch 4, 2020 by Abraham Pabbathi and Greg Wood in Platform Blog Try this notebook to reproduce the steps outlined below In the era of accelerating everything, streaming data is no longer an outlier- instead...
Securely Accessing Azure Data Sources from Azure DatabricksFebruary 28, 2020 by Bhavin Kukadia, Abhinav Garg and Michal Marusan in Security and Trust Azure Databricks is a Unified Data Analytics Platform that is a part of the Microsoft Azure Cloud. Built upon the foundations of Delta...
Introducing Databricks Ingest: Easy and Efficient Data Ingestion from Different Sources into Delta LakeFebruary 24, 2020 by Prakash Chockalingam in Engineering Blog Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake We are excited to...
New Data Ingestion Network for Databricks: The Partner Ecosystem for Applications, Database, and Big Data Integrations into Delta LakeFebruary 24, 2020 by Hiral Jasani in Company Blog Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. Organizations have a wealth...
Working with Entity Relationship (ER) Diagrams on DatabricksFebruary 21, 2020 by Greg Rahn in Platform Blog Introduction Databricks supports the standard SQL data types and has first-class support for both ODBC and JDBC clients. This means that most 3rd...