Databricks Security Advisory: Critical Runc Vulnerability (CVE-2019-5736)
Databricks became aware of a new critical runc vulnerability (CVE-2019-5736) on February 12, 2019 that allows malicious container users to gain root access...
AI Trends that Paved the Way in 2018
With 2018 behind us, it’s been amazing to see AI projects gain steam and make significant impact across industries. In fact, a recent...
How to Work with Avro, Kafka, and Schema Registry in Databricks
In the previous blog post , we introduced the new built-in Apache Avro data source in Apache Spark and explained how you can...
Near-Real-Time Hardware Failure Rate Estimation with Bayesian Reasoning
Try this notebook in Databricks You might be using Bayesian techniques in your data science without knowing it! And if you're not, then...
High-Performance Modern Data Warehousing with Azure Databricks and Azure SQL Data Warehouse
As organizations move to the cloud, the architecture for a Modern Data Warehouse (MDW) allows a new level of performance and scalability. A...