Log4j2 Vulnerability (CVE-2021-44228) Research and AssessmentDecember 23, 2021 by Fermín J. Serna in Engineering Blog This blog relates to an ongoing investigation. We will update it with any significant updates, including detection rules to help people investigate potential...
Scala at Scale at DatabricksDecember 3, 2021 by Li Haoyi in Engineering Blog With hundreds of developers and millions of lines of code, Databricks is one of the largest Scala shops around. This post will be...
The Foundation of Your Lakehouse Starts With Delta LakeDecember 1, 2021 by Denny Lee and Vini Jaiswal in Engineering Blog It’s been an exciting last few years with the Delta Lake project. The release of Delta Lake 1.0 as announced by Michael Armbrust...
Turning 2 Trillion Data Points of Traffic Intelligence into Critical Business InsightsNovember 3, 2021 by Stephanie Mak in Engineering Blog This is a guest authored post by Stephanie Mak , Senior Data Engineer, formerly at Intelematics. This blog post offers my experience of...
Introducing Apache Spark™ 3.2October 19, 2021 by Gengliang Wang, Wenchen Fan, Hyukjin Kwon, Xiao Li and Reynold Xin in Engineering Blog We are excited to announce the availability of Apache Spark™ 3.2 on Databricks as part of Databricks Runtime 10.0 . We want to...