Top 5 Reasons to Convert Your Cloud Data Lake to a Delta Lake
Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. If you examine the...
How to accelerate your ETL pipelines from 18 hours to as fast as 5 minutes with Azure Databricks
Azure Databricks enables organizations to migrate on-premises ETL pipelines to the cloud to dramatically accelerate performance and increase reliability. If you are using...
Data Teams Unite! Spark + AI Summit Recap
It’s been a few weeks since Spark + AI Summit 2020 and we can still feel the amazing energy from this global virtual...
Modern Industrial IoT Analytics on Azure - Part 2
Introduction In part 1 of the series on Modern Industrial Internet of Things (IoT) Analytics on Azure, we walked through the big data...
Data with impact: A look back at the first Hackathon for Social Good
As global citizens, more and more businesses are investing in corporate social responsibility (CSR) programs to help solve the issues of system social...
Modern Industrial IoT Analytics on Azure - Part 1
This post and the three-part series about Industrial IoT analytics were jointly authored by Databricks and members of the Microsoft Cloud Solution Architecture...
Announcing Support for Google BigQuery in Databricks Runtime 7.1
At Databricks, we are building a unified platform for data and AI. Data in enterprises lives in many locations, and Databricks excels at...
Industrial IoT Analytics with DeepIQ DataStudio and Databricks
A recent survey by Bain & Company shows that more than 30% of industrial companies are concerned about Information Technology and Operations Technology...
Optimizing User Defined Functions with Apache Spark™ and R in the Real World: Scaling Pitch Scenario Analysis with the Minnesota Twins Part 2
Introduction In part 1 we talked about how Baseball Operations for the Minnesota Twins wanted to run up to 20k simulations on 15...
Bucket Brigade — Securing Public S3 Buckets
Are your Amazon S3 buckets secure? Do you know which ones are public or private? Do you even know which ones are supposed...