Best Practices for Coarse Grained Data Security in Databricks
At Databricks, we work with hundreds of companies, all pushing the bleeding edge in their respective industries. We want to share patterns for...
Getting Around “Moore’s Wall”: Databricks CEO Ali Ghodsi Strives to Make AI More Accessible to the Fortune 2000
Today Databricks, a high-profile provider of technology fueling artificial-intelligence and data-analysis breakthroughs at big companies, announced it has raised $140 million from a...
Apache Spark’s Structured Streaming with Amazon Kinesis on Databricks
On July 11, 2017, we announced the general availability of Apache Spark 2.2.0 as part of Databricks Runtime 3.0 (DBR) for the Unified...
Databricks Named as a Strong Performer in The Forrester Wave: Insight Platforms-as-a-Service, Q3 2017
Forrester recently published The Forrester Wave: Insight Platforms-as-a-Service Wave, Q3 2017 . In its 36-criteria evaluation of insight platform-as-a-service (PaaS) providers, Forrester identified...
On-Demand Webinar and FAQ: Accelerate Data Science with Better Data Engineering on Databricks
On July 13th, we hosted a live webinar — Accelerate Data Science with Better Data Engineering on Databricks . This webinar focused on...
Breaking the “curse of dimensionality” in Genomics using “wide” Random Forests
This is a guest blog from members of CSIRO’s transformational bioinformatics team in Sydney, Australia. CSIRO, Australia’s government research agency, is in the...
Integrating Apache Airflow with Databricks
This blog post is part of our series of internal engineering blogs on Databricks platform, infrastructure management, integration, tooling, monitoring, and provisioning. Today...
Serverless Continuous Delivery with Databricks and AWS CodePipeline
Two characteristics commonly mark many companies' success. First, they quickly adapt to new technology. Second, as a result, they gain technological leadership and...
4 SQL High-Order and Lambda Functions to Examine Complex and Structured Data in Databricks
Read Rise of the Data Lakehouse to explore why lakehouses are the data architecture of the future with the father of the data...
Declarative Infrastructure with the Jsonnet Templating Language
This blog post is part of our series of internal engineering blogs on Databricks platform, infrastructure management, integration, tooling, monitoring, and provisioning. At...