Skip to main content
Page 1
Platform blog

Improve Lakehouse Security Monitoring using System Tables in Databricks Unity Catalog

As the lakehouse becomes increasingly mission-critical to data-forward organizations, so too grows the risk that unexpected events, outages, and security incidents may derail...
Platform blog

Security best practices for the Databricks Lakehouse Platform

Your data security is our priority At Databricks, we know that data is one of your most valuable assets and always has to...
Platform blog

Monitoring Notebook Command Logs With Static Analysis Tools

November 2, 2022 by Silvio Fiorito in Platform Blog
Background Code review and static analysis tools are standard practices in the Software Development Lifecycle (SDLC). Static analysis tools help developers find code...
Platform blog

Using Enhanced Security Monitoring to Detect & Alert for Suspicious Activity on Your Databricks Clusters

September 1, 2022 by Silvio Fiorito in Platform Blog
Databricks on AWS relies on custom machine images, AMIs, deployed as EC2 instances in the customer’s account. These EC2 instances provide the elastic...
Engineering blog

Building ETL pipelines for the cybersecurity lakehouse with Delta Live Tables

June 3, 2022 by Silvio Fiorito in Data Engineering
Databricks recently introduced Workflows to enable data engineers, data scientists, and analysts to build reliable data, analytics, and ML workflows on any cloud...
Platform blog

Monitoring Your Databricks Lakehouse Platform with Audit Logs

This blog is part two of our Admin Essentials series, where we'll focus on topics that are important to those managing and maintaining...
Company blog

How Databricks IAM Credential Passthrough Solves Common Data Authorization Problems

July 17, 2019 by Greg Owen and Silvio Fiorito in Company Blog
In our first blog post , we introduced Databricks IAM Credential Passthrough as a secure, convenient way for customers to manage access to...
Company blog

Introducing Databricks AWS IAM Credential Passthrough

March 26, 2019 by Silvio Fiorito and Greg Owen in Company Blog
As more and more analytics move to the cloud, customers are faced with the challenge of how to control which users have access...
Company blog

Learn about Apache Spark APIs and Best Practices

September 12, 2017 by Jules Damji and Silvio Fiorito in Company Blog
Since Apache Spark 1.3, Spark and its APIs have evolved to make them easier, faster, and smarter. The goal has been to unify...