Introducing Data Profiles in the Databricks Notebook
Before a data scientist can write a report on analytics or train a machine learning (ML) model, they need to understand the shape...
Evolution of the Sql Language at Databricks: Ansi Standard by Default and Easier Migrations from Data Warehouses
Databricks SQL is now generally available on AWS and Azure. Today, we are excited to announce that Databricks SQL will use the ANSI...
Now Generally Available: Simplify Data and Machine Learning Pipelines With Jobs Orchestration
We are excited to announce the general availability of Jobs orchestration , a new capability that lets Databricks customers easily build data and...
Introducing SQL User-Defined Functions
A user-defined function (UDF) is a means for a user to extend the native capabilities of Apache Spark™ SQL. SQL on Databricks has...
Databricks Repos Is Now Generally Available - New ‘Files’ Feature in Public Preview
Thousands of Databricks customers have adopted Databricks Repos since its public preview and have standardized on it for their development and production workflows...
Databricks SQL: Delivering a Production SQL Development Experience on the Data Lake
Databricks SQL is now generally available on AWS and Azure. Databricks SQL (DB SQL) is a simple and powerful SQL analytics platform for...
Part 1: Implementing CI/CD on Databricks Using Databricks Notebooks and Azure DevOps
Discussed code can be found here . This is the first part of a two-part series of blog posts that show how to...
Announcing Public Preview of Low Shuffle Merge
Today, we are excited to announce the public preview of Low Shuffle Merge in Delta Lake , available on AWS, Azure, and Google...
5 Steps to Implementing Intelligent Data Pipelines With Delta Live Tables
Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake Many IT organizations are...
New Performance Improvements in Databricks SQL
Databricks SQL is now generally available on AWS and Azure. Originally announced at Data + AI Summit 2020 Europe, Databricks SQL lets you...