State Rebalancing in Structured Streaming
In light of the accelerated growth and adoption of Apache Spark Structured Streaming, Databricks announced Project Lightspeed at Data + AI Summit 2022...
Welcome to the World Tour: Destination Lakehouse
We are thrilled to bring back the Data + AI World Tour , a virtual and in-person event series kicking off in November...
Orchestrate Production dbt Projects on the Lakehouse With Databricks Workflows
We are delighted to announce that Databricks Workflows , the highly reliable lakehouse orchestrator, now supports orchestrating dbt projects in public preview. This...
Building Patient Cohorts with NLP and Knowledge Graphs
Check out the solution accelerator to download the notebooks referred throughout this blog. Cohort building is an essential part of patient analytics. Defining...
Best Practices and Guidance for Cloud Engineers to Deploy Databricks on AWS: Part 1
As a cloud engineering team, it may seem like a daily occurrence that you get a request from a team to deploy a...
Mosaic LLMs: GPT-3 quality for <$500k
Training large language models (LLMs) costs less than you think. Using the MosaicML platform, we show how fast, cheap, and easy it is...
Using Streaming Delta Live Tables and AWS DMS for Change Data Capture From MySQL
In this article we will walk you through the steps to create an end-to-end CDC pipeline with Terraform using Delta Live Tables, AWS...
Navigating the Databricks Lakehouse Like a Pro
At Databricks, we love helping you be as efficient as possible—whether through simplifying the modern data stack with the Lakehouse or saving costs...
Databricks at Current 2022
Current 2022 , organized by Confluent, is the first-ever data streaming industry event – and it's coming up soon! No matter where you...
Introducing New Partner Integrations in Partner Connect
We are delighted to introduce five new integrations in Databricks Partner Connect , a one-stop portal that makes it easy to discover and...