Databricks Ventures Invests in Arcion to Enable Real-Time Data Sync with the Lakehouse
Databricks customers, regardless of size and industry, are increasingly seeking to unify their data onto a single platform. To do this, they need...
Using Apache Flink With Delta Lake
As with all parts of our platform, we are constantly raising the bar and adding new features to enhance developers’ abilities to build...
Structured Streaming: A Year in Review
As we enter 2022, we want to take a moment to reflect on the great strides made on the streaming front in Databricks...
Google Datastream Integration With Delta Lake for Change Data Capture
This is a collaborative post between the data teams as Badal, Google and Databricks. We thank Eugene Miretsky, Partner, and Steven Deutscher-Kobayashi, Senior...
Confluent Streaming for Databricks: Build Scalable Real-time Applications on the Lakehouse
For many organizations, real-time data collection and data processing at scale can provide immense advantages for business and operational insights. The need for...
Native Support of Session Window in Spark Structured Streaming
Apache Spark™ Structured Streaming allowed users to do aggregations on windows over event-time . Before Apache Spark 3.2™, Spark supported tumbling windows and...
How YipitData Extracts Insights From Alternative Data Using Delta Lake
Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. This is a guest...
Real-time Point-of-Sale Analytics With a Data Lakehouse
Disruptions in the supply chain – from reduced product supply and diminished warehouse capacity – coupled with rapidly shifting consumer expectations for seamless...
Infrastructure Design for Real-time Machine Learning Inference
This is a guest authored post by Yu Chen, Senior Software Engineer, Headspace. Headspace's core products are iOS, Android and web-based apps that...
How Incremental ETL Makes Life Simpler With Data Lakes
Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake. Incremental ETL (Extract, Transform...