A look at the new Structured Streaming UI in Apache Spark 3.0
This is a guest community post from Genmao Yu, a software engineer at Alibaba. Structured Streaming was initially introduced in Apache Spark 2.0...
Modernizing Risk Management Part 1: Streaming data-ingestion, rapid model development and Monte-Carlo Simulations at Scale
Part 2 of this accelerator here . Managing risk within the financial services , especially within the banking sector, has increased in complexity...
How to build a Quality of Service (QoS) analytics solution for streaming video services
Click on the following link to view and download the QoS notebooks discussed below in this article. Contents The Importance of Quality to...
Data Quality Monitoring on Streaming Data Using Spark Streaming and Delta Lake
Try this notebook to reproduce the steps outlined below In the era of accelerating everything, streaming data is no longer an outlier- instead...
Introducing Databricks Ingest: Easy and Efficient Data Ingestion from Different Sources into Delta Lake
Get an early preview of O'Reilly's new ebook for the step-by-step guidance you need to start using Delta Lake We are excited to...