Crypto at Scale: Building a Cost-Efficient, High-Performance Platform for Real-Time Blockchain Data
Overview
Experience | In Person |
---|---|
Type | Breakout |
Track | Data Engineering and Streaming |
Industry | Public Sector, Financial Services |
Technologies | Apache Spark, Delta Lake, Databricks SQL |
Skill Level | Intermediate |
Duration | 40 min |
In today’s fast-evolving crypto landscape, organizations require fast, reliable intelligence to manage risk, investigate financial crime, and stay ahead of evolving threats. In this session, discover how Elliptic built a scalable, high-performance data intelligence platform that delivers real-time, actionable blockchain insights—empowering businesses to future-proof their crypto risk strategies and law enforcement to streamline investigations.
We’ll walk you through how we've built a high-performance data platform, leveraging key components of the Databricks ecosystem such as Structured Streaming and Delta Lake. This transformation has fundamentally changed the way we deliver user-facing analytics—improving not only speed and scalability, but also enabling analytics to directly enhance the accuracy and intelligence of our operational systems. Along the way, we’ll share how we overcame critical challenges such as building efficient incremental pipelines, designing robust partitioning strategies for large-scale crypto datasets, and enabling seamless data sharing with our customers.Whether you’re looking to enhance your streaming capabilities, expand your knowledge of how crypto analytics works or simply discover novel approaches to data processing at scale, this session will provide concrete strategies and valuable lessons learned from the front lines of crypto attribution
Session Speakers
Matthew Moorcroft
/Specialist Solutions Architect
Databricks
Ferran Cabezas Castellvi
/Lead Data Engineer
Elliptic