Session
Spark on Databricks: Tips and Tricks
Overview
| Experience | In Person |
|---|---|
| Type | Breakout |
| Track | Data Engineering and Streaming |
| Industry | Enterprise Technology |
| Technologies | Apache Spark |
| Skill Level | Advanced |
| Duration | 40 min |
This session explores advanced JSON Schema handing(inference and evolving), and event Demuxing
Topics include:
- How from_json is currently used today and its challenges.
- How to use Variant for rapidly changing schema.
- How from_json in DLT with primed schema helps simplify schema handling.
- Demultiplexing patterns for scalable stream processing.
- Simply event Demuxing with DLT.
Session Speakers
Dattatraya Walake
/Specialist Solutions Architect
Databricks
IMAGE COMING SOON
Murali Talluri
/Specialist Solutions Architect
Databricks