Session
Advanced JSON Schema handing and Event Demuxing
Overview
Experience | In Person |
---|---|
Type | Breakout |
Track | Data Engineering and Streaming |
Industry | Enterprise Technology |
Technologies | Apache Spark |
Skill Level | Advanced |
Duration | 40 min |
This session explores advanced JSON Schema handing(inference and evolving), and event Demuxing
Topics include:
- How from_json is currently used today and its challenges.
- How to use Variant for rapidly changing schema.
- How from_json in DLT with primed schema helps simplify schema handling.
- Demultiplexing patterns for scalable stream processing.
- Simply event Demuxing with DLT.
Session Speakers
Dattatraya Walake
/Specialist Solutions Architect
Databricks
Murali Talluri
/Specialist Solutions Architect
Databricks