Session

Advanced JSON Schema handing and Event Demuxing

Overview

ExperienceIn Person
TypeBreakout
TrackData Engineering and Streaming
IndustryEnterprise Technology
TechnologiesApache Spark
Skill LevelAdvanced
Duration40 min

This session explores advanced JSON Schema handing(inference and evolving), and event Demuxing

 

Topics include:

  • How from_json is currently used today and its challenges.
  • How to use Variant for rapidly changing schema. 
  • How from_json in DLT with primed schema helps simplify schema handling.
  • Demultiplexing patterns for scalable stream processing.
  • Simply event Demuxing with DLT.

Session Speakers

Dattatraya Walake

/Specialist Solutions Architect
Databricks

Murali Talluri

/Specialist Solutions Architect
Databricks