Session

Advanced JSON Schema handing and Event Demuxing

Register or Login

Overview

Tuesday

June 10

8:00 am

ExperienceIn Person
TypeBreakout
TrackData Engineering and Streaming
IndustryEnterprise Technology
TechnologiesApache Spark
Skill LevelAdvanced
Duration40 min

This session explores advanced JSON Schema handing(inference and evolving), and event DemuxingTopics include:

  • How from_json is currently used today and its challenges.
  • How to use Variant for rapidly changing schema.
  • How from_json in Lakeflow Declarative Pipelines with primed schema helps simplify schema handling.
  • Demultiplexing patterns for scalable stream processing.
  • Simply event Demuxing with Lakeflow Declarative Pipelines.

Session Speakers

Dattatraya Walake

/Specialist Solutions Architect
Databricks

Murali Talluri

/Specialist Solutions Architect
Databricks