Session

O(n*m) Architecture in Open Source. What Could Possibly Go Wrong?

Overview

ExperienceIn Person
TrackData Engineering & Streaming
IndustryEnterprise Technology
TechnologiesDelta Sharing, Unity Catalog
Skill LevelIntermediate

There's a quiet crisis going on in open source right now — whenever an open table format wants to build a new feature or integration, there's an exponentially more amount of work to do to incorporate it. A project that's increasingly harder to contribute to is the death of innovation.Kernel sets out to solve this problem by rewriting the source of truth. When other projects adopt Kernel, they no longer need to do any additional development for new features — they just appear. Join us for a deep dive into how we turned this project on its head, to solve not just these problems, but future problems we anticipate in open source.What started out as a contribution to Delta, could change the way that open table formats fundamentally integrate everywhere.Join Robert Pack, open-source contributor for Delta, Iceberg, Arrow and all round Rust enthusiast, and Holly Smith, tech communicator, who bullied Robert into this talk.

Session Speakers

Speaker placeholderIMAGE COMING SOON

Holly Smith

/DevRel
Databricks

Speaker placeholderIMAGE COMING SOON

Robert Pack

/Staff Developer Advocate
Databricks