O(n*m) Architecture in Open Source. What Could Possibly Go Wrong?
Overview
| Experience | In Person |
|---|---|
| Track | Data Engineering & Streaming |
| Industry | Enterprise Technology |
| Technologies | Delta Sharing, Unity Catalog |
| Skill Level | Intermediate |
There's a quiet crisis going on in open source right now — whenever an open table format wants to build a new feature or integration, there's an exponentially more amount of work to do to incorporate it. A project that's increasingly harder to contribute to is the death of innovation.Kernel sets out to solve this problem by rewriting the source of truth. When other projects adopt Kernel, they no longer need to do any additional development for new features — they just appear. Join us for a deep dive into how we turned this project on its head, to solve not just these problems, but future problems we anticipate in open source.What started out as a contribution to Delta, could change the way that open table formats fundamentally integrate everywhere.Join Robert Pack, open-source contributor for Delta, Iceberg, Arrow and all round Rust enthusiast, and Holly Smith, tech communicator, who bullied Robert into this talk.
Session Speakers
Holly Smith
/DevRel
Databricks
Robert Pack
/Staff Developer Advocate
Databricks