SESSION

Building File-Based Applications with Unity Catalog Volumes

OVERVIEW

EXPERIENCEIn Person
TYPELightning Talk
TRACKData Governance
INDUSTRYEnterprise Technology
TECHNOLOGIESData Sharing, AI/Machine Learning, Governance
SKILL LEVELIntermediate
DURATION20

Are you looking to build file-based applications that can handle extensive collections of non-tabular data, regardless of the data format? Unity Catalog Volumes provide a solution for accessing, storing, processing, and sharing files of any format, including structured, semi-structured, and unstructured data. With Volumes, you can manage non-tabular data alongside tabular data and models in Unity Catalog, ensuring a unified discovery and governance for all your data and AI assets. Whether you need to read directories, process files, create and write new ones, or work with files using specific libraries and tools, Volumes have you covered. In this session, you'll discover the full capabilities of Volumes and how they can help you build scalable file-based applications using Spark APIs, REST APIs, native file libraries, SQL connectors, SDKs, and more. Plus, you'll see how to use Volumes for AI and Ingestion use cases in action.

SESSION SPEAKERS

Adriana Ispas

/Sr. Staff Product Manager
Databricks

Adrian Ionescu

/Staff Software Engineer
Databricks