Your guide to understanding Databricks Marketplace for both data providers and consumers
by Tia Chang, Darshana Sivakumar, Harish Gaur, Bemnet Merha and Mengxi Chen
Databricks Marketplace is an open marketplace for data, analytics, and AI, powered by the open-source Delta Sharing standard. Since the release of Databricks Marketplace, we have seen 300% growth in listings and providers. Throughout this explosive growth phase, we helped data partners and data consumers make the best use of Databricks Marketplace.
Today, we want to share the top 10 most frequently asked questions. Tailored for both consumers and providers, read on to learn more about what makes us different, how to make your listing stand out, and how to find the right product for your specific data needs.
Databricks Marketplace includes a variety of products such as data sets, ML models, notebooks, solution accelerators, and very soon, applications. This variety supports a broader range of analytics and AI initiatives, helping consumers realize the full value of the data. There are 2500+ listings across 250+ providers.
Databricks Marketplace allows for data access without the need to be on the Databricks platform. This open approach avoids vendor lock-in and enables consumers to use their preferred tools and platforms, enhancing flexibility and integration.
Built on top of Delta Sharing, Marketplace eliminates the need for complex ETL processes and expensive data replication. Customers can use Unity Catalog to govern the Databricks Marketplace datasets along with the rest of the lakehouse data. All this reduces the operational burden on consumers, allowing them to focus on deriving value from the data rather than managing and governing it.
Databricks Marketplace is powered by Delta Sharing, so you can benefit from open source flexibility and no vendor lock-in. It offers a diverse range of assets beyond just structured data, including AI models, notebooks, volumes or unstructured data (images/videos/audio), and solution accelerators, accessible through various analytics tools such as PowerBI and Spark. Examples include Crisp (Tables), Shutterstock (Volumes), AI21 Lab (AI Models), Datavant or LiveRamp (Solution Accelerators), and Kythera Labs (Notebooks).
D2O (Databricks-to-Open) sharing allows Databricks Marketplace providers to share data with recipients on any platform or cloud, without requiring you to be on Databricks. This expands the addressable market for providers, while deep integration with Unity Catalog enhances governance for Databricks users. These features collectively emphasize flexibility, openness, and comprehensive support for diverse data and analytics needs, catering to a wide range of users across different platforms and tools.
To identify the most suitable data product on Databricks Marketplace, begin by specifying your analytical goals and data requirements. Utilize the platform's filtering capabilities to refine your search by product, provider, category, model task, and type of listing. For an in-depth evaluation, take advantage of the pre-built notebooks and sample datasets available; these resources enable you to conduct exploratory data analysis and assess the data's fit for your specific use case.
For example, the HealthVerity Claims Sample Patient Dataset includes a detailed notebook and use cases to assist you in assessing its applicability. Technical users can execute sample queries within these notebooks to gain insights into the data's schema, quality, and potential analytical applications.