SESSION

Sponsored by: Oracle | Deploying DBRX on OCI with NVIDIA NIM leveraging Delta Sharing

OVERVIEW

EXPERIENCEIn Person
TYPEBreakout
TRACKGenerative AI
INDUSTRYEnterprise Technology
TECHNOLOGIESAI/Machine Learning
SKILL LEVELIntermediate
DURATION40 min

The deployment of Large Language Models like DBRX can run on Oracle Cloud Infrastructure (OCI) with NVIDIA NIM represents an advancement in artificial intelligence applications. This session covers the DBRX deployment and and sharing data with the Delta Sharing protocol to achieve data collaboration and AI outcomes.. By leveraging OCI's robust and secure cloud platform alongside NVIDIA's cutting-edge AI capabilities, we’ll show how DBRX is empowered to deliver high-performance, real-time inference services tailored for generative AI applications. The deployment framework showcases how OCI's flexible infrastructure, combined with NVIDIA's GPUs and optimized inference microservices, efficiently handles large-scale data, accelerating research and innovation.

SESSION SPEAKERS

Dr. Sanjay Basu

/Senior Director, Cloud Engineering
Oracle

Yang Liu

/Senior Solutions Architect
NVIDIA