Skip to main content

Lakehouse AI announcements at Data and AI Summit 2023

Generative AI Architecture Patterns

Build production-quality generative AI for any architectural pattern

hero image

Start building your generative AI solution

There are four architectural patterns to consider when building a large language model (LLM) solution.

Databricks is the only provider that lets you build high-quality solutions at low cost across all four generative AI architectural patterns:

gen ai
gen ai

Prompt engineering

Prompt engineering is the practice of customizing prompts to elicit better responses without changing the underlying model. Prompt engineering is easy in Databricks by finding available models in the Marketplace (including popular open source models such as Llama 2 and MPT), serving models behind an endpoint in Model Serving, and evaluating prompts in an easy-to-use UI with Playground or MLflow.

gen ai

Retrieval augmented generation (RAG)

RAG finds data/documents that are relevant to a question or task and provides them as context for the LLM to give more relevant responses. 

Databricks has a suite of RAG tools that helps you combine and optimize all aspects of the RAG process such as data preparation, retrieval models, language models (either SaaS or open source), ranking and post-processing pipelines, prompt engineering, and training models on custom enterprise data.

gen ai


Fine-tuning adapts an existing general-purpose LLM model by doing additional training using your organization’s IP with your data. Databricks fine-tuning lets you do this easily by allowing you to start with your preferred LLM model — including curated models by Databricks such as MPT-30B, Llama 2 and BGE — and giving you the ability to do further training on new datasets. 

gen ai


Pretraining is the practice of building a new LLM model from scratch to ensure the foundational knowledge of the model is tailored to your specific domain. By training on your organization’s IP with your data, it creates a customized model that is uniquely differentiated. Databricks Mosaic AI Pretraining is an optimized training solution that can build new multibillion parameter LLMs in days with up to 10x lower training costs.

gen ai

Choosing the best pattern

These architectural patterns are not mutually exclusive. Rather, they can (and should) be combined to take advantage of the strengths of each in different generative AI deployments. Databricks is the only provider that enables all four generative AI architectural patterns, ensuring you have the most options and can evolve as your business requirements demand.

Ready to get started?