Generative AI | Databricks Blog

Page 6

Patronus AI: Using LLMs to Detect Business-Sensitive Information

November 1, 2023 by Emily Hutson in Mosaic Research

EnterprisePII is a first-of-its-kind large language model (LLM) data set aimed at detecting business-sensitive information. The challenge of detecting and redacting sensitive business...

Training LLMs at Scale with AMD MI250 GPUs

October 30, 2023 by Abhi Venigalla in Mosaic Research

Introduction Four months ago, we shared how AMD had emerged as a capable platform for generative AI and demonstrated how to easily and...

LLM Training on Unity Catalog data with MosaicML Streaming Dataset

October 17, 2023 by Xiaohan Zhang, Maddie Dawson and Karan Jariwala in Mosaic Research

Introduction Large Language Models (LLMs) have given us a way to generate text, extract information, and identify patterns in industries from healthcare to...

LLM Inference Performance Engineering: Best Practices

October 12, 2023 by Megha Agarwal, Asfandyar Qureshi, Nikhil Sardana, Linden Li, Julian Quevedo and Daya Khudia in Mosaic Research

In this blog post, the MosaicML engineering team shares best practices for how to capitalize on popular open source large language models (LLMs)...

Introducing Llama2-70B-Chat with MosaicML Inference

August 24, 2023 by Hagay Lupesko, Margaret Qian, Daya Khudia, Sam Havens, Daniel King and Erica Ji Yuen in Mosaic Research

Llama2-70B-Chat is a leading AI model for text completion, comparable with ChatGPT in terms of quality. Today, organizations can leverage this state-of-the-art model...

End-to-End Secure Evaluation of Code Generation Models

August 10, 2023 by Rishab Parthasarathy in Mosaic Research

With MosaicML, you can now evaluate LLMs and Code Generation Models on code generation tasks (such as HumanEval, with MBPP and APPS coming...

Announcing MPT-7B-8K: 8K Context Length for Document Understanding

July 18, 2023 by Sam Havens and Erica Ji Yuen in Mosaic Research

Today, we are releasing MPT-7B-8K, a 7B parameter open-source LLM with 8k context length trained with the MosaicML platform. MPT-7B-8K was pretrained starting...

Training LLMs with AMD MI250 GPUs and MosaicML

June 30, 2023 by Abhi Venigalla in Mosaic Research

With the release of PyTorch 2.0 and ROCm 5.4, we are excited to announce that LLM training works out of the box on...

MPT-30B: Raising the bar for open-source foundation models

June 22, 2023 by in Mosaic Research

Introducing MPT-30B, a new, more powerful member of our Foundation Series of open-source models, trained with an 8k context length on NVIDIA H100...

Introducing AI2 OLMo (Open Language Model)

June 2, 2023 by Jonathan Frankle in Mosaic Research

Last month, the Allen Institute for AI (AI2) announced the development of an open, state-of-the-art generative language model: AI2 OLMo (Open Language Model)...