Skip to main content

- - Databricks for Industries
    Communications
    Media and Entertainment
    Financial Services
    Public Sector
    Healthcare & Life Sciences
    Retail
    Manufacturing
    See All Industries
  - Cross Industry Solutions
    Cybersecurity
    Marketing
  - Migration & Deployment
    Data Migration
    Professional Services
  - Solution Accelerators
    Explore Accelerators
    Move faster toward outcomes that matter
- - Company
    Who We Are
    Our Team
    Databricks Ventures
    Contact Us
  - Careers
    Working at Databricks
    Open Jobs
  - Press
    Awards and Recognition
    Newsroom
  - Security and Trust
    Security and Trust
JUNE 9–12 | SAN FRANCISCO
Data + AI Summit is almost here — don’t miss the chance to join us in San Francisco!
REGISTER

Ready to get started?
Get a Demo

Data and AI summit

JUNE 9–12 | SAN FRANCISCO

Data + AI Summit is almost here — don’t miss the chance to join us in San Francisco!

Login
Try Databricks

Blog
Ying Sheng (Stanford University)

Ying Sheng (Stanford University)

Ying Sheng (Stanford University)'s posts

Mix Attention Blog Banner Image

Mosaic Research

September 18, 2024/14 min read

Inference-Friendly Models with MixAttention

Why Databricks

Discover

For Executives
For Startups
Lakehouse Architecture
Mosaic Research

Customers

Featured
See All

Partners

Cloud Providers
Technology Partners
Data Partners
Built on Databricks
Consulting & System Integrators
C&SI Partner Program
Partner Solutions

Discover

For Executives
For Startups
Lakehouse Architecture
Mosaic Research

Customers

Featured
See All

Partners

Cloud Providers
Technology Partners
Data Partners
Built on Databricks
Consulting & System Integrators
C&SI Partner Program
Partner Solutions

Product

Databricks Platform

Platform Overview
Sharing
Governance
Artificial Intelligence
Business Intelligence
Data Management
Data Warehousing
Real-Time Analytics
Data Engineering
Data Science

Pricing

Pricing Overview
Pricing Calculator

Integrations and Data

Marketplace
IDE Integrations
Partner Connect

Databricks Platform

Platform Overview
Sharing
Governance
Artificial Intelligence
Business Intelligence
Data Management
Data Warehousing
Real-Time Analytics
Data Engineering
Data Science

Pricing

Pricing Overview
Pricing Calculator

Integrations and Data

Marketplace
IDE Integrations
Partner Connect

Solutions

Databricks For Industries

Communications
Financial Services
Healthcare and Life Sciences
Manufacturing
Media and Entertainment
Public Sector
Retail
View All

Cross Industry Solutions

Cybersecurity
Marketing

Professional Services

Solution Accelerators

Databricks For Industries

Communications
Financial Services
Healthcare and Life Sciences
Manufacturing
Media and Entertainment
Public Sector
Retail
View All

Cross Industry Solutions

Cybersecurity
Marketing

Resources

Customer Support

Training and Certification

Learning Overview
Training Overview
Certification
University Alliance
Databricks Academy Login

Events

Data + AI Summit
Data + AI World Tour
Data Intelligence Days
Event Calendar

Blog and Podcasts

Databricks Blog
Databricks Mosaic Research Blog
Data Brew Podcast
Champions of Data & AI Podcast

Training and Certification

Learning Overview
Training Overview
Certification
University Alliance
Databricks Academy Login

Events

Data + AI Summit
Data + AI World Tour
Data Intelligence Days
Event Calendar

Blog and Podcasts

Databricks Blog
Databricks Mosaic Research Blog
Data Brew Podcast
Champions of Data & AI Podcast

About

Company

Who We Are
Our Team
Databricks Ventures
Contact Us

Careers

Open Jobs
Working at Databricks

Press

Awards and Recognition
Newsroom

Security and Trust

Company

Who We Are
Our Team
Databricks Ventures
Contact Us

Careers

Open Jobs
Working at Databricks

Press

Awards and Recognition
Newsroom

Databricks Inc.
160 Spear Street, 15th Floor
San Francisco, CA 94105
1-866-330-0121

See Careers
at Databricks

© Databricks 2025. All rights reserved. Apache, Apache Spark, Spark, the Spark Logo, Apache Iceberg, Iceberg, and the Apache Iceberg logo are trademarks of the Apache Software Foundation.

Privacy Notice
Terms of Use
Modern Slavery Statement
California Privacy
Your Privacy Choices