Eric Liang

Senior Staff Engineer at Databricks

Eric is a senior staff engineer at Databricks.

Eric Liang's posts

Are LLM agents good at join order optimization?

AI

April 22, 2026/7 min read

Are LLM agents good at join order optimization?

Automatic Liquid Clustering

Announcements

March 5, 2025/7 min read

Announcing Automatic Liquid Clustering

Announcing Ray support on Databricks and Apache Spark Clusters

Open Source

February 28, 2023/4 min read

Announcing Ray support on Databricks and Apache Spark Clusters

DBCImage1

Announcements

June 14, 2019/4 min read

Databricks Connect: Bringing the capabilities of hosted Apache Spark™ to applications and microservices

Data Intelligence Platforms

Product

May 2, 2018/5 min read

Introducing Databricks Optimized Autoscaling on Apache Spark™

Data Intelligence Platforms

Solutions

June 26, 2017/10 min read

Declarative Infrastructure with the Jsonnet Templating Language

Data Intelligence Platforms

Product

June 7, 2017/8 min read

Databricks Serverless: Next Generation Resource Management for Apache Spark

Data Intelligence Platforms

Platform

May 31, 2017/6 min read

Transactional Writes to Cloud Storage on Databricks

Data Intelligence Platforms

Open Source

April 1, 2017/7 min read

Next Generation Physical Planning in Apache Spark

Data Intelligence Platforms

Open Source

December 15, 2016/8 min read

Scalable Partition Handling for Cloud-Native Architecture in Apache Spark 2.1

Data Intelligence Platforms

Product

August 30, 2016/5 min read

Notebook Workflows: The Easiest Way to Implement Apache Spark Pipelines

Engineering blog

Data Science and ML

October 5, 2015/5 min read

Generalized Linear Models in SparkR and R Formula Support in MLlib