Ingestion

What you’ll learn

With Databricks Auto Loader, you can incrementally and efficiently ingest new batch and real-time streaming data files into your Delta Lake tables as soon as they arrive in your data lake — so that they always contain the most complete and up-to-date data available. Auto Loader is a simple, flexible tool that can be run continuously, or in "triggerOnce" mode to process data in batches. SQL users can use the simple "COPY INTO" command to pull new data into their Delta Lake tables automatically, without the need to keep track of which files have already been processed.

Recommended

demothumb-small-video-ingestion

On-Demand Video

Data Ingestion using Auto Loader

demothumb-small-video-ingestion

On-Demand Video

Get data into Databricks from Kafka

delta live table

On-Demand Video

Streaming Data With Delta Live Tables and Databricks Workflows

Try Databricks free

Test-drive the full Databricks platform free for 14 days

Simplify data ingestion and automate ETL

Collaborate in your preferred language

12x better price/performance than cloud data warehouses

Create your Databricks account
1/2

Sign up with your work email to elevate your trial with expert assistance and more.

Select