Ingestion
Type
On-Demand Video
Duration
2 minutes
Related Content
What you’ll learn
With Databricks Auto Loader, you can incrementally and efficiently ingest new batch and real-time streaming data files into your Delta Lake tables as soon as they arrive in your data lake — so that they always contain the most complete and up-to-date data available. Auto Loader is a simple, flexible tool that can be run continuously, or in "triggerOnce" mode to process data in batches. SQL users can use the simple "COPY INTO" command to pull new data into their Delta Lake tables automatically, without the need to keep track of which files have already been processed.
Try Databricks free
Test-drive the full Databricks platform free for 14 days
Simplify data ingestion and automate ETL
Ingest data from hundreds of sources. Use a simple declarative approach to build data pipelines.
Collaborate in your preferred language
Code in Python, R, Scala and SQL with coauthoring, automatic versioning, Git integrations and RBAC.
12x better price/performance than cloud data warehouses
See why over 9,000 customers worldwide rely on Databricks for all their workloads from BI to AI.