HomepageData + AI Summit 2022 Logo
Watch on demand

Elixir: The Wickedly Awesome Batch and Stream Processing Language You Should Have in Your Toolbox

On Demand


  • Session


  • Virtual


  • Data Engineering


  • Intermediate


  • 40 min
Download session slides


Elixir is an Erlang-VM bytecode-compatible programming language that is growing in popularity.

In this session I will show how you can apply Elixir towards solving data engineering problems in novel ways.

Examples include:
• How to leverage Erlang's lightweight distributed process coordination to run clusters of workers across docker containers and perform data ingestion.
• A framework that hooks Elixir functions as steps into Airflow graphs.
• How to consume and process Kafka events directly within Elixir microservices.

For each of the above I'll show real system examples and walk through the key elements step by step. No prior familiarity with Erlang or Elixir will be required.

Session Speakers

Brian Femiano

Data Engineering


See the best of Data+AI Summit

Watch on demand