This is a short interactive guide to asynchronous data processing in Elixir. It uses Livebook to show interactive Elixir snippets that you can run on your own machine.
There are a handful of livebooks in this guide. Using the badges below, you can import them to your computer and run and explore them there. My recommendation is to use the Livebook desktop app that you can find on its website.
In this livebook we talk about the basics of processes and message passing.
Here, we talk about the Task
abstraction that ships in Elixir's standard
library.
GenStage is an Elixir library maintained by the Elixir core team. It lets you build pipelines of stages through which events flow.
Flow is another Elixir library maintained by the core team. It builds on top
of GenStage to provide an API similar to Enum
and Stream
, but for parallel
data processing.
Broadway lets you build declarative data ingestion and processing pipelines. It supports several sources (RabbitMQ, Kafka, AWS SQS, and more).
See the license file.