We will start by introducing Airflow and its main infrastructure components. The focus will then be put on orchestration of data products with Airflow and the different stages that are necessary from ingestion, transformation and distribution of data.
Orchestrating data product with Airflow
Having a standard and replicable approach to scale your orchestration
All this will be covered with concrete use cases through live coding and live demos. Advanced techniques to host Airflow on mainstream providers and to use Kubernetes to run tasks will also be covered.
Orchestrating data product with Airflow
Gratis webinar via Zoom
23/11/2023 09:00
Orchestrating data product with Airflow
Gratis webinar via Zoom
23/11/2023 09:00
- main concepts of Airflow
- how to run Airflow 2.6 locally
- how to run Airflow on a Cloud Provider and a taste of a few fully managed options
Wat je leert
- the main stages that are required to orchestrate a data pipeline in Airflow
- concrete hands-on experience with a dummy repo consisting of two data products containing few transformations in dbt
- Airflow UI and how to navigate seamlessly through it
Over de trainer
Passionate about business, education and technology in general, Charles has an international experience after having worked and lived for long periods in Mexico, Congo and various cities around Europe.
He started working as a data engineer in 2017 and since then has become an avid coder, passionate architect and data guru. His mix of soft and hard skills give him the ability to switch between leadership and technical roles when required.
Schrijf in
"*" geeft vereiste velden aan