Data Pipelines using Airflow on Kubernetes
Airflow is an opensource platform to create, schedule and monitor workflows. In this talk we will explore - What is airflow? - How to create data pipelines? - How to exploit kubernetes to achieve perf
Airflow is an opensource platform to create, schedule and monitor workflows. In this talk we will explore - What is airflow? - How to create data pipelines? - How to exploit kubernetes to achieve performance - Pros and cons of the approach
Blog Post
Checkout the step by step implementation
Slides
Video
Last updated