Kubernetes

By Tim van de Keer/ on 23 Oct, 2020

Three Ways to run Airflow on Kubernetes

This post shows how to leverage the power of Kubernetes for Airflow in three different ways.

  • Using the Airflow KubernetesPodOperator from within your DAG’s
  • Using the KubernetesExecutor to run task in your DAG’s natively on Kubernetes
  • Using KEDA (Kubernetes Event Driven Autoscaler) together with Celery

Code examples and a video reference are included!

...

Read more