Lets code Airflow Kubernetes Pod Operator | Deep dive | Part 2
watch first part of Airflow Kubernetes Pod Operator here;
• Deep dive into Airflow Kubernetes Pod...
In this 2nd part tutorial, we will write the code that builds an airflow DAG using KubernetesPodOperator. You will have clear understanding of how this operator works and what are the best practices on sharing data between running containers and airflow/kubernetes environment.
Get the code here;
https://github.com/maxcotec/airflow-o...
simple python app to test on KubernetesPodOperator
https://github.com/maxcotec/k8sPodOp-app
#apacheairflow #maxcoteclearning #maxcotec #kubernetes #kubernetespodoperator
Timeline:
00:00 intro & outline
00:46 python app to containerize
02:01 code repository overview
03:11 spin kubernetes cluster
04:26 write DAG with KPO tasks
07:10 prepare docker image of python app
08:02 write k8s config-map
08:40 build airflow docker image
09:47 deploy airflow via helm chart
11:42 test KPO dag
12:47 test KPO pod access config-maps
14:24 outro
👍 If this video was helpful to you, please don't forget to thumbs-up,
⌨️ leave a comment and
🔗 share with your friends.
⭐ Support our work by hitting that subscribe button.
🔔 hit bell icon to stay alert on more upcoming interesting stuff.
Read our latest technology blog posts on our website
www.maxcotec.com
https://maxcotec.com/blog/top-5-wirel...
https://maxcotec.com/blog/top-20-nft-...
Смотрите видео Lets code Airflow Kubernetes Pod Operator | Deep dive | Part 2 онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь MaxcoTec Learning 10 Январь 2023, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 4,241 раз и оно понравилось 59 людям.