Lets code Airflow Kubernetes Pod Operator | Deep dive | Part 2
watch first part of Airflow Kubernetes Pod Operator here;
• Deep dive into Airflow Kubernetes Pod...
In this 2nd part tutorial, we will write the code that builds an airflow DAG using KubernetesPodOperator. You will have clear understanding of how this operator works and what are the best practices on sharing data between running containers and airflow/kubernetes environment.
Get the code here;
https://github.com/maxcotec/airflow-o...
simple python app to test on KubernetesPodOperator
https://github.com/maxcotec/k8sPodOp-app
#apacheairflow #maxcoteclearning #maxcotec #kubernetes #kubernetespodoperator
Timeline:
00:00 intro & outline
00:46 python app to containerize
02:01 code repository overview
03:11 spin kubernetes cluster
04:26 write DAG with KPO tasks
07:10 prepare docker image of python app
08:02 write k8s config-map
08:40 build airflow docker image
09:47 deploy airflow via helm chart
11:42 test KPO dag
12:47 test KPO pod access config-maps
14:24 outro
👍 If this video was helpful to you, please don't forget to thumbs-up,
⌨️ leave a comment and
🔗 share with your friends.
⭐ Support our work by hitting that subscribe button.
🔔 hit bell icon to stay alert on more upcoming interesting stuff.
Read our latest technology blog posts on our website
www.maxcotec.com
https://maxcotec.com/blog/top-5-wirel...
https://maxcotec.com/blog/top-20-nft-...
Watch video Lets code Airflow Kubernetes Pod Operator | Deep dive | Part 2 online without registration, duration hours minute second in high quality. This video was added by user MaxcoTec Learning 10 January 2023, don't forget to share it with your friends and acquaintances, it has been viewed on our site 4,241 once and liked it 59 people.