Building Data Pipelines on Apache NiFi with Python｜Shuhsi Lin｜PyCon TW 2019
PyCon Taiwan 2019｜一般演講 Talks
🪧 投影片 Slides：https://speakerdeck.com/sucitw/buildi...
💡 摘要 Abstract 💡
In today's big data world, the data you need to analyze comes from diverse sources in a variety of different formats. Combining all that data and reconciling it is incredibly difficult. Based on your need, adopting a proper and manageable ETL tool can make data integration easier. An open source project, Apache NiFi, is a tool to built to automate and manage the flow of data between systems. You can use NiFi to build streaming data pipelines between different data-related systems, including Apache Kafka and Apache Spark, various RDBS, and so much more! In this talk, I will start with introducing a concept of ETL and Apache NiFi, what it can solve, and how to use Python to enable NiFi's ability. Then, a sample demo will help you to understand how to build a streaming data pipeline with NiFi.
🚀 關於講者 About Speaker - Shuhsi Lin 🚀
A data engineer and Python programmer. Currently working on various data applications in a manufacturing company.
Research interests: IoT applications, data streaming processing, data analysis and data visualization.
#python #pycontw #pycontw2019
Follow “PyCon Taiwan”
⭐️ Official Website: https://tw.pycon.org
⭐️ Facebook: / pycontw
⭐️ Instagram: / pycontw
⭐️ Twitter: / pycontw
⭐️ LinkedIn: / pycontw
⭐️ Blogger: https://pycontw.blogspot.com
Смотрите видео Building Data Pipelines on Apache NiFi with Python｜Shuhsi Lin｜PyCon TW 2019 онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь PyCon Taiwan 03 Ноябрь 2019, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 3,239 раз и оно понравилось 27 людям.