Challenges in Data Cleaning and Transformation: Mistakes, Confusion, ...｜Iris Chen｜PyCon Taiwan 2023
PyCon Taiwan 2023｜Talk 演講｜Day 1, R2 11:35–12:05
🪄 說明 Description 🪄
Data cleaning and transformation are critical steps in any data-related project, including data analysis, machine learning, and business intelligence. However, these tasks can be challenging due to the various methods available and the lack of standardization in the process. In this speech, I will discuss the specific challenges I faced while cleaning and transforming video metadata. I will also introduce some solutions that I have found helpful in my work, such as the use of systematic data cleaning processes like Data Build Tool(DBT) and data pipeline quality monitoring tools like PipeRider. By combining these tools and techniques, we can improve the efficiency and reliability of data transformation and enhance the overall data application process. The goal of this speech is to show how DBT and PipeRider can help create a more efficient, scalable, and error-free data transformation pipeline.
🪧 投影片 Slides：https://docs.google.com/presentation/...
🚀 講者介紹 About Speaker - Iris Chen 🚀
As a fresh graduate stepping into the professional world, I am filled with enthusiasm for every aspect of data.
Follow “PyCon Taiwan”
⭐️ Official Website: https://tw.pycon.org
⭐️ Facebook: / pycontw
⭐️ Instagram: / pycontw
⭐️ Twitter: / pycontw
⭐️ LinkedIn: / pycontw
⭐️ Blogger: https://conf.python.tw/
Смотрите видео Challenges in Data Cleaning and Transformation: Mistakes, Confusion, ...｜Iris Chen｜PyCon Taiwan 2023 онлайн без регистрации, длительностью часов минут секунд в хорошем качестве. Это видео добавил пользователь PyCon Taiwan 22 Ноябрь 2023, не забудьте поделиться им ссылкой с друзьями и знакомыми, на нашем сайте его посмотрели 153 раз и оно понравилось 0 людям.