Building an ETL Pipeline in Python | ETL Pipeline for Web Scraping | Naukri Learning
Web Scraping can be a complicated and slow process. But it can be a useful one and can capitalize on parallel processing either with multiple processor threads or distributing scraping requests. Extract, Transform & Load (ETL) pipelines also help to achieve the same.
ETL includes a set of processes that include gathering data from various sources, transforming it, and then storing it into a new single data warehouse. This data warehouse can be accessed by data analysts and data scientists to perform data science tasks, such as data visualization, statistical analysis, ML modeling and front-end app development.
In this tutorial, you will learn how to build a web scraping ETL pipeline in Python using multithreading. The process includes scraping multiple pages, performing transformations on the fetched data and loading the same to a SQL database.
------------------------------------------------------------------------------------
About Naukri Learning
Naukri Learning helps you discover, search & compare online courses to choose the best of the lot for your professional growth. We are constantly working to bring you a carefully curated list of courses and certifications from leading course providers & universities, so you can fulfil your career ambitions through continuous upskilling.
Visit us at https://www.naukri.com/learning/
-------------------------------------------------
Follow us on:
LinkedIn
/ naukri-learning
Facebook - / naukrilearning
Like, share & subscribe to stay tuned with more learning content
#pythonprojects #webscraping #python
Watch video Building an ETL Pipeline in Python | ETL Pipeline for Web Scraping | Naukri Learning online without registration, duration hours minute second in high quality. This video was added by user Shiksha Online 29 August 2022, don't forget to share it with your friends and acquaintances, it has been viewed on our site 12,616 once and liked it 72 people.