How To Web Scrape with Python (even sites that block you!)

Published: 19 September 2024
on channel: Unconventional Coding
5,383
305

In this video I show you two ways for scraping websites using Python. I cover the Requests library, Playwright and how to set a custom user agent. I also show two ways of parsing HTML data: the "king of splits" method and the BeautifulSoup method

Support: https://buymeacoffee.com/unconv
Consultations: https://www.buymeacoffee.com/unconv/e...
Memberships: https://www.buymeacoffee.com/unconv/m...

00:00 Fetching HTML with Python requests
03:02 Bypassing blocks
11:02 King of Splits method
19:33 Beautiful Soup method
25:17 Scraping job listings into JSON


Watch video How To Web Scrape with Python (even sites that block you!) online without registration, duration hours minute second in high quality. This video was added by user Unconventional Coding 19 September 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 5,383 once and liked it 305 people.