Scrapy Splash: How to scrape JS rendered websites (2022)
In this project, we use Scrapy Splash to scrape javascript rendered websites.
Link to the project on github: https://github.com/python-scrapy-play...
The in-depth article with the code snippets we use in the video: https://scrapeops.io/python-scrapy-pl...
Chapters:
00:00 - Intro
01:33 - Installing Scrapy Splash
02:25 - Running Scrapy Splash docker image
03:30 - Installing Scrapy project & python packages
04:30 - Adding Scrapy splash settings
05:18 - Adding Scrapy spider code
06:30 - Running the spider
07:44 - Adding in a wait (for page to load)
09:20 - Wait for page to load with lua script
11:11 - Scroll down a page using a lua script
13:40 - How to click elements on the page using lua script
17:22 - How to take a screenshot of a page with Scrapy Splash
19:16 - How to run javascript code with Scrapy Splash
21:42 - Outro
Watch video Scrapy Splash: How to scrape JS rendered websites (2022) online without registration, duration hours minute second in high quality. This video was added by user ScrapeOps 14 September 2022, don't forget to share it with your friends and acquaintances, it has been viewed on our site 11,239 once and liked it 148 people.