Scraping LinkedIn Jobs with Python Scrapy (2022)
In this video, we look at how you can scrape LinkedIn job data using Python Scrapy. We look at how to use Scrapy and a proxy to find the jobs for a specific search term and location (eg. Python and United States) and then parse the associated job/company data.
The article that goes along with this video:
https://scrapeops.io/python-scrapy-pl...
Basic Scrapy project used in this tutorial:
https://github.com/python-scrapy-play...
Completed Scrapy Project which you can just download and run (after adding your account details!!): https://github.com/python-scrapy-play...
Link to the ScrapeOps proxy: https://scrapeops.io/proxy-aggregator/
The proxy python library: https://pypi.org/project/scrapeops-sc...
00:00 - Intro
00:44 - Understanding the LinkedIn jobs search page
05:57 - Setting up a basic spider
07:59 - Setting up a proxy to by-pass LinkedIn restrictions (anti-bots)
10:15 - Writing our spider code
22:25 - Running our spider
24:38 - Outro
Watch video Scraping LinkedIn Jobs with Python Scrapy (2022) online without registration, duration hours minute second in high quality. This video was added by user ScrapeOps 09 January 2023, don't forget to share it with your friends and acquaintances, it has been viewed on our site 17,992 once and liked it 317 people.