Scraping LinkedIn Profiles with Python Scrapy (2022)
In this video, we look at how you can scrape LinkedIn profiles using Python Scrapy. We look at how to use Scrapy and a proxy to find the profile for a specific person and then parse the associated profile data, education, job experience etc.
The article that goes along with this video:
https://scrapeops.io/python-scrapy-pl...
Basic Scrapy project used in this tutorial:
https://github.com/python-scrapy-play...
Completed Scrapy Project which you can just download and run (after adding your account details!!): https://github.com/python-scrapy-play...
Link to the ScrapeOps proxy: https://scrapeops.io/proxy-aggregator/
The proxy python library: https://pypi.org/project/scrapeops-sc...
00:00 - Intro
00:44 - Understanding LinkedIn & profile pages
03:35 - Setting up a basic spider
04:40 - Setting up a proxy to by-pass LinkedIn restrictions (anti-bots)
07:05 - Writing our spider code
19:27 - Running our spider
22:40 - Outro
Watch video Scraping LinkedIn Profiles with Python Scrapy (2022) online without registration, duration hours minute second in high quality. This video was added by user ScrapeOps 06 December 2022, don't forget to share it with your friends and acquaintances, it has been viewed on our site 37,991 once and liked it 503 people.