Crawler for LinkedIn public profiles. To install- gem install requestmanager gem install generalscraper gem install linkedincrawler To run- requests_linkedin = RequestManager.new("path/to/proxies", [min wait, max wait], # of browsers) requests_google = RequestManager.new("path/to/proxies", [min wait, max wait], # of browsers) requests_google2 = RequestManager.new("path/to/proxies", [min wait, max wait], # of browsers) c = LinkedinCrawler.new("search terms", max retry #, requests_linkedin, requests_google, requests_google2, solver_details hash or nil, cm_hash) c.search puts c.gen_json (to print the json)
Project
requestmanager
Manages proxies, wait intervals, etc
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
Development
Dependencies
Project Readme