0.0
No commit activity in last 3 years
No release in over 3 years
Crawls job listing websites for jobs requiring security clearance.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Dependencies

Development

~> 1.10
~> 10.0

Runtime

 Project Readme

This is a crawler for job listings that require security clearance.

To run-

t = TSJobCrawler.new("search term" (or nil), request_manager, cm_hash or nil)

t.crawl_jobs

For example-

Headless.ly do

r = RequestManager.new(nil, [0, 0], 1)

t = TSJobCrawler.new(nil, r, nil)

t.crawl_jobs

File.write("test.json", t.gen_json)

end

If you input nil for the search term, it downloads as many job listings as possible. Unless you have a lot of RAM, you should run it through Harvester if you want to download as many listings as possible as then you can take advantage of incremental result reporting.