Projects

Full

Compact

Table

Bugfix forks are hidden

jpstock-crawler

0.0
No commit activity in last 3 years
No release in over 3 years
jpstock-crawlerkenkiti/jpstock-crawlerHomepageDocumentationSource CodeBug TrackerWiki
株価情報を取得してあれこれするライブラリ
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
3,420
Stars
0
Forks
1
Watchers
1
 Releases
Current version
0.0.0
Total releases
1
First release
2014-03-28
Latest release
2014-03-28
 Activity
Average date of last 50 commits
2014-03-28
Reverse Dependencies
0
Show more project detailsCompare

middleman-crawler

0.0
No commit activity in last 3 years
No release in over 3 years
middleman-crawlerwelaika/middleman-crawlerHomepageDocumentationSource CodeBug TrackerWiki
it starts a crawler for Middleman sites
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
5,335
Stars
4
Forks
1
Watchers
3
 Releases
Current version
0.0.2
Total releases
2
First release
2016-07-05
Latest release
2016-07-05
 Activity
Average date of last 50 commits
2016-11-12
Reverse Dependencies
0
Show more project detailsCompare

recipe_crawler

0.0
Repository is archived
No commit activity in last 3 years
No release in over 3 years
recipe_crawlermadeindjs/recipe_crawlerHomepageDocumentationSource CodeBug TrackerWiki
This crawler will use my personnal scraper named 'RecipeScraper' to dowload recipes data from Marmiton, 750g or cuisineaz
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
12,379
Stars
0
Forks
1
Watchers
3
 Releases
Current version
4.0.0
Total releases
7
First release
2016-11-29
Latest release
2018-12-08
 Activity
Issue Closure Rate
33%
Average date of last 50 commits
2017-02-01
Reverse Dependencies
0
Show more project detailsCompare

botch

0.0
No commit activity in last 3 years
No release in over 3 years
botchnamusyaka/botchHomepageDocumentationSource CodeBug TrackerWiki
Botch is a DSL for quickly creating web crawlers. Inspired by Sinatra.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
20,630
Stars
4
Forks
1
Watchers
3
 Releases
Current version
0.1.5
Total releases
6
First release
2013-07-14
Latest release
2013-08-08
 Activity
Issue Closure Rate
100%
Pull Request Acceptance Rate
100%
Average date of last 50 commits
2013-07-22
Reverse Dependencies
0
Show more project detailsCompare

kudzu

0.0
Low commit activity in last 3 years
A long-lived project that still receives updates
kudzukanety/kudzuHomepageDocumentationSource CodeBug TrackerWiki
A simple web crawler for ruby
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
26,027
Stars
1
Forks
1
Watchers
3
 Releases
Current version
1.3.1
Total releases
16
First release
2017-12-20
Latest release
2023-06-23
 Activity
Issue Closure Rate
100%
Pull Request Acceptance Rate
89%
Average date of last 50 commits
2020-01-19
Reverse Dependencies
1
Show more project detailsCompare

rsocial

0.0
No commit activity in last 3 years
No release in over 3 years
rsocialadvectus/rsocialHomepageDocumentationSource CodeBug TrackerWiki
A ruby social media stat crawler
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
19,423
Stars
2
Forks
1
Watchers
2
 Releases
Current version
3.6.0
Total releases
10
First release
2016-08-24
Latest release
2017-11-01
 Activity
Average date of last 50 commits
2016-10-29
Reverse Dependencies
0
Show more project detailsCompare

sledgehammer

0.0
No commit activity in last 3 years
No release in over 3 years
sledgehammergrowthrepublic/sledgehammerHomepageDocumentationSource CodeBug TrackerWiki
Website crawler harvesting e-mails. Uses Sidekiq and Typhoeus.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
3,298
Stars
3
Forks
1
Watchers
2
 Releases
Current version
0.1.0
Total releases
1
First release
2014-07-10
Latest release
2014-07-10
 Activity
Issue Closure Rate
25%
Average date of last 50 commits
2014-07-09
Reverse Dependencies
0
Show more project detailsCompare

wriggle

0.01
No commit activity in last 3 years
No release in over 3 years
wriggletsigo/wriggleHomepageDocumentationSource CodeBug Tracker
A simple directory crawler DSL.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
14,059
Stars
26
Forks
1
Watchers
2
 Releases
Current version
1.3.0
Total releases
4
First release
2010-10-09
Latest release
2011-03-09
 Activity
Average date of last 50 commits
2011-08-02
Reverse Dependencies
0
Show more project detailsCompare

bot_detection

0.0
No commit activity in last 3 years
No release in over 3 years
bot_detectionsumy/bot_detectionHomepageDocumentationSource CodeBug TrackerWiki
Checks a user agent for a web crawler
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
31,510
Stars
2
Forks
1
Watchers
3
 Releases
Current version
1.0.9
Total releases
11
First release
2014-08-01
Latest release
2015-11-03
 Activity
Issue Closure Rate
0%
Average date of last 50 commits
2014-12-28
Reverse Dependencies
0
Show more project detailsCompare

booking-com-crawler

0.0
No commit activity in last 3 years
No release in over 3 years
booking-com-crawlerelsoul/booking-com-crawlerHomepageDocumentationSource CodeBug TrackerWiki
Empower World Travel Information Technology
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
1,823
Stars
0
Forks
1
Watchers
2
 Releases
Current version
0.1.0
Total releases
1
First release
2020-08-03
Latest release
2020-08-03
 Activity
Average date of last 50 commits
2020-08-03
Reverse Dependencies
0
Show more project detailsCompare

browser_crawler

0.0
No commit activity in last 3 years
No release in over 3 years
There's a lot of open issues
browser_crawlerdimasamodurov/browser_crawlerHomepageDocumentationSource CodeBug TrackerWiki
Simple site crawler using Capybara
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
4,174
Stars
0
Forks
1
Watchers
4
 Releases
Current version
0.4.1
Total releases
2
First release
2019-08-23
Latest release
2020-05-13
 Activity
Issue Closure Rate
66%
Pull Request Acceptance Rate
95%
Average date of last 50 commits
2019-05-28
Reverse Dependencies
0
Show more project detailsCompare

rumba-crawler

0.0
No commit activity in last 3 years
No release in over 3 years
rumba-crawlervladnik/rumba-crawlerDocumentationSource CodeBug TrackerWiki
Web crawler with JSON-based DSL and EventMachine-powered page fetching
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
3,578
Stars
0
Forks
0
Watchers
2
 Releases
Current version
0.1
Total releases
1
First release
2013-06-10
Latest release
2013-06-10
 Activity
Average date of last 50 commits
2013-05-31
Reverse Dependencies
0
Show more project detailsCompare

current-price

0.0
No commit activity in last 3 years
No release in over 3 years
current-priceadvectus/current-priceHomepageDocumentationSource CodeBug TrackerWiki
A ruby stock price & option chain crawler
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
6,479
Stars
1
Forks
0
Watchers
2
 Releases
Current version
0.3.0
Total releases
3
First release
2016-09-10
Latest release
2016-09-11
 Activity
Average date of last 50 commits
2016-09-11
Reverse Dependencies
0
Show more project detailsCompare

embulk-filter-crawler

0.0
No commit activity in last 3 years
No release in over 3 years
embulk-filter-crawlertoyama0919/embulk-filter-crawlerHomepageDocumentationSource CodeBug TrackerWiki
Crawler4J filter plugin for Embulk
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
9,385
Stars
0
Forks
0
Watchers
3
 Releases
Current version
0.1.3
Total releases
4
First release
2016-03-25
Latest release
2016-04-06
 Activity
Average date of last 50 commits
2016-03-28
Reverse Dependencies
0
Show more project detailsCompare

grucrawler

0.0
No commit activity in last 3 years
No release in over 3 years
grucrawlerslava-vishnyakov/grucrawlerHomepageDocumentationSource CodeBug TrackerWiki
Simple crawler using Redis as backend
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
10,386
Stars
0
Forks
0
Watchers
1
 Releases
Current version
0.0.5
Total releases
4
First release
2014-11-18
Latest release
2014-11-18
 Activity
Average date of last 50 commits
2014-11-18
Reverse Dependencies
0
Show more project detailsCompare

iron-crawler

0.0
No commit activity in last 3 years
No release in over 3 years
iron-crawlernoqcks/iron-crawlerHomepageDocumentationSource CodeBug TrackerWiki
A generic web crawler that doesn't crawl outside URLs.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
14,679
Stars
1
Forks
0
Watchers
2
 Releases
Current version
1.2.1
Total releases
7
First release
2016-02-07
Latest release
2016-02-08
 Activity
Average date of last 50 commits
2016-02-07
Reverse Dependencies
0
Show more project detailsCompare

bankcrawlers-hapoalim

0.0
No commit activity in last 3 years
No release in over 3 years
bankcrawlers-hapoalimjoaomilho/bank-crawlers-hapoalimHomepageDocumentationSource CodeBug TrackerWiki
A crappy crawler for a crappy bank interface
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
6,649
Stars
4
Forks
0
Watchers
1
 Releases
Current version
0.0.8
Total releases
2
First release
2014-04-07
Latest release
2015-04-04
 Activity
Average date of last 50 commits
2014-04-11
Reverse Dependencies
0
Show more project detailsCompare

rack-pesticide

0.0
No commit activity in last 3 years
No release in over 3 years
rack-pesticidemdippery/rack-pesticideHomepageDocumentationSource CodeBug Tracker
Block crawlers who spam your site with fake HTTP referers
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
3,764
Stars
0
Forks
0
Watchers
2
 Releases
Current version
1.0.5
Total releases
2
First release
2016-09-08
Latest release
2020-11-21
 Activity
Average date of last 50 commits
2016-01-08
Reverse Dependencies
0
Show more project detailsCompare

creepy-crawler

0.0
No commit activity in last 3 years
No release in over 3 years
creepy-crawlerudryan10/creepy-crawlerHomepageDocumentationSource CodeBug TrackerWiki
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
6,595
Stars
5
Forks
0
Watchers
1
 Releases
Current version
1.0.2
Total releases
2
First release
2014-05-10
Latest release
2014-05-10
 Activity
Average date of last 50 commits
2014-05-07
Reverse Dependencies
0
Show more project detailsCompare

refract

0.0
No commit activity in last 3 years
No release in over 3 years
refractnvreynolds/refractHomepageDocumentationSource CodeBug TrackerWiki
Crawler that auto generates SitePrism Page Objects
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
5,099
Stars
0
Forks
0
Watchers
2
 Releases
Current version
0.0.2
Total releases
3
First release
2017-04-30
Latest release
2019-01-05
 Activity
Issue Closure Rate
100%
Average date of last 50 commits
2017-12-02
Reverse Dependencies
0
Show more project detailsCompare