Projects

Full

Compact

Table

Bugfix forks are hidden

polipus-elasticsearch

0.0
No commit activity in last 3 years
No release in over 3 years
polipus-elasticsearchstefanofontanelli/polipus-elasticsearchHomepageDocumentationSource CodeBug TrackerWiki
Add support for ElasticSearch in Polipus crawler
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
11,761
Stars
1
Forks
2
Watchers
3
 Releases
Current version
0.0.4
Total releases
4
First release
2015-07-17
Latest release
2015-09-14
 Activity
Average date of last 50 commits
2015-08-03
Reverse Dependencies
0
Show more project detailsCompare

otacrawler

0.0
Repository is gone
No release in over 3 years
otacrawlerHomepageDocumentation
This is web comic crawler that Akihabara otaku.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
10,698
 Releases
Current version
0.1.3
Total releases
4
First release
2016-07-12
Latest release
2016-07-31
 Activity
Reverse Dependencies
0
Show more project detailsCompare

pba_crawler

0.0
No release in over 3 years
pba_crawlerDocumentation
Crawl websites
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
19,846
 Releases
Current version
0.0.11
Total releases
6
First release
2011-03-21
Latest release
2011-05-13
 Activity
Reverse Dependencies
0
Show more project detailsCompare

rack-pesticide

0.0
No commit activity in last 3 years
No release in over 3 years
rack-pesticidemdippery/rack-pesticideHomepageDocumentationSource CodeBug Tracker
Block crawlers who spam your site with fake HTTP referers
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
3,764
Stars
0
Forks
0
Watchers
2
 Releases
Current version
1.0.5
Total releases
2
First release
2016-09-08
Latest release
2020-11-21
 Activity
Average date of last 50 commits
2016-01-08
Reverse Dependencies
0
Show more project detailsCompare

rack_staging

0.0
No commit activity in last 3 years
No release in over 3 years
rack_stagingglenngillen/rack_stagingHomepageDocumentationSource CodeBug TrackerWiki
Automatically protects your staging app from web crawlers and casual visitors.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
20,519
Stars
6
Forks
2
Watchers
2
 Releases
Current version
0.2.0
Total releases
3
First release
2011-08-14
Latest release
2011-10-08
 Activity
Issue Closure Rate
50%
Pull Request Acceptance Rate
50%
Average date of last 50 commits
2011-11-08
Reverse Dependencies
0
Show more project detailsCompare

rcrawler

0.0
No commit activity in last 3 years
No release in over 3 years
rcrawleri2bskn/rcrawlerHomepageDocumentationSource CodeBug TrackerWiki
The wrapper of capybara for crawler
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
8,656
Stars
1
Forks
0
Watchers
3
 Releases
Current version
0.0.3
Total releases
3
First release
2013-07-02
Latest release
2013-07-30
 Activity
Average date of last 50 commits
2013-07-21
Reverse Dependencies
0
Show more project detailsCompare

recluse

0.0
No commit activity in last 3 years
No release in over 3 years
recluseczycha/recluseHomepageDocumentationSource CodeBug TrackerWiki
Friendly, neighborhood web crawler for quality assurance.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
7,338
Stars
1
Forks
0
Watchers
3
 Releases
Current version
2.0.0
Total releases
4
First release
2017-02-27
Latest release
2017-03-28
 Activity
Issue Closure Rate
0%
Average date of last 50 commits
2016-10-23
Reverse Dependencies
0
Show more project detailsCompare

refract

0.0
No commit activity in last 3 years
No release in over 3 years
refractnvreynolds/refractHomepageDocumentationSource CodeBug TrackerWiki
Crawler that auto generates SitePrism Page Objects
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
5,099
Stars
0
Forks
0
Watchers
2
 Releases
Current version
0.0.2
Total releases
3
First release
2017-04-30
Latest release
2019-01-05
 Activity
Issue Closure Rate
100%
Average date of last 50 commits
2017-12-02
Reverse Dependencies
0
Show more project detailsCompare

crawler_guru

0.0
Repository is gone
No release in over a year
crawler_guruHomepageDocumentationSource Code
Crawler Guru provides all basic functionalities to extract data from web pages
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
1,851
 Releases
Current version
0.1.0
Total releases
1
First release
2021-09-03
Latest release
2021-09-03
 Activity
Reverse Dependencies
0
Show more project detailsCompare

sengi

0.0
Repository is archived
No commit activity in last 3 years
No release in over 3 years
There's a lot of open issues
sengithefox/sengiHomepageDocumentationSource CodeBug TrackerWiki
A web crawler using Ruby and Redis.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
3,154
Stars
0
Forks
0
Watchers
3
 Releases
Current version
0.1.0
Total releases
1
First release
2016-05-07
Latest release
2016-05-07
 Activity
Issue Closure Rate
71%
Average date of last 50 commits
2016-06-10
Reverse Dependencies
0
Show more project detailsCompare

sesc

0.0
Repository is archived
No commit activity in last 3 years
No release in over 3 years
sescfernandopso/sescHomepageDocumentationSource CodeBug TrackerWiki
A simple crawler to list SESC events schedule on Terminal
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
5,832
Stars
1
Forks
0
Watchers
2
 Releases
Current version
0.1.10
Total releases
2
First release
2017-11-05
Latest release
2017-11-05
 Activity
Pull Request Acceptance Rate
100%
Average date of last 50 commits
2018-02-02
Reverse Dependencies
0
Show more project detailsCompare

simple-news-crawler

0.0
No release in over 3 years
simple-news-crawlerHomepageDocumentation
A simple news crawler. You can specify the structure of your xml or rss feeds.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
7,663
 Releases
Current version
1.0.3
Total releases
3
First release
2014-10-10
Latest release
2014-10-10
 Activity
Reverse Dependencies
0
Show more project detailsCompare

sledgehammer

0.0
No commit activity in last 3 years
No release in over 3 years
sledgehammergrowthrepublic/sledgehammerHomepageDocumentationSource CodeBug TrackerWiki
Website crawler harvesting e-mails. Uses Sidekiq and Typhoeus.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
3,298
Stars
3
Forks
1
Watchers
2
 Releases
Current version
0.1.0
Total releases
1
First release
2014-07-10
Latest release
2014-07-10
 Activity
Issue Closure Rate
25%
Average date of last 50 commits
2014-07-09
Reverse Dependencies
0
Show more project detailsCompare

suitoru

0.0
No commit activity in last 3 years
No release in over 3 years
suitorumyokoym/suitoruHomepageDocumentationSource CodeBug TrackerWiki
A crawler for such as mailing lists.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
2,819
Stars
0
Forks
0
Watchers
2
 Releases
Current version
0.1.0
Total releases
1
First release
2016-01-26
Latest release
2016-01-26
 Activity
Average date of last 50 commits
2016-01-26
Reverse Dependencies
0
Show more project detailsCompare

vrowser

0.0
No commit activity in last 3 years
No release in over 3 years
vrowserkimoto/vrowserHomepageDocumentationSource CodeBug TrackerWiki
Server browser and Crawler for many games (L4D2, TF2, CS:S, KZMOD, The Ship)
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
45,158
Stars
2
Forks
0
Watchers
2
 Releases
Current version
0.1.5
Total releases
15
First release
2012-02-05
Latest release
2012-03-12
 Activity
Average date of last 50 commits
2012-02-09
Reverse Dependencies
0
Show more project detailsCompare

watir_crawler

0.0
No release in over 3 years
watir_crawlerDocumentation
A watir based web crawler
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
6,184
 Releases
Current version
0.0.2
Total releases
2
First release
2014-01-21
Latest release
2014-01-22
 Activity
Reverse Dependencies
0
Show more project detailsCompare

webcream

0.0
Repository is gone
No release in over 3 years
webcreamHomepageDocumentation
A web crawler dsl.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
3,690
 Releases
Current version
0.0.1
Total releases
1
First release
2013-06-11
Latest release
2013-06-11
 Activity
Reverse Dependencies
0
Show more project detailsCompare

zhSieve

0.0
No commit activity in last 3 years
No release in over 3 years
zhSievegwzz/zhsieveHomepageDocumentationSource CodeBug TrackerWiki
A ruby based zhihu content crawler.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
2,572
Stars
1
Forks
0
Watchers
1
 Releases
Current version
0.2.0
Total releases
1
First release
2016-11-04
Latest release
2016-11-04
 Activity
Average date of last 50 commits
2016-10-31
Reverse Dependencies
0
Show more project detailsCompare

iudex-barc

0.0
No release in over 3 years
iudex-barcHomepageDocumentation
Iudex is a general purpose web crawler and feed processor in ruby/java. The iudex-barc gem contains support for the BARC Basic ARChive format.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
26,466
 Releases
Current version
1.7.0
Total releases
10
First release
2011-04-04
Latest release
2018-10-29
 Activity
Reverse Dependencies
1
Show more project detailsCompare

iudex-char-detector

0.0
No release in over 3 years
iudex-char-detectorHomepageDocumentation
Iudex is a general purpose web crawler and feed processor in ruby/java. The iudex-char-detector gem provides charset detection support.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
17,176
 Releases
Current version
1.4.0
Total releases
6
First release
2011-11-13
Latest release
2015-05-04
 Activity
Reverse Dependencies
1
Show more project detailsCompare