Projects

Full

Compact

Table

Bugfix forks are hidden

wpcrawler

0.0
No release in over 3 years
wpcrawlerHomepageDocumentation
A simple crawler that gets posts and pages from wordpress websites that have an exposed api
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
2,015
 Releases
Current version
0.0.1
Total releases
1
First release
2020-01-22
Latest release
2020-01-22
 Activity
Reverse Dependencies
0
Show more project detailsCompare

restaurant_crawler

0.0
Repository is archived
No commit activity in last 3 years
No release in over 3 years
restaurant_crawlermadeindjs/restaurant_crawlerHomepageDocumentationSource CodeBug TrackerWiki
A simply web crawler.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
2,290
Stars
0
Forks
0
Watchers
3
 Releases
Current version
0.1.0
Total releases
1
First release
2017-04-30
Latest release
2017-04-30
 Activity
Average date of last 50 commits
2017-04-30
Reverse Dependencies
0
Show more project detailsCompare

flyerhzm-regexp_crawler

0.0
No release in over 3 years
flyerhzm-regexp_crawlerDocumentation
RegexpCrawler is a Ruby library for crawl data from website using regular expression.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
31,237
 Releases
Current version
0.9.1
Total releases
12
First release
2009-08-02
Latest release
2009-09-14
 Activity
Reverse Dependencies
0
Show more project detailsCompare

event-crawler

0.0
Repository is gone
No release in over 3 years
event-crawlerHomepageDocumentationSource CodeWiki
Generic Web crawler with a DSL that parses event-related data from web pages
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
4,509
 Releases
Current version
0.1.0
Total releases
1
First release
2011-11-14
Latest release
2011-11-14
 Activity
Reverse Dependencies
0
Show more project detailsCompare

cangrejo

0.0
No commit activity in last 3 years
No release in over 3 years
cangrejoplatanus/cangrejo-gemHomepageDocumentationSource CodeBug TrackerWiki
Cangrejo lets you consume crabfarm crawlers using a simple DSL
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
64,265
Stars
6
Forks
1
Watchers
4
 Releases
Current version
0.2.5
Total releases
24
First release
2015-01-02
Latest release
2016-03-30
 Activity
Issue Closure Rate
33%
Average date of last 50 commits
2015-06-27
Reverse Dependencies
0
Show more project detailsCompare

caule

0.0
No commit activity in last 3 years
No release in over 3 years
caulerafaelss/cauleHomepageDocumentationSource CodeBug TrackerWiki
DSL to build crawlers easily
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
4,671
Stars
1
Forks
0
Watchers
2
 Releases
Current version
0.0.1
Total releases
1
First release
2012-04-14
Latest release
2012-04-14
 Activity
Average date of last 50 commits
2012-04-20
Reverse Dependencies
0
Show more project detailsCompare

crawler_rocks

0.0
No release in over 3 years
crawler_rocksDocumentation
a crawler toolkit
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
15,283
 Releases
Current version
0.0.6
Total releases
6
First release
2015-05-29
Latest release
2016-07-21
 Activity
Reverse Dependencies
0
Show more project detailsCompare

crabbs

0.0
Repository is gone
No release in over 3 years
crabbsHomepageDocumentation
A crawler for a single domain web application
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
6,560
 Releases
Current version
0.1.0
Total releases
2
First release
2014-05-18
Latest release
2014-05-18
 Activity
Reverse Dependencies
0
Show more project detailsCompare

embulk-filter-crawler

0.0
No commit activity in last 3 years
No release in over 3 years
embulk-filter-crawlertoyama0919/embulk-filter-crawlerHomepageDocumentationSource CodeBug TrackerWiki
Crawler4J filter plugin for Embulk
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
9,385
Stars
0
Forks
0
Watchers
3
 Releases
Current version
0.1.3
Total releases
4
First release
2016-03-25
Latest release
2016-04-06
 Activity
Average date of last 50 commits
2016-03-28
Reverse Dependencies
0
Show more project detailsCompare

grucrawler

0.0
No commit activity in last 3 years
No release in over 3 years
grucrawlerslava-vishnyakov/grucrawlerHomepageDocumentationSource CodeBug TrackerWiki
Simple crawler using Redis as backend
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
10,386
Stars
0
Forks
0
Watchers
1
 Releases
Current version
0.0.5
Total releases
4
First release
2014-11-18
Latest release
2014-11-18
 Activity
Average date of last 50 commits
2014-11-18
Reverse Dependencies
0
Show more project detailsCompare

harvestman

0.0
No release in over 3 years
harvestmanDocumentation
Lightweight web crawler
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
3,982
 Releases
Current version
0.1.1
Total releases
1
First release
2013-08-28
Latest release
2013-08-28
 Activity
Reverse Dependencies
0
Show more project detailsCompare

horseman

0.0
No release in over 3 years
horsemanHomepageDocumentation
Headless HTTP crawler/scraper
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
18,051
 Releases
Current version
0.0.5
Total releases
5
First release
2012-01-06
Latest release
2012-04-11
 Activity
Reverse Dependencies
0
Show more project detailsCompare

lattes

0.0
Repository is gone
No release in over 3 years
lattesHomepageDocumentation
A crawler and parser to the Currículo Lattes.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
3,450
 Releases
Current version
0.0.1
Total releases
1
First release
2014-04-09
Latest release
2014-04-09
 Activity
Reverse Dependencies
0
Show more project detailsCompare

marmiton_crawler

0.01
Repository is archived
No commit activity in last 3 years
No release in over 3 years
marmiton_crawlermadeindjs/marmiton_crawlerHomepageDocumentationSource CodeBug TrackerWiki
A web scrawler to get a Marmiton's recipe
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
4,683
Stars
6
Forks
3
Watchers
4
 Releases
Current version
1.0.3
Total releases
2
First release
2016-10-09
Latest release
2016-11-28
 Activity
Issue Closure Rate
75%
Pull Request Acceptance Rate
100%
Average date of last 50 commits
2017-09-23
Reverse Dependencies
0
Show more project detailsCompare

manga-crawler

0.0
No commit activity in last 3 years
No release in over 3 years
manga-crawlerthiagokimo/manga-crawlerHomepageDocumentationSource CodeBug TrackerWiki
A gem that collects mangas from websites
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
16,471
Stars
1
Forks
0
Watchers
3
 Releases
Current version
0.2.0
Total releases
5
First release
2013-04-16
Latest release
2013-04-22
 Activity
Pull Request Acceptance Rate
100%
Average date of last 50 commits
2013-07-11
Reverse Dependencies
0
Show more project detailsCompare

rack-pesticide

0.0
No commit activity in last 3 years
No release in over 3 years
rack-pesticidemdippery/rack-pesticideHomepageDocumentationSource CodeBug Tracker
Block crawlers who spam your site with fake HTTP referers
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
3,764
Stars
0
Forks
0
Watchers
2
 Releases
Current version
1.0.5
Total releases
2
First release
2016-09-08
Latest release
2020-11-21
 Activity
Average date of last 50 commits
2016-01-08
Reverse Dependencies
0
Show more project detailsCompare

rack_staging

0.0
No commit activity in last 3 years
No release in over 3 years
rack_stagingglenngillen/rack_stagingHomepageDocumentationSource CodeBug TrackerWiki
Automatically protects your staging app from web crawlers and casual visitors.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
20,519
Stars
6
Forks
2
Watchers
2
 Releases
Current version
0.2.0
Total releases
3
First release
2011-08-14
Latest release
2011-10-08
 Activity
Issue Closure Rate
50%
Pull Request Acceptance Rate
50%
Average date of last 50 commits
2011-11-08
Reverse Dependencies
0
Show more project detailsCompare

rcrawl

0.0
No release in over 3 years
rcrawlHomepageDocumentation
A web crawler written in ruby
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
31,813
 Releases
Current version
0.5.1
Total releases
9
First release
2006-09-20
Latest release
2006-10-06
 Activity
Reverse Dependencies
0
Show more project detailsCompare

rdig

0.01
No commit activity in last 3 years
No release in over 3 years
rdigjkraemer/rdigHomepageDocumentationSource CodeBug TrackerWiki
Website crawler and fulltext indexer.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
48,278
Stars
17
Forks
4
Watchers
6
 Releases
Current version
0.3.12
Total releases
14
First release
2006-03-25
Latest release
2009-04-25
 Activity
Average date of last 50 commits
2008-07-29
Reverse Dependencies
0
Show more project detailsCompare

rcrawler

0.0
No commit activity in last 3 years
No release in over 3 years
rcrawleri2bskn/rcrawlerHomepageDocumentationSource CodeBug TrackerWiki
The wrapper of capybara for crawler
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
 Popularity
Downloads
8,656
Stars
1
Forks
0
Watchers
3
 Releases
Current version
0.0.3
Total releases
3
First release
2013-07-02
Latest release
2013-07-30
 Activity
Average date of last 50 commits
2013-07-21
Reverse Dependencies
0
Show more project detailsCompare