0.0
a crawler toolkit
2021
2022
2023
2024
2025
2026
0.0
A very simple crawler for RubyGems.org used to demo the power of ElasticSearch at RubyConf 2013
2021
2022
2023
2024
2025
2026
0.0
A crappy crawler for crashlytics
2021
2022
2023
2024
2025
2026
0.0
The Baidu Crawler is to crawl data with your demmand
2021
2022
2023
2024
2025
2026
0.0
web crawler that generates a sitemap to a neo4j database. It will also store broken_links and total number of pages on site
2021
2022
2023
2024
2025
2026
0.0
Web crawler help you with parse and collect data from the web
2021
2022
2023
2024
2025
2026
0.0
Crawler for downloading comics from komiks.gildia.pl
2021
2022
2023
2024
2025
2026
0.0
This file crawler helps to decect if there are new files in a directory.
2021
2022
2023
2024
2025
2026
0.0
Crawler for http://legendas.tv to see the most dowloaded subtitles
2021
2022
2023
2024
2025
2026
0.0
Simple site crawler using Capybara
2021
2022
2023
2024
2025
2026
0.0
Retrieves a list of URLs to seed the crawler by publishing them to a RabbitMQ exchange.
2021
2022
2023
2024
2025
2026
0.0
Jobs crawler
2021
2022
2023
2024
2025
2026
0.0
it starts a crawler for Middleman sites
2021
2022
2023
2024
2025
2026
0.0
A simple web crawler gem
2021
2022
2023
2024
2025
2026
0.0
Web page crawler.
2021
2022
2023
2024
2025
2026
0.0
Stupid crawler that looks for URLs on a given site. Result is saved as two CSV files one with found URLs and another with failed URLs.
2021
2022
2023
2024
2025
2026
0.0
Email crawler: crawls the top ten Google search results looking for email addresses and exports them to CSV.
2021
2022
2023
2024
2025
2026
0.0
Web crawler with JSON-based DSL and EventMachine-powered page fetching
2021
2022
2023
2024
2025
2026
0.0
A generic web crawler that doesn't crawl outside URLs.
2021
2022
2023
2024
2025
2026
0.0
A simple web crawler gem
2021
2022
2023
2024
2025
2026