0.01
Website crawler and fulltext indexer.
2021
2022
2023
2024
2025
2026
0.01
A simple directory crawler DSL.
2021
2022
2023
2024
2025
2026
0.01
Cosmicrawler is crawler library for Ruby. It provides scalable asynchronous crawling by (http|file|etc) using EventMachine.
2021
2022
2023
2024
2025
2026
0.01
render_static allows you to make your single-page apps (Backbone, Angular, etc) built on Rails SEO-friendly. It works by injecting a small rack middleware that will render pages as plain html, when the requester is one of the most common crawlers/bots out there (Google, Yahoo Baidu and Bing)
2021
2022
2023
2024
2025
2026
0.01
This is a crawler framework.
2021
2022
2023
2024
2025
2026
0.01
JavaScript enabled web crawler kit
2021
2022
2023
2024
2025
2026
0.01
A simple, fast web crawler
2021
2022
2023
2024
2025
2026
0.0
Friendly, neighborhood web crawler for quality assurance.
2021
2022
2023
2024
2025
2026
0.0
Add support for Cassandra in Polipus crawler
2021
2022
2023
2024
2025
2026
0.0
Ruby Web crawler
2021
2022
2023
2024
2025
2026
0.0
A ruby social media stat crawler
2021
2022
2023
2024
2025
2026
0.0
Crawl websites
2021
2022
2023
2024
2025
2026
0.0
This is web comic crawler that Akihabara otaku.
2021
2022
2023
2024
2025
2026
0.0
A simple crawler to list SESC events schedule on Terminal
2021
2022
2023
2024
2025
2026
0.0
Add support for ElasticSearch in Polipus crawler
2021
2022
2023
2024
2025
2026
0.0
A Crawler for NewRank
2021
2022
2023
2024
2025
2026
0.0
Server browser and Crawler for many games (L4D2, TF2, CS:S, KZMOD, The Ship)
2021
2022
2023
2024
2025
2026
0.0
A gem that collects mangas from websites
2021
2022
2023
2024
2025
2026
0.0
A web crawler dsl.
2021
2022
2023
2024
2025
2026
0.0
A ruby based zhihu content crawler.
2021
2022
2023
2024
2025
2026