Web Content Scrapers
This category does not have a description yet. You can add one on github!
0.54
MetaInspector lets you scrape a web page and get its links, images, texts, meta tags...
2019
2020
2021
2022
2023
2024
0.11
Download, pull out of a ZIP/TAR/GZ/BZ2 archive, parse, correct, and import XLS, ODS, XML, CSV, HTML, etc. into your ActiveRecord models. Uses Upsert internally for speed.
2019
2020
2021
2022
2023
2024
0.12
Cobweb is a web crawler that can use resque to cluster crawls to quickly crawl extremely large sites which is much more performant than multi-threaded crawlers. It is also a standalone crawler that has a sophisticated statistics monitoring interface to monitor the progress of the crawls.
2019
2020
2021
2022
2023
2024
0.29
Ruby gem generating thumbnail images from a given URL.
2019
2020
2021
2022
2023
2024
0.0
It's a scraper
2019
2020
2021
2022
2023
2024
0.53
Generic Web crawler with a DSL that parses structured data from web pages
2019
2020
2021
2022
2023
2024
0.83
Anemone web-spider framework
2019
2020
2021
2022
2023
2024
0.03
Easily fetch product information from third party websites such as Amazon, Steam, eBay, etc.
2019
2020
2021
2022
2023
2024
0.01
A simple, fast web crawler
2019
2020
2021
2022
2023
2024
0.08
Crawl web sites easily using ruby recipes, with caching and nokogiri.
2019
2020
2021
2022
2023
2024
0.32
Pismo extracts and retrieves content-related metadata from HTML pages - you can use the resulting data in an organized way, such as a summary/first paragraph, body text, keywords, RSS feed URL, favicon, etc.
2019
2020
2021
2022
2023
2024
0.05
A pure ruby implementation of the boilerpipe web content extraction algorithm
2019
2020
2021
2022
2023
2024
0.01
DocParser is a Ruby Gem for webscraping
2019
2020
2021
2022
2023
2024
0.43
Modern web scraping framework written in Ruby and based on Capybara/Nokogiri
2019
2020
2021
2022
2023
2024
0.09
Maintained fork of Kimurai, a modern web scraping framework written in Ruby and based on Capybara/Nokogiri
2019
2020
2021
2022
2023
2024
0.0
MediaWiki API and Page content parser for Headlines (nested), TextBlocks, ListItems, and Links.
2019
2020
2021
2022
2023
2024
0.0
A simple plugin for extracting information from url entered by user (Something
like what facebook does). This gem is built on top of opengraph gem created by michael
bleigh.
2019
2020
2021
2022
2023
2024