A ruby gem to give you the power of Google Search in your command line.

Engine to add a RSS and Atom reader to your JRuby on Rails app.

chomchom extracts article's title, published_date, author, and fulltext. It also detects videos and audio for classifying the media type of a given page

This gem allows to crawl news articles from RSS feeds.

初级开发工程师，基于 http 写的爬虫扩展包。请不要随意下载里面有很多坑。

Given a URL, retrieves thumbnail images (similar to when you share a link on Facebook or Digg).

A collection of extractors, transformers and loaders for scraping news websites and syndicates.

Collect and serialize rss feeds.

The Mutt of RSS/Atom feeds.

A simple news crawler. You can specify the structure of your xml or rss feeds.

SourceMonitor is a mountable Rails 8 engine that ingests RSS, Atom, and JSON feeds, scrapes full article content, and surfaces Solid Queue powered dashboards for monitoring and remediation.

Extracts article text from a URL

Fetch the web pages and stat.