Low commit activity in last 3 years
No release in over a year
DocParser is a Ruby Gem for webscraping
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
 Dependencies

Development

Runtime

~> 2.0.1
~> 1.10.0
~> 1.10
 Project Readme

DocParser

Gem Version Build status

DocParser is a web scraping/screen scraping tool.

You can use it to easily scrape information out of HTML documents.

The gem is called docparser. You can find the documentation here.

Features

  • XPath and CSS support through Nokogiri
  • Support for parallel processing of the documents
  • 6 Output formats:
    • CSV
    • XLSX
    • HTML
    • YAML
    • JSON
    • Screen (for debugging and development)
    • And more! (easy to extend)

Installation

Add this line to your application's Gemfile:

gem 'docparser'

And then execute:

bundle

Or install it yourself using:

gem install docparser

Usage

See example.rb

Todo

  • Better examples and documentation

Contributing

  1. Fork it
  2. Create your feature branch (git checkout -b my-new-feature)
  3. Commit your changes (git commit -am 'Add some feature')
  4. Push to the branch (git push origin my-new-feature)
  5. Create new Pull Request

Contributors

Thanks