Project

scruber

0.0
No commit activity in last 3 years
No release in over 3 years
Crawling framework
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
 Dependencies

Development

~> 1.15
~> 10.0
~> 3.0
= 3.0.1

Runtime

>= 5.1.5, ~> 5.1
>= 0.7.6, ~> 0.7
>= 1.8.2, ~> 1.8
>= 2.0.1, ~> 2.0
~> 0.0.11
>= 2.0.1, ~> 2.0
= 0.20.0
>= 1.1.2, ~> 1.1
 Project Readme

Scruber

Scruber is an open source scraping framework for Ruby.

Getting started

  1. Install Scruber at the command prompt if you haven't yet:

    $ gem install scruber

  2. Create a new workspace

    $ scruber new myworkspace

  3. Create a new scraper

    $ scruber new scraper example

Scruber.run do
  csv_file 'output.csv', col_sep: ','

  get 'http://example.com'

  parse :html do |page, html|
    csv_out html.at('title').text
  end
end
  1. Run your scraper

    $ scruber start example

Contributing

Bug reports and pull requests are welcome on GitHub at https://github.com/scruber/scruber.

License

The gem is available as open source under the terms of the MIT License.