spidr

spidr

Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

Rubygem spidr

Total Downloads
32543
Releases
23
Current Version
0.4.1
Released
2011-12-09 00:00:00 UTC
First Release
2008-05-23 07:00:00 UTC
Depends on following gems
Depending Gems
4

Github postmodern/spidr

Watchers
212
Forks
29
Development activity
Inactive
Last commit
2013-02-25 23:53:38 UTC
First commit
Contributors
5
Issues
Wiki pages

Resources

There are no resources yet, be the first to submit one!

Comments

There are no comments yet, be the first to write one!

Post a comment

Markdown supported
or
×

In order to continue, you must be signed in using your Github account.

If you're signing in using this account for the first time Github will ask for your permission to give access to your public user data to the Ruby Toolbox.

Although the Github Authorization page does not mention it, the request includes read-only access to your verified email address (user:email OAuth scope). This is neccessary so there's a way to notify you about comments, information about your accepted project edits and the like. You can review your notification settings on your account page once you're signed in.