Project

webget

0.0
A long-lived project that still receives updates
webget gem - a web (go get) crawler incl. web cache
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
2025
2026
 Dependencies

Development

>= 4.0, < 7
~> 4.2

Runtime

>= 0
>= 0.3.1
 Project Readme

web command line tools, libraries & scripts

Gems:

  • webclient - yet (another) universal network client interface for world wide web (www) requests via HTTP
  • webget - a web (go get) crawler incl. web cache
  • webget-mirror - a webget addon to mirror website

more / classic / "legacy"

  • fetcher - fetch text documents or binary blobs via HTTP / HTTPS

License

The scripts are dedicated to the public domain. Use as you please with no restrictions whatsoever.