No release in over 3 years
Low commit activity in last 3 years
Rack middleware that executes javascript before serving pages to crawlers.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
 Project Readme

Indexable

Drop-in Rack middleware that that executes javascript before serving pages to crawlers.

Installation

You will need to install PhantomJS. We use the network request abort functionality that was added in version 1.9, so lower versions will not work. You can check the installed version of PhantomJS by running phantomjs -v.

Rails

Add this to your Gemfile:

gem 'indexable'

That's it, we're done!

Rack

require 'indexable'
use Indexable::Middleware

There is an example Rack application in the example/ directory.

Common

(Optional) Adding the following meta tag to the head section of your pages will opt you into the AJAX crawling scheme, which the middleware uses in addition to checking the user agent in order to determine whether a request is coming from a crawler.

<meta name="fragment" content="!">