S3Browser

The S3Browser is a simple wrapper around Amazon's S3 Service. Apart from listing files and managing, S3 doesn't give you a lot of functionality.

This wrapper gives you a couple of killer functions:

• Search
• Sorting
• Automatically update file information
• Upload files
• Download files
• Delete files

Add this line to your application's Gemfile:

gem 's3browser'

And then execute:

$ bundle

Or install it yourself as:

$ gem install s3browser

Here's an example config.ru for booting S3Browser::Server in your choice of Rack server:

# config.ru
#\-o 0.0.0.0 -p 9292
require 's3browser/server'
run S3Browser::Server

You can mount S3Browser to existing Rack (Sinatra) application as well:

# config.ru
require 'your_app'

require 's3browser/server'
run Rack::URLMap.new('/' => Sinatra::Application, '/s3browser' => S3Browser::Server)

To run S3Browser rake files, require the tasks file:

# Rakefile
require 's3browser/gem_tasks'

Run the fetcher

bundle exec rake s3browser:fetch

Run the server

bundle exec rake s3browser:server

Run the worker

bundle exec s3browser-worker

This will use the default config file shoryuken-config.yml generated by the setup process. You can override this and add any shoryuken options you want:

bundle exec s3browser-worker -C config.yml -L /var/log/shoryuken.log -P ./tmp/shoryuken.pid 

S3 buckets can be configured to send Event Notifications when certain events happen in a bucket.

Run bundle exec rake s3browser:setup to ensure the correct ENV variables are set, and that your AWS setup is correct.

It will:

1. Record the neccesary ENV variables:

• AWS_ACCESS_KEY_ID
• AWS_SECRET_ACCESS_KEY
• AWS_REGION
• AWS_S3_BUCKET
• AWS_SQS_QUEUE

2. Create the SQS queue, with the correct permissions
3. Create the S3 bucket, with the correct notification configuration

To do the setup, the IAM profile you're using to run the script should have the following policy in place:

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Sid": "S3BrowserFullAccess",
            "Effect": "Allow",
            "Action": [
                "s3:GetObject",
                "s3:GetObjectVersion",
                "s3:ListBucket",
                "s3:PutObject",
                "s3:CreateBucket",
                "s3:PutBucketNotification"
            ],
            "Resource": [
                "arn:aws:s3:::*",
                "arn:aws:s3:::*/*"
            ]
        },
        {
            "Sid": "Stmt1460660107000",
            "Effect": "Allow",
            "Action": [
                "sqs:DeleteMessage",
                "sqs:ReceiveMessage",
                "sqs:CreateQueue",
                "sqs:GetQueueUrl",
                "sqs:GetQueueAttributes",
                "sqs:SetQueueAttributes"
            ],
            "Resource": [
                "arn:aws:sqs:*"
            ]
        }
    ]
}

After setting up the queue and the bucket, a policy without the following actions can be used:

• s3:CreateBucket
• s3:PutBucketNotification
• sqs:CreateQueue
• sqs:GetQueueUrl
• sqs:GetQueueAttributes
• sqs:SetQueueAttributes

You might not want to allow public access to your S3 bucket. To work around this, the gem provides a proxy with which the server will fetch the file from S3 and serve it to the client, caching it in between.

It's a simple Sinatra app, so can be mounted on a Rack endpoint as well:

# config.ru
#\-o 0.0.0.0 -p 9292
require 's3browser/server'
require 's3browser/s3proxy'

run Rack::URLMap.new('/s3' => S3Browser::S3Proxy, '/' => S3Browser::Server)

The above example allows you to set the S3BROWSER_THUMBNAIL_URL and S3BROWSER_OBJECT_URL environmental variables to /s3 so that you can download and view the files from the browser.

After checking out the repo, run bin/setup to install dependencies. You can also run bin/console for an interactive prompt that will allow you to experiment.

To install this gem onto your local machine, run bundle exec rake install. To release a new version, update the version number in version.rb, and then run bundle exec rake release, which will create a git tag for the version, push git commits and tags, and push the .gem file to rubygems.org.

Bug reports and pull requests are welcome on GitHub at https://github.com/jrgns/s3browser.

The gem is available as open source under the terms of the MIT License.