rdh/active_intelligence README

A Rails engine that provides Rails-y AI integration

This engine is in (very) early development and breaking changes are expected. Use at your own risk or contribute at your pleasure.

Add this line to your application's Gemfile:

gem 'active_intelligence', git: 'git@github.com:rdh/active_intelligence.git', branch: 'main'

And then execute:

$ bundle

Configure your LLM in config/ai/llm.yml, something like:

openai: &openai
  adapter: openai
  access_token: <%= ENV.fetch('OPENAI_ACCESS_TOKEN') %>
  organization_id: <%= ENV.fetch('OPENAI_ORGANIZATION_ID')  %>
  request_timeout: 120

development:
  <<: *openai
  model: gpt-4-turbo
  temperature: 0.0

adapter = ActiveIntelligence::LLM::Config.new.adapter
puts adapter.generate("Tell me a joke")

• Prompts live in app/prompts. They are ERB files that use a model as binding.
• The default prompt per-model is named after the model, e.g. app/prompts/users.erb
• Named prompts per-model live in a subdirectory named adter the model, e.g. app/prompts/users/invite.erb

Add include ActiveIntelligence::Promptable to your model, which adds the #to_prompt and #from_llm methods.

default_response = user.from_llm 
invite_response = user.from_llm(:invite)

Configure your LLM in config/ai/llm.yml, something like:

aws: &aws
  adapter: aws
  access_key_id: <%= ENV.fetch('AWS_ACCESS_KEY_ID') %>
  secret_access_key: <%= ENV.fetch('AWS_SECRET_ACCESS_KEY') %>
  region: <%= ENV.fetch('AWS_REGION') %>
  bucket: <%= ENV.fetch('AWS_TRANSCRIBE_BUCKET') %>
  folder: <%= ENV.fetch('AWS_TRANSCRIBE_FOLDER') %>
  language_code: en-US
  
openai: &openai
  adapter: openai
  access_token: <%= ENV.fetch('OPENAI_ACCESS_TOKEN') %>
  organization_id: <%= ENV.fetch('OPENAI_ORGANIZATION_ID')  %>
  request_timeout: 300
  model: whisper-1
  
development:
  <<: *openai

adapter = ActiveIntelligence::ASR::Config.new.adapter
puts adapter.transcribe('spec/data/audio/ebn.wav')

The engine currently has two significant modules: ASR and LLM. Each module has a common Config and Adapter pattern.

The config is a constructor for the adapter.
By default, it uses the Rails.env as the key, but you can specify one:

adapter = ActiveIntelligence::ASR::Config.new.adapter # uses Rails.env
adapter = ActiveIntelligence::ASR::Config.new.adapter(:foobar) # uses the named configuration

Values in a configuration will "flow through" to services called by the adapter, so you can set defaults in the configuration. Options provided directly to calls will take precedence over the configuration.

Contribution directions go here.

The gem is available as open source under the terms of the MIT License.