Project

ask-llm-providers

0.0
The project is in a healthy, maintained state
ask-llm-providersask-rb/ask-llm-providersHomepageDocumentationSource CodeBug Tracker
Supports OpenAI, Anthropic, Google Gemini + Vertex, Amazon Bedrock, Ollama (local), Mistral AI, and Cloudflare Workers AI + AI Gateway. One gem, all the models you need.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
2025
2026
 Popularity
Downloads
9,916
Stars
1
Forks
0
Watchers
0
 Releases
Current version
0.10.0
Total releases
36
First release
2026-06-09
Latest release
2026-07-25
 Development
Primary Language
Ruby
Licenses
MIT
Average date of last 50 commits
2026-06-25
Reverse Dependencies
1

 Dependencies

Development

minitest
~> 5.25
mocha
~> 3.1
rake
~> 13.0
vcr
~> 6.0
webmock
~> 3.26

Runtime

ask-auth
>= 0.1
ask-core
>= 0.7.0
base64
~> 0.2
faraday
>= 2.0
faraday-multipart
>= 1.0
json
>= 0
 Project Readme

ask-llm-providers

All LLM providers for the ask-rb ecosystem in one gem. Implements Ask::Provider from ask-core with a capabilities-based interface.

Supported Providers

Provider Auth Implementation
OpenAI + all OpenAI-compatible Ask::Auth.resolve(:openai_api_key) Ask::Providers::OpenAI
Anthropic (Claude) Ask::Auth.resolve(:anthropic_api_key) Ask::Providers::Anthropic
Google Gemini Ask::Auth.resolve(:gemini_api_key) Ask::Providers::Google
Vertex AI GCP service account Ask::Providers::Google (via Vertex)
Amazon Bedrock AWS credentials chain Ask::Providers::Bedrock
Ollama (local) None needed Ask::Providers::Ollama
Mistral AI Ask::Auth.resolve(:mistral_api_key) Ask::Providers::Mistral
Cloudflare Workers AI Ask::Auth.resolve(:cloudflare_api_key) Ask::Providers::Cloudflare

Installation

gem "ask-llm-providers"

Usage

require "ask-llm-providers"

# All providers are auto-registered with Ask::Models
models = Ask::Models.find("gpt-4o")
# => { provider: :openai, capabilities: [...] }

# Use a provider directly
provider = Ask::Providers::OpenAI.new
provider.chat(conversation, tools: [], model: "gpt-4o") do |chunk|
  print chunk.content
end

Capabilities

Each provider and model exposes its capabilities:

provider = Ask::Providers::OpenAI.new
provider.capabilities
# => { chat: true, streaming: true, tool_calls: true, vision: true, thinking: true,
#     :structured_output, :embed, :transcribe, :paint, :moderate]

model = Ask::Models.find("claude-sonnet-4-5")
model[:capabilities]
# => { chat: true, streaming: true, tool_calls: true, vision: true, thinking: true, :prompt_caching]

# Unsupported capabilities raise a helpful error
provider = Ask::Providers::Anthropic.new
provider.embed(["text"], model: "claude-sonnet-4-5")
# => Ask::CapabilityNotSupported: Anthropic (claude-sonnet-4-5) does not support embeddings.

Streaming

stream = provider.chat(
  [{ role: "user", content: "Tell me a story" }],
  model: "gpt-4o",
  stream: true
) do |chunk|
  print chunk.content
end

# After streaming completes, you can access the full response
puts stream.accumulated_text
puts stream.accumulated_usage

Tool Calls

tools = [{
  name: "get_weather",
  description: "Get weather for a location",
  parameters: {
    type: "object",
    properties: { location: { type: "string" } },
    required: ["location"]
  }
}]

response = provider.chat(
  [{ role: "user", content: "What's the weather in NYC?" }],
  model: "gpt-4o",
  tools: tools
)
# response.tool_call? => true
# response.tool_calls => [{ id: "call_1", name: "get_weather", arguments: '{"location":"NYC"}' }]

Error Handling

Provider errors map to structured Ask::Error types:

Ask::RateLimitError       # 429 — retry with backoff
Ask::Unauthorized         # 401/403 — check your API key
Ask::ServerError          # 500 — provider issue
Ask::ServiceUnavailable   # 503 — temporary
Ask::ContextLengthExceeded # context window exceeded
Ask::ProviderError        # other provider errors
Ask::CapabilityNotSupported # feature not available on this model

Development

bin/setup
bundle exec rake test

License

MIT