lex-llm-gateway
LLM inference gateway for LegionIO. Provides centralized metering over RabbitMQ, fleet RPC dispatch to GPU workers, and local disk spooling for offline resilience.
Installation
Add to your Gemfile:
gem 'lex-llm-gateway'License
MIT
Project
lex-llm-gateway
LLM inference gateway: metering over RabbitMQ, fleet RPC dispatch, local disk spool
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
2025
2026
Development
Dependencies
Development
Project Readme