Language Operator

Language Operator is a Kubernetes operator that turns natural language into autonomous agents.

It is under active development and incomplete.

# Add repository:
helm repo add language-operator https://language-operator.github.io/language-operator
helm repo update

# Install in kube-system:
helm install language-operator language-operator/language-operator

Vision

Wouldn't it be neat if you could do this in Kubernetes? We think so!

LanguageModel

Deploy a litellm proxy with rate limiting and cost control:

apiVersion: langop.io/v1alpha1
kind: LanguageModel
metadata:
  name: gpt-4-turbo
spec:
  provider: openai
  modelName: gpt-4-turbo-preview
  apiKeySecretRef:
    name: openai-credentials
    key: api-key
  rateLimits:
    requestsPerMinute: 100
    tokensPerMinute: 100000
  costTracking:
    enabled: true
    inputTokenCost: 0.01
    outputTokenCost: 0.03

LanguageTool

Deploy an MCP tool as a standalone service or sidecar for shared workspaces:

apiVersion: langop.io/v1alpha1
kind: LanguageTool
metadata:
  name: web-search
spec:
  image: gchr.io/language-operator/web-tool:latest
  deploymentMode: service  # or 'sidecar' for workspace access
  type: mcp
  port: 8080
  replicas: 2

LanguageCluster

A network-isolated ¹ environment for agents and tools:

apiVersion: langop.io/v1alpha1
kind: LanguageCluster
metadata:
  name: production
  namespace: langop-system
spec:
  domain: agents.example.com
  ingressConfig:
    tls:
      enabled: true

LanguagePersona

A free-form description of a person, role, or behavior.

apiVersion: langop.io/v1alpha1
kind: LanguagePersona
metadata:
  name: helpful-assistant
spec:
  displayName: "Helpful Assistant"
  description: "A friendly AI assistant for customer support"
  systemPrompt: "You are a helpful, patient customer support agent."
  tone: friendly
  language: en
  capabilities:
    - "Answer questions"
    - "Provide guidance"
    - "Escalate to human when needed"
  limitations:
    - "Cannot access customer payment information"
    - "Cannot make refunds without approval"

LanguageAgent

Self-synthesizing agents ² from natural language instructions:

apiVersion: langop.io/v1alpha1
kind: LanguageAgent
metadata:
  name: customer-support-bot
spec:
  modelRefs:
    - name: gpt-4-turbo
  toolRefs:
    - name: web-search
  personaRefs:
    - name: helpful-assistant
  instructions: |
    You are a customer support agent. Answer customer questions
    using the available tools and escalate complex issues.
  workspace:
    enabled: true
    size: 10Gi

¹ requires CNI like Cilium (recommended) ² quality of synthesis is model dependent