litellm_client
LiteLLMClient - the Ruby gem for the LiteLLM API
Proxy Server to call 100+ LLMs in the OpenAI format. Customize Swagger Docs
👉 LiteLLM Admin Panel on /ui. Create, Edit Keys with SSO
💸 LiteLLM Model Cost Map.
This SDK is automatically generated by the OpenAPI Generator project:
- API version: 1.72.6
- Package version: 1.0.0
- Generator version: 7.13.0
- Build package: org.openapitools.codegen.languages.RubyClientCodegen
Installation
Build a gem
To build the Ruby code into a gem:
gem build litellm_client.gemspecThen either install the gem locally:
gem install ./litellm_client-1.0.0.gem(for development, run gem install --dev ./litellm_client-1.0.0.gem to install the development dependencies)
or publish the gem to a gem hosting service, e.g. RubyGems.
Finally add this to the Gemfile:
gem 'litellm_client', '~> 1.0.0'
Install from Git
If the Ruby gem is hosted at a git repository: https://github.com/aluminumio/litellm-ruby, then add the following in the Gemfile:
gem 'litellm_client', :git => 'https://github.com/aluminumio/litellm-ruby.git'
Include the Ruby code directly
Include the Ruby code directly using -I as follows:
ruby -Ilib script.rbGetting Started
Please follow the installation procedure and then run the following code:
# Load the gem
require 'litellm_client'
# Setup authorization
LiteLLMClient.configure do |config|
# Configure API key authorization: APIKeyHeader
config.api_key['x-litellm-api-key'] = 'YOUR API KEY'
# Uncomment the following line to set a prefix for the API key, e.g. 'Bearer' (defaults to nil)
# config.api_key_prefix['x-litellm-api-key'] = 'Bearer'
end
api_instance = LiteLLMClient::AnthropicPassThroughApi.new
endpoint = 'endpoint_example' # String |
begin
#Anthropic Proxy Route
result = api_instance.anthropic_proxy_route_anthropic_endpoint_get(endpoint)
p result
rescue LiteLLMClient::ApiError => e
puts "Exception when calling AnthropicPassThroughApi->anthropic_proxy_route_anthropic_endpoint_get: #{e}"
endDocumentation for API Endpoints
All URIs are relative to http://localhost
| Class | Method | HTTP request | Description |
|---|---|---|---|
| LiteLLMClient::AnthropicPassThroughApi | anthropic_proxy_route_anthropic_endpoint_get | GET /anthropic/{endpoint} | Anthropic Proxy Route |
| LiteLLMClient::AnthropicPassThroughApi | anthropic_proxy_route_anthropic_endpoint_get_0 | PUT /anthropic/{endpoint} | Anthropic Proxy Route |
| LiteLLMClient::AnthropicPassThroughApi | anthropic_proxy_route_anthropic_endpoint_get_1 | POST /anthropic/{endpoint} | Anthropic Proxy Route |
| LiteLLMClient::AnthropicPassThroughApi | anthropic_proxy_route_anthropic_endpoint_get_2 | DELETE /anthropic/{endpoint} | Anthropic Proxy Route |
| LiteLLMClient::AnthropicPassThroughApi | anthropic_proxy_route_anthropic_endpoint_get_3 | PATCH /anthropic/{endpoint} | Anthropic Proxy Route |
| LiteLLMClient::AssemblyAIEUPassThroughApi | assemblyai_proxy_route_eu_assemblyai_endpoint_get | GET /eu.assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::AssemblyAIEUPassThroughApi | assemblyai_proxy_route_eu_assemblyai_endpoint_get_0 | PUT /eu.assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::AssemblyAIEUPassThroughApi | assemblyai_proxy_route_eu_assemblyai_endpoint_get_1 | POST /eu.assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::AssemblyAIEUPassThroughApi | assemblyai_proxy_route_eu_assemblyai_endpoint_get_2 | DELETE /eu.assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::AssemblyAIEUPassThroughApi | assemblyai_proxy_route_eu_assemblyai_endpoint_get_3 | PATCH /eu.assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::AssemblyAIPassThroughApi | assemblyai_proxy_route_assemblyai_endpoint_get | GET /assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::AssemblyAIPassThroughApi | assemblyai_proxy_route_assemblyai_endpoint_get_0 | PUT /assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::AssemblyAIPassThroughApi | assemblyai_proxy_route_assemblyai_endpoint_get_1 | POST /assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::AssemblyAIPassThroughApi | assemblyai_proxy_route_assemblyai_endpoint_get_2 | DELETE /assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::AssemblyAIPassThroughApi | assemblyai_proxy_route_assemblyai_endpoint_get_3 | PATCH /assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::AssistantsApi | add_messages_threads_thread_id_messages_post | POST /threads/{thread_id}/messages | Add Messages |
| LiteLLMClient::AssistantsApi | add_messages_v1_threads_thread_id_messages_post | POST /v1/threads/{thread_id}/messages | Add Messages |
| LiteLLMClient::AssistantsApi | create_assistant_assistants_post | POST /assistants | Create Assistant |
| LiteLLMClient::AssistantsApi | create_assistant_v1_assistants_post | POST /v1/assistants | Create Assistant |
| LiteLLMClient::AssistantsApi | create_threads_threads_post | POST /threads | Create Threads |
| LiteLLMClient::AssistantsApi | create_threads_v1_threads_post | POST /v1/threads | Create Threads |
| LiteLLMClient::AssistantsApi | delete_assistant_assistants_assistant_id_delete | DELETE /assistants/{assistant_id} | Delete Assistant |
| LiteLLMClient::AssistantsApi | delete_assistant_v1_assistants_assistant_id_delete | DELETE /v1/assistants/{assistant_id} | Delete Assistant |
| LiteLLMClient::AssistantsApi | get_assistants_assistants_get | GET /assistants | Get Assistants |
| LiteLLMClient::AssistantsApi | get_assistants_v1_assistants_get | GET /v1/assistants | Get Assistants |
| LiteLLMClient::AssistantsApi | get_messages_threads_thread_id_messages_get | GET /threads/{thread_id}/messages | Get Messages |
| LiteLLMClient::AssistantsApi | get_messages_v1_threads_thread_id_messages_get | GET /v1/threads/{thread_id}/messages | Get Messages |
| LiteLLMClient::AssistantsApi | get_thread_threads_thread_id_get | GET /threads/{thread_id} | Get Thread |
| LiteLLMClient::AssistantsApi | get_thread_v1_threads_thread_id_get | GET /v1/threads/{thread_id} | Get Thread |
| LiteLLMClient::AssistantsApi | run_thread_threads_thread_id_runs_post | POST /threads/{thread_id}/runs | Run Thread |
| LiteLLMClient::AssistantsApi | run_thread_v1_threads_thread_id_runs_post | POST /v1/threads/{thread_id}/runs | Run Thread |
| LiteLLMClient::AudioApi | audio_speech_audio_speech_post | POST /audio/speech | Audio Speech |
| LiteLLMClient::AudioApi | audio_speech_v1_audio_speech_post | POST /v1/audio/speech | Audio Speech |
| LiteLLMClient::AudioApi | audio_transcriptions_audio_transcriptions_post | POST /audio/transcriptions | Audio Transcriptions |
| LiteLLMClient::AudioApi | audio_transcriptions_v1_audio_transcriptions_post | POST /v1/audio/transcriptions | Audio Transcriptions |
| LiteLLMClient::AuditLoggingApi | get_audit_log_by_id_audit_id_get | GET /audit/{id} | Get Audit Log By Id |
| LiteLLMClient::AuditLoggingApi | get_audit_logs_audit_get | GET /audit | Get Audit Logs |
| LiteLLMClient::AzurePassThroughApi | azure_proxy_route_azure_endpoint_get | GET /azure/{endpoint} | Azure Proxy Route |
| LiteLLMClient::AzurePassThroughApi | azure_proxy_route_azure_endpoint_get_0 | PUT /azure/{endpoint} | Azure Proxy Route |
| LiteLLMClient::AzurePassThroughApi | azure_proxy_route_azure_endpoint_get_1 | POST /azure/{endpoint} | Azure Proxy Route |
| LiteLLMClient::AzurePassThroughApi | azure_proxy_route_azure_endpoint_get_2 | DELETE /azure/{endpoint} | Azure Proxy Route |
| LiteLLMClient::AzurePassThroughApi | azure_proxy_route_azure_endpoint_get_3 | PATCH /azure/{endpoint} | Azure Proxy Route |
| LiteLLMClient::BatchApi | cancel_batch_batches_batch_id_cancel_post | POST /batches/{batch_id}/cancel | Cancel Batch |
| LiteLLMClient::BatchApi | cancel_batch_provider_v1_batches_batch_id_cancel_post | POST /{provider}/v1/batches/{batch_id}/cancel | Cancel Batch |
| LiteLLMClient::BatchApi | cancel_batch_v1_batches_batch_id_cancel_post | POST /v1/batches/{batch_id}/cancel | Cancel Batch |
| LiteLLMClient::BatchApi | create_batch_batches_post | POST /batches | Create Batch |
| LiteLLMClient::BatchApi | create_batch_provider_v1_batches_post | POST /{provider}/v1/batches | Create Batch |
| LiteLLMClient::BatchApi | create_batch_v1_batches_post | POST /v1/batches | Create Batch |
| LiteLLMClient::BatchApi | list_batches_batches_get | GET /batches | List Batches |
| LiteLLMClient::BatchApi | list_batches_provider_v1_batches_get | GET /{provider}/v1/batches | List Batches |
| LiteLLMClient::BatchApi | list_batches_v1_batches_get | GET /v1/batches | List Batches |
| LiteLLMClient::BatchApi | retrieve_batch_batches_batch_id_get | GET /batches/{batch_id} | Retrieve Batch |
| LiteLLMClient::BatchApi | retrieve_batch_provider_v1_batches_batch_id_get | GET /{provider}/v1/batches/{batch_id} | Retrieve Batch |
| LiteLLMClient::BatchApi | retrieve_batch_v1_batches_batch_id_get | GET /v1/batches/{batch_id} | Retrieve Batch |
| LiteLLMClient::BedrockPassThroughApi | bedrock_proxy_route_bedrock_endpoint_get | GET /bedrock/{endpoint} | Bedrock Proxy Route |
| LiteLLMClient::BedrockPassThroughApi | bedrock_proxy_route_bedrock_endpoint_get_0 | PUT /bedrock/{endpoint} | Bedrock Proxy Route |
| LiteLLMClient::BedrockPassThroughApi | bedrock_proxy_route_bedrock_endpoint_get_1 | POST /bedrock/{endpoint} | Bedrock Proxy Route |
| LiteLLMClient::BedrockPassThroughApi | bedrock_proxy_route_bedrock_endpoint_get_2 | DELETE /bedrock/{endpoint} | Bedrock Proxy Route |
| LiteLLMClient::BedrockPassThroughApi | bedrock_proxy_route_bedrock_endpoint_get_3 | PATCH /bedrock/{endpoint} | Bedrock Proxy Route |
| LiteLLMClient::BudgetManagementApi | budget_settings_budget_settings_get | GET /budget/settings | Budget Settings |
| LiteLLMClient::BudgetManagementApi | delete_budget_budget_delete_post | POST /budget/delete | Delete Budget |
| LiteLLMClient::BudgetManagementApi | info_budget_budget_info_post | POST /budget/info | Info Budget |
| LiteLLMClient::BudgetManagementApi | list_budget_budget_list_get | GET /budget/list | List Budget |
| LiteLLMClient::BudgetManagementApi | new_budget_budget_new_post | POST /budget/new | New Budget |
| LiteLLMClient::BudgetManagementApi | update_budget_budget_update_post | POST /budget/update | Update Budget |
| LiteLLMClient::BudgetSpendTrackingApi | add_allowed_ip_add_allowed_ip_post | POST /add/allowed_ip | Add Allowed Ip |
| LiteLLMClient::BudgetSpendTrackingApi | calculate_spend_spend_calculate_post | POST /spend/calculate | Calculate Spend |
| LiteLLMClient::BudgetSpendTrackingApi | delete_allowed_ip_delete_allowed_ip_post | POST /delete/allowed_ip | Delete Allowed Ip |
| LiteLLMClient::BudgetSpendTrackingApi | get_global_spend_report_global_spend_report_get | GET /global/spend/report | Get Global Spend Report |
| LiteLLMClient::BudgetSpendTrackingApi | get_user_daily_activity_user_daily_activity_get | GET /user/daily/activity | Get User Daily Activity |
| LiteLLMClient::BudgetSpendTrackingApi | global_spend_reset_global_spend_reset_post | POST /global/spend/reset | Global Spend Reset |
| LiteLLMClient::BudgetSpendTrackingApi | global_view_spend_tags_global_spend_tags_get | GET /global/spend/tags | Global View Spend Tags |
| LiteLLMClient::BudgetSpendTrackingApi | view_spend_logs_spend_logs_get | GET /spend/logs | View Spend Logs |
| LiteLLMClient::BudgetSpendTrackingApi | view_spend_tags_spend_tags_get | GET /spend/tags | View Spend Tags |
| LiteLLMClient::CachingApi | cache_delete_cache_delete_post | POST /cache/delete | Cache Delete |
| LiteLLMClient::CachingApi | cache_delete_cache_delete_post_0 | POST /cache/delete | Cache Delete |
| LiteLLMClient::CachingApi | cache_flushall_cache_flushall_post | POST /cache/flushall | Cache Flushall |
| LiteLLMClient::CachingApi | cache_flushall_cache_flushall_post_0 | POST /cache/flushall | Cache Flushall |
| LiteLLMClient::CachingApi | cache_ping_cache_ping_get | GET /cache/ping | Cache Ping |
| LiteLLMClient::CachingApi | cache_redis_info_cache_redis_info_get | GET /cache/redis/info | Cache Redis Info |
| LiteLLMClient::ChatCompletionsApi | chat_completion_chat_completions_post | POST /chat/completions | Chat Completion |
| LiteLLMClient::ChatCompletionsApi | chat_completion_engines_model_chat_completions_post | POST /engines/{model}/chat/completions | Chat Completion |
| LiteLLMClient::ChatCompletionsApi | chat_completion_openai_deployments_model_chat_completions_post | POST /openai/deployments/{model}/chat/completions | Chat Completion |
| LiteLLMClient::ChatCompletionsApi | chat_completion_v1_chat_completions_post | POST /v1/chat/completions | Chat Completion |
| LiteLLMClient::CoherePassThroughApi | cohere_proxy_route_cohere_endpoint_get | GET /cohere/{endpoint} | Cohere Proxy Route |
| LiteLLMClient::CoherePassThroughApi | cohere_proxy_route_cohere_endpoint_get_0 | PUT /cohere/{endpoint} | Cohere Proxy Route |
| LiteLLMClient::CoherePassThroughApi | cohere_proxy_route_cohere_endpoint_get_1 | POST /cohere/{endpoint} | Cohere Proxy Route |
| LiteLLMClient::CoherePassThroughApi | cohere_proxy_route_cohere_endpoint_get_2 | DELETE /cohere/{endpoint} | Cohere Proxy Route |
| LiteLLMClient::CoherePassThroughApi | cohere_proxy_route_cohere_endpoint_get_3 | PATCH /cohere/{endpoint} | Cohere Proxy Route |
| LiteLLMClient::CompletionsApi | completion_completions_post | POST /completions | Completion |
| LiteLLMClient::CompletionsApi | completion_engines_model_completions_post | POST /engines/{model}/completions | Completion |
| LiteLLMClient::CompletionsApi | completion_openai_deployments_model_completions_post | POST /openai/deployments/{model}/completions | Completion |
| LiteLLMClient::CompletionsApi | completion_v1_completions_post | POST /v1/completions | Completion |
| LiteLLMClient::CredentialManagementApi | create_credential_credentials_post | POST /credentials | Create Credential |
| LiteLLMClient::CredentialManagementApi | delete_credential_credentials_credential_name_delete | DELETE /credentials/{credential_name} | Delete Credential |
| LiteLLMClient::CredentialManagementApi | get_credential_credentials_by_model_model_id_get | GET /credentials/by_model/{model_id} | Get Credential |
| LiteLLMClient::CredentialManagementApi | get_credential_credentials_by_name_credential_name_get | GET /credentials/by_name/{credential_name} | Get Credential |
| LiteLLMClient::CredentialManagementApi | get_credentials_credentials_get | GET /credentials | Get Credentials |
| LiteLLMClient::CredentialManagementApi | update_credential_credentials_credential_name_patch | PATCH /credentials/{credential_name} | Update Credential |
| LiteLLMClient::CustomerManagementApi | block_user_customer_block_post | POST /customer/block | Block User |
| LiteLLMClient::CustomerManagementApi | delete_end_user_customer_delete_post | POST /customer/delete | Delete End User |
| LiteLLMClient::CustomerManagementApi | end_user_info_customer_info_get | GET /customer/info | End User Info |
| LiteLLMClient::CustomerManagementApi | list_end_user_customer_list_get | GET /customer/list | List End User |
| LiteLLMClient::CustomerManagementApi | new_end_user_customer_new_post | POST /customer/new | New End User |
| LiteLLMClient::CustomerManagementApi | unblock_user_customer_unblock_post | POST /customer/unblock | Unblock User |
| LiteLLMClient::CustomerManagementApi | update_end_user_customer_update_post | POST /customer/update | Update End User |
| LiteLLMClient::DefaultApi | create_pass_through_endpoints_config_pass_through_endpoint_post | POST /config/pass_through_endpoint | Create Pass Through Endpoints |
| LiteLLMClient::DefaultApi | delete_pass_through_endpoints_config_pass_through_endpoint_delete | DELETE /config/pass_through_endpoint | Delete Pass Through Endpoints |
| LiteLLMClient::DefaultApi | get_active_tasks_stats_debug_asyncio_tasks_get | GET /debug/asyncio-tasks | Get Active Tasks Stats |
| LiteLLMClient::DefaultApi | get_pass_through_endpoints_config_pass_through_endpoint_get | GET /config/pass_through_endpoint | Get Pass Through Endpoints |
| LiteLLMClient::DefaultApi | get_robots_robots_txt_get | GET /robots.txt | Get Robots |
| LiteLLMClient::DefaultApi | get_routes_routes_get | GET /routes | Get Routes |
| LiteLLMClient::DefaultApi | get_ui_config_litellm_well_known_litellm_ui_config_get | GET /litellm/.well-known/litellm-ui-config | Get Ui Config |
| LiteLLMClient::DefaultApi | get_ui_config_well_known_litellm_ui_config_get | GET /.well-known/litellm-ui-config | Get Ui Config |
| LiteLLMClient::DefaultApi | home_get | GET / | Home |
| LiteLLMClient::DefaultApi | list_available_teams_team_available_get | GET /team/available | List Available Teams |
| LiteLLMClient::DefaultApi | provider_budgets_provider_budgets_get | GET /provider/budgets | Provider Budgets |
| LiteLLMClient::DefaultApi | update_pass_through_endpoints_config_pass_through_endpoint_endpoint_id_post | POST /config/pass_through_endpoint/{endpoint_id} | Update Pass Through Endpoints |
| LiteLLMClient::EmailManagementApi | get_email_event_settings_email_event_settings_get | GET /email/event_settings | Get Email Event Settings |
| LiteLLMClient::EmailManagementApi | reset_event_settings_email_event_settings_reset_post | POST /email/event_settings/reset | Reset Event Settings |
| LiteLLMClient::EmailManagementApi | update_event_settings_email_event_settings_patch | PATCH /email/event_settings | Update Event Settings |
| LiteLLMClient::EmbeddingsApi | embeddings_embeddings_post | POST /embeddings | Embeddings |
| LiteLLMClient::EmbeddingsApi | embeddings_engines_model_embeddings_post | POST /engines/{model}/embeddings | Embeddings |
| LiteLLMClient::EmbeddingsApi | embeddings_openai_deployments_model_embeddings_post | POST /openai/deployments/{model}/embeddings | Embeddings |
| LiteLLMClient::EmbeddingsApi | embeddings_v1_embeddings_post | POST /v1/embeddings | Embeddings |
| LiteLLMClient::FilesApi | create_file_files_post | POST /files | Create File |
| LiteLLMClient::FilesApi | create_file_provider_v1_files_post | POST /{provider}/v1/files | Create File |
| LiteLLMClient::FilesApi | create_file_v1_files_post | POST /v1/files | Create File |
| LiteLLMClient::FilesApi | delete_file_files_file_id_delete | DELETE /files/{file_id} | Delete File |
| LiteLLMClient::FilesApi | delete_file_provider_v1_files_file_id_delete | DELETE /{provider}/v1/files/{file_id} | Delete File |
| LiteLLMClient::FilesApi | delete_file_v1_files_file_id_delete | DELETE /v1/files/{file_id} | Delete File |
| LiteLLMClient::FilesApi | get_file_content_files_file_id_content_get | GET /files/{file_id}/content | Get File Content |
| LiteLLMClient::FilesApi | get_file_content_provider_v1_files_file_id_content_get | GET /{provider}/v1/files/{file_id}/content | Get File Content |
| LiteLLMClient::FilesApi | get_file_content_v1_files_file_id_content_get | GET /v1/files/{file_id}/content | Get File Content |
| LiteLLMClient::FilesApi | get_file_files_file_id_get | GET /files/{file_id} | Get File |
| LiteLLMClient::FilesApi | get_file_provider_v1_files_file_id_get | GET /{provider}/v1/files/{file_id} | Get File |
| LiteLLMClient::FilesApi | get_file_v1_files_file_id_get | GET /v1/files/{file_id} | Get File |
| LiteLLMClient::FilesApi | list_files_files_get | GET /files | List Files |
| LiteLLMClient::FilesApi | list_files_provider_v1_files_get | GET /{provider}/v1/files | List Files |
| LiteLLMClient::FilesApi | list_files_v1_files_get | GET /v1/files | List Files |
| LiteLLMClient::FineTuningApi | cancel_fine_tuning_job_fine_tuning_jobs_fine_tuning_job_id_cancel_post | POST /fine_tuning/jobs/{fine_tuning_job_id}/cancel | ✨ (Enterprise) Cancel Fine-Tuning Jobs |
| LiteLLMClient::FineTuningApi | cancel_fine_tuning_job_v1_fine_tuning_jobs_fine_tuning_job_id_cancel_post | POST /v1/fine_tuning/jobs/{fine_tuning_job_id}/cancel | ✨ (Enterprise) Cancel Fine-Tuning Jobs |
| LiteLLMClient::FineTuningApi | create_fine_tuning_job_fine_tuning_jobs_post | POST /fine_tuning/jobs | ✨ (Enterprise) Create Fine-Tuning Job |
| LiteLLMClient::FineTuningApi | create_fine_tuning_job_v1_fine_tuning_jobs_post | POST /v1/fine_tuning/jobs | ✨ (Enterprise) Create Fine-Tuning Job |
| LiteLLMClient::FineTuningApi | list_fine_tuning_jobs_fine_tuning_jobs_get | GET /fine_tuning/jobs | ✨ (Enterprise) List Fine-Tuning Jobs |
| LiteLLMClient::FineTuningApi | list_fine_tuning_jobs_v1_fine_tuning_jobs_get | GET /v1/fine_tuning/jobs | ✨ (Enterprise) List Fine-Tuning Jobs |
| LiteLLMClient::FineTuningApi | retrieve_fine_tuning_job_fine_tuning_jobs_fine_tuning_job_id_get | GET /fine_tuning/jobs/{fine_tuning_job_id} | ✨ (Enterprise) Retrieve Fine-Tuning Job |
| LiteLLMClient::FineTuningApi | retrieve_fine_tuning_job_v1_fine_tuning_jobs_fine_tuning_job_id_get | GET /v1/fine_tuning/jobs/{fine_tuning_job_id} | ✨ (Enterprise) Retrieve Fine-Tuning Job |
| LiteLLMClient::GoogleAIStudioPassThroughApi | gemini_proxy_route_gemini_endpoint_get | GET /gemini/{endpoint} | Gemini Proxy Route |
| LiteLLMClient::GoogleAIStudioPassThroughApi | gemini_proxy_route_gemini_endpoint_get_0 | PUT /gemini/{endpoint} | Gemini Proxy Route |
| LiteLLMClient::GoogleAIStudioPassThroughApi | gemini_proxy_route_gemini_endpoint_get_1 | POST /gemini/{endpoint} | Gemini Proxy Route |
| LiteLLMClient::GoogleAIStudioPassThroughApi | gemini_proxy_route_gemini_endpoint_get_2 | DELETE /gemini/{endpoint} | Gemini Proxy Route |
| LiteLLMClient::GoogleAIStudioPassThroughApi | gemini_proxy_route_gemini_endpoint_get_3 | PATCH /gemini/{endpoint} | Gemini Proxy Route |
| LiteLLMClient::GuardrailsApi | apply_guardrail_guardrails_apply_guardrail_post | POST /guardrails/apply_guardrail | Apply Guardrail |
| LiteLLMClient::GuardrailsApi | create_guardrail_guardrails_post | POST /guardrails | Create Guardrail |
| LiteLLMClient::GuardrailsApi | delete_guardrail_guardrails_guardrail_id_delete | DELETE /guardrails/{guardrail_id} | Delete Guardrail |
| LiteLLMClient::GuardrailsApi | get_guardrail_guardrails_guardrail_id_get | GET /guardrails/{guardrail_id} | Get Guardrail |
| LiteLLMClient::GuardrailsApi | get_guardrail_info_guardrails_guardrail_id_info_get | GET /guardrails/{guardrail_id}/info | Get Guardrail Info |
| LiteLLMClient::GuardrailsApi | get_guardrail_ui_settings_guardrails_ui_add_guardrail_settings_get | GET /guardrails/ui/add_guardrail_settings | Get Guardrail Ui Settings |
| LiteLLMClient::GuardrailsApi | get_provider_specific_params_guardrails_ui_provider_specific_params_get | GET /guardrails/ui/provider_specific_params | Get Provider Specific Params |
| LiteLLMClient::GuardrailsApi | list_guardrails_guardrails_list_get | GET /guardrails/list | List Guardrails |
| LiteLLMClient::GuardrailsApi | list_guardrails_v2_v2_guardrails_list_get | GET /v2/guardrails/list | List Guardrails V2 |
| LiteLLMClient::GuardrailsApi | patch_guardrail_guardrails_guardrail_id_patch | PATCH /guardrails/{guardrail_id} | Patch Guardrail |
| LiteLLMClient::GuardrailsApi | update_guardrail_guardrails_guardrail_id_put | PUT /guardrails/{guardrail_id} | Update Guardrail |
| LiteLLMClient::HealthApi | active_callbacks_active_callbacks_get | GET /active/callbacks | Active Callbacks |
| LiteLLMClient::HealthApi | active_callbacks_settings_get | GET /settings | Active Callbacks |
| LiteLLMClient::HealthApi | health_endpoint_health_get | GET /health | Health Endpoint |
| LiteLLMClient::HealthApi | health_liveliness_health_liveliness_get | GET /health/liveliness | Health Liveliness |
| LiteLLMClient::HealthApi | health_liveliness_health_liveness_get | GET /health/liveness | Health Liveliness |
| LiteLLMClient::HealthApi | health_liveliness_options_health_liveliness_options | OPTIONS /health/liveliness | Health Liveliness Options |
| LiteLLMClient::HealthApi | health_liveliness_options_health_liveness_options | OPTIONS /health/liveness | Health Liveliness Options |
| LiteLLMClient::HealthApi | health_readiness_health_readiness_get | GET /health/readiness | Health Readiness |
| LiteLLMClient::HealthApi | health_readiness_options_health_readiness_options | OPTIONS /health/readiness | Health Readiness Options |
| LiteLLMClient::HealthApi | health_services_endpoint_health_services_get | GET /health/services | Health Services Endpoint |
| LiteLLMClient::HealthApi | test_endpoint_test_get | GET /test | Test Endpoint |
| LiteLLMClient::HealthApi | test_model_connection_health_test_connection_post | POST /health/test_connection | Test Model Connection |
| LiteLLMClient::ImagesApi | image_edit_api_images_edits_post | POST /images/edits | Image Edit Api |
| LiteLLMClient::ImagesApi | image_edit_api_openai_deployments_model_images_edits_post | POST /openai/deployments/{model}/images/edits | Image Edit Api |
| LiteLLMClient::ImagesApi | image_edit_api_v1_images_edits_post | POST /v1/images/edits | Image Edit Api |
| LiteLLMClient::ImagesApi | image_generation_images_generations_post | POST /images/generations | Image Generation |
| LiteLLMClient::ImagesApi | image_generation_openai_deployments_model_images_generations_post | POST /openai/deployments/{model}/images/generations | Image Generation |
| LiteLLMClient::ImagesApi | image_generation_v1_images_generations_post | POST /v1/images/generations | Image Generation |
| LiteLLMClient::InternalUserManagementApi | delete_user_user_delete_post | POST /user/delete | Delete User |
| LiteLLMClient::InternalUserManagementApi | get_user_daily_activity_user_daily_activity_get | GET /user/daily/activity | Get User Daily Activity |
| LiteLLMClient::InternalUserManagementApi | get_users_user_list_get | GET /user/list | Get Users |
| LiteLLMClient::InternalUserManagementApi | new_user_user_new_post | POST /user/new | New User |
| LiteLLMClient::InternalUserManagementApi | user_info_user_info_get | GET /user/info | User Info |
| LiteLLMClient::InternalUserManagementApi | user_update_user_update_post | POST /user/update | User Update |
| LiteLLMClient::KeyManagementApi | block_key_key_block_post | POST /key/block | Block Key |
| LiteLLMClient::KeyManagementApi | delete_key_fn_key_delete_post | POST /key/delete | Delete Key Fn |
| LiteLLMClient::KeyManagementApi | generate_key_fn_key_generate_post | POST /key/generate | Generate Key Fn |
| LiteLLMClient::KeyManagementApi | info_key_fn_key_info_get | GET /key/info | Info Key Fn |
| LiteLLMClient::KeyManagementApi | key_health_key_health_post | POST /key/health | Key Health |
| LiteLLMClient::KeyManagementApi | list_keys_key_list_get | GET /key/list | List Keys |
| LiteLLMClient::KeyManagementApi | regenerate_key_fn_key_key_regenerate_post | POST /key/{key}/regenerate | Regenerate Key Fn |
| LiteLLMClient::KeyManagementApi | regenerate_key_fn_key_regenerate_post | POST /key/regenerate | Regenerate Key Fn |
| LiteLLMClient::KeyManagementApi | unblock_key_key_unblock_post | POST /key/unblock | Unblock Key |
| LiteLLMClient::KeyManagementApi | update_key_fn_key_update_post | POST /key/update | Update Key Fn |
| LiteLLMClient::LangfusePassThroughApi | langfuse_proxy_route_langfuse_endpoint_get | GET /langfuse/{endpoint} | Langfuse Proxy Route |
| LiteLLMClient::LangfusePassThroughApi | langfuse_proxy_route_langfuse_endpoint_get_0 | PUT /langfuse/{endpoint} | Langfuse Proxy Route |
| LiteLLMClient::LangfusePassThroughApi | langfuse_proxy_route_langfuse_endpoint_get_1 | POST /langfuse/{endpoint} | Langfuse Proxy Route |
| LiteLLMClient::LangfusePassThroughApi | langfuse_proxy_route_langfuse_endpoint_get_2 | DELETE /langfuse/{endpoint} | Langfuse Proxy Route |
| LiteLLMClient::LangfusePassThroughApi | langfuse_proxy_route_langfuse_endpoint_get_3 | PATCH /langfuse/{endpoint} | Langfuse Proxy Route |
| LiteLLMClient::LlmUtilsApi | supported_openai_params_utils_supported_openai_params_get | GET /utils/supported_openai_params | Supported Openai Params |
| LiteLLMClient::LlmUtilsApi | token_counter_utils_token_counter_post | POST /utils/token_counter | Token Counter |
| LiteLLMClient::LlmUtilsApi | transform_request_utils_transform_request_post | POST /utils/transform_request | Transform Request |
| LiteLLMClient::McpApi | add_mcp_server_v1_mcp_server_post | POST /v1/mcp/server | Add Mcp Server |
| LiteLLMClient::McpApi | call_tool_rest_api_mcp_rest_tools_call_post | POST /mcp-rest/tools/call | Call Tool Rest Api |
| LiteLLMClient::McpApi | edit_mcp_server_v1_mcp_server_put | PUT /v1/mcp/server | Edit Mcp Server |
| LiteLLMClient::McpApi | fetch_all_mcp_servers_v1_mcp_server_get | GET /v1/mcp/server | Fetch All Mcp Servers |
| LiteLLMClient::McpApi | fetch_mcp_server_v1_mcp_server_server_id_get | GET /v1/mcp/server/{server_id} | Fetch Mcp Server |
| LiteLLMClient::McpApi | list_tool_rest_api_mcp_rest_tools_list_get | GET /mcp-rest/tools/list | List Tool Rest Api |
| LiteLLMClient::McpApi | remove_mcp_server_v1_mcp_server_server_id_delete | DELETE /v1/mcp/server/{server_id} | Remove Mcp Server |
| LiteLLMClient::MistralPassThroughApi | mistral_proxy_route_mistral_endpoint_get | GET /mistral/{endpoint} | Mistral Proxy Route |
| LiteLLMClient::MistralPassThroughApi | mistral_proxy_route_mistral_endpoint_get_0 | PUT /mistral/{endpoint} | Mistral Proxy Route |
| LiteLLMClient::MistralPassThroughApi | mistral_proxy_route_mistral_endpoint_get_1 | POST /mistral/{endpoint} | Mistral Proxy Route |
| LiteLLMClient::MistralPassThroughApi | mistral_proxy_route_mistral_endpoint_get_2 | DELETE /mistral/{endpoint} | Mistral Proxy Route |
| LiteLLMClient::MistralPassThroughApi | mistral_proxy_route_mistral_endpoint_get_3 | PATCH /mistral/{endpoint} | Mistral Proxy Route |
| LiteLLMClient::ModelManagementApi | add_new_model_model_new_post | POST /model/new | Add New Model |
| LiteLLMClient::ModelManagementApi | delete_model_model_delete_post | POST /model/delete | Delete Model |
| LiteLLMClient::ModelManagementApi | model_group_info_model_group_info_get | GET /model_group/info | Model Group Info |
| LiteLLMClient::ModelManagementApi | model_info_v1_model_info_get | GET /model/info | Model Info V1 |
| LiteLLMClient::ModelManagementApi | model_info_v1_v1_model_info_get | GET /v1/model/info | Model Info V1 |
| LiteLLMClient::ModelManagementApi | model_list_models_get | GET /models | Model List |
| LiteLLMClient::ModelManagementApi | model_list_v1_models_get | GET /v1/models | Model List |
| LiteLLMClient::ModelManagementApi | patch_model_model_model_id_update_patch | PATCH /model/{model_id}/update | Patch Model |
| LiteLLMClient::ModelManagementApi | update_model_model_update_post | POST /model/update | Update Model |
| LiteLLMClient::ModerationsApi | moderations_moderations_post | POST /moderations | Moderations |
| LiteLLMClient::ModerationsApi | moderations_v1_moderations_post | POST /v1/moderations | Moderations |
| LiteLLMClient::OpenAIPassThroughApi | openai_proxy_route_openai_endpoint_get | GET /openai/{endpoint} | Openai Proxy Route |
| LiteLLMClient::OpenAIPassThroughApi | openai_proxy_route_openai_endpoint_get_0 | PUT /openai/{endpoint} | Openai Proxy Route |
| LiteLLMClient::OpenAIPassThroughApi | openai_proxy_route_openai_endpoint_get_1 | POST /openai/{endpoint} | Openai Proxy Route |
| LiteLLMClient::OpenAIPassThroughApi | openai_proxy_route_openai_endpoint_get_2 | DELETE /openai/{endpoint} | Openai Proxy Route |
| LiteLLMClient::OpenAIPassThroughApi | openai_proxy_route_openai_endpoint_get_3 | PATCH /openai/{endpoint} | Openai Proxy Route |
| LiteLLMClient::OrganizationManagementApi | delete_organization_organization_delete_delete | DELETE /organization/delete | Delete Organization |
| LiteLLMClient::OrganizationManagementApi | deprecated_info_organization_organization_info_post | POST /organization/info | Deprecated Info Organization |
| LiteLLMClient::OrganizationManagementApi | info_organization_organization_info_get | GET /organization/info | Info Organization |
| LiteLLMClient::OrganizationManagementApi | list_organization_organization_list_get | GET /organization/list | List Organization |
| LiteLLMClient::OrganizationManagementApi | new_organization_organization_new_post | POST /organization/new | New Organization |
| LiteLLMClient::OrganizationManagementApi | organization_member_add_organization_member_add_post | POST /organization/member_add | Organization Member Add |
| LiteLLMClient::OrganizationManagementApi | organization_member_delete_organization_member_delete_delete | DELETE /organization/member_delete | Organization Member Delete |
| LiteLLMClient::OrganizationManagementApi | organization_member_update_organization_member_update_patch | PATCH /organization/member_update | Organization Member Update |
| LiteLLMClient::OrganizationManagementApi | update_organization_organization_update_patch | PATCH /organization/update | Update Organization |
| LiteLLMClient::PassThroughApi | anthropic_proxy_route_anthropic_endpoint_get | GET /anthropic/{endpoint} | Anthropic Proxy Route |
| LiteLLMClient::PassThroughApi | anthropic_proxy_route_anthropic_endpoint_get_0 | PUT /anthropic/{endpoint} | Anthropic Proxy Route |
| LiteLLMClient::PassThroughApi | anthropic_proxy_route_anthropic_endpoint_get_1 | POST /anthropic/{endpoint} | Anthropic Proxy Route |
| LiteLLMClient::PassThroughApi | anthropic_proxy_route_anthropic_endpoint_get_2 | DELETE /anthropic/{endpoint} | Anthropic Proxy Route |
| LiteLLMClient::PassThroughApi | anthropic_proxy_route_anthropic_endpoint_get_3 | PATCH /anthropic/{endpoint} | Anthropic Proxy Route |
| LiteLLMClient::PassThroughApi | assemblyai_proxy_route_assemblyai_endpoint_get | GET /assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::PassThroughApi | assemblyai_proxy_route_assemblyai_endpoint_get_0 | PUT /assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::PassThroughApi | assemblyai_proxy_route_assemblyai_endpoint_get_1 | POST /assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::PassThroughApi | assemblyai_proxy_route_assemblyai_endpoint_get_2 | DELETE /assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::PassThroughApi | assemblyai_proxy_route_assemblyai_endpoint_get_3 | PATCH /assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::PassThroughApi | assemblyai_proxy_route_eu_assemblyai_endpoint_get | GET /eu.assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::PassThroughApi | assemblyai_proxy_route_eu_assemblyai_endpoint_get_0 | PUT /eu.assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::PassThroughApi | assemblyai_proxy_route_eu_assemblyai_endpoint_get_1 | POST /eu.assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::PassThroughApi | assemblyai_proxy_route_eu_assemblyai_endpoint_get_2 | DELETE /eu.assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::PassThroughApi | assemblyai_proxy_route_eu_assemblyai_endpoint_get_3 | PATCH /eu.assemblyai/{endpoint} | Assemblyai Proxy Route |
| LiteLLMClient::PassThroughApi | azure_proxy_route_azure_endpoint_get | GET /azure/{endpoint} | Azure Proxy Route |
| LiteLLMClient::PassThroughApi | azure_proxy_route_azure_endpoint_get_0 | PUT /azure/{endpoint} | Azure Proxy Route |
| LiteLLMClient::PassThroughApi | azure_proxy_route_azure_endpoint_get_1 | POST /azure/{endpoint} | Azure Proxy Route |
| LiteLLMClient::PassThroughApi | azure_proxy_route_azure_endpoint_get_2 | DELETE /azure/{endpoint} | Azure Proxy Route |
| LiteLLMClient::PassThroughApi | azure_proxy_route_azure_endpoint_get_3 | PATCH /azure/{endpoint} | Azure Proxy Route |
| LiteLLMClient::PassThroughApi | bedrock_proxy_route_bedrock_endpoint_get | GET /bedrock/{endpoint} | Bedrock Proxy Route |
| LiteLLMClient::PassThroughApi | bedrock_proxy_route_bedrock_endpoint_get_0 | PUT /bedrock/{endpoint} | Bedrock Proxy Route |
| LiteLLMClient::PassThroughApi | bedrock_proxy_route_bedrock_endpoint_get_1 | POST /bedrock/{endpoint} | Bedrock Proxy Route |
| LiteLLMClient::PassThroughApi | bedrock_proxy_route_bedrock_endpoint_get_2 | DELETE /bedrock/{endpoint} | Bedrock Proxy Route |
| LiteLLMClient::PassThroughApi | bedrock_proxy_route_bedrock_endpoint_get_3 | PATCH /bedrock/{endpoint} | Bedrock Proxy Route |
| LiteLLMClient::PassThroughApi | cohere_proxy_route_cohere_endpoint_get | GET /cohere/{endpoint} | Cohere Proxy Route |
| LiteLLMClient::PassThroughApi | cohere_proxy_route_cohere_endpoint_get_0 | PUT /cohere/{endpoint} | Cohere Proxy Route |
| LiteLLMClient::PassThroughApi | cohere_proxy_route_cohere_endpoint_get_1 | POST /cohere/{endpoint} | Cohere Proxy Route |
| LiteLLMClient::PassThroughApi | cohere_proxy_route_cohere_endpoint_get_2 | DELETE /cohere/{endpoint} | Cohere Proxy Route |
| LiteLLMClient::PassThroughApi | cohere_proxy_route_cohere_endpoint_get_3 | PATCH /cohere/{endpoint} | Cohere Proxy Route |
| LiteLLMClient::PassThroughApi | gemini_proxy_route_gemini_endpoint_get | GET /gemini/{endpoint} | Gemini Proxy Route |
| LiteLLMClient::PassThroughApi | gemini_proxy_route_gemini_endpoint_get_0 | PUT /gemini/{endpoint} | Gemini Proxy Route |
| LiteLLMClient::PassThroughApi | gemini_proxy_route_gemini_endpoint_get_1 | POST /gemini/{endpoint} | Gemini Proxy Route |
| LiteLLMClient::PassThroughApi | gemini_proxy_route_gemini_endpoint_get_2 | DELETE /gemini/{endpoint} | Gemini Proxy Route |
| LiteLLMClient::PassThroughApi | gemini_proxy_route_gemini_endpoint_get_3 | PATCH /gemini/{endpoint} | Gemini Proxy Route |
| LiteLLMClient::PassThroughApi | langfuse_proxy_route_langfuse_endpoint_get | GET /langfuse/{endpoint} | Langfuse Proxy Route |
| LiteLLMClient::PassThroughApi | langfuse_proxy_route_langfuse_endpoint_get_0 | PUT /langfuse/{endpoint} | Langfuse Proxy Route |
| LiteLLMClient::PassThroughApi | langfuse_proxy_route_langfuse_endpoint_get_1 | POST /langfuse/{endpoint} | Langfuse Proxy Route |
| LiteLLMClient::PassThroughApi | langfuse_proxy_route_langfuse_endpoint_get_2 | DELETE /langfuse/{endpoint} | Langfuse Proxy Route |
| LiteLLMClient::PassThroughApi | langfuse_proxy_route_langfuse_endpoint_get_3 | PATCH /langfuse/{endpoint} | Langfuse Proxy Route |
| LiteLLMClient::PassThroughApi | mistral_proxy_route_mistral_endpoint_get | GET /mistral/{endpoint} | Mistral Proxy Route |
| LiteLLMClient::PassThroughApi | mistral_proxy_route_mistral_endpoint_get_0 | PUT /mistral/{endpoint} | Mistral Proxy Route |
| LiteLLMClient::PassThroughApi | mistral_proxy_route_mistral_endpoint_get_1 | POST /mistral/{endpoint} | Mistral Proxy Route |
| LiteLLMClient::PassThroughApi | mistral_proxy_route_mistral_endpoint_get_2 | DELETE /mistral/{endpoint} | Mistral Proxy Route |
| LiteLLMClient::PassThroughApi | mistral_proxy_route_mistral_endpoint_get_3 | PATCH /mistral/{endpoint} | Mistral Proxy Route |
| LiteLLMClient::PassThroughApi | openai_proxy_route_openai_endpoint_get | GET /openai/{endpoint} | Openai Proxy Route |
| LiteLLMClient::PassThroughApi | openai_proxy_route_openai_endpoint_get_0 | PUT /openai/{endpoint} | Openai Proxy Route |
| LiteLLMClient::PassThroughApi | openai_proxy_route_openai_endpoint_get_1 | POST /openai/{endpoint} | Openai Proxy Route |
| LiteLLMClient::PassThroughApi | openai_proxy_route_openai_endpoint_get_2 | DELETE /openai/{endpoint} | Openai Proxy Route |
| LiteLLMClient::PassThroughApi | openai_proxy_route_openai_endpoint_get_3 | PATCH /openai/{endpoint} | Openai Proxy Route |
| LiteLLMClient::PassThroughApi | vertex_discovery_proxy_route_vertex_ai_discovery_endpoint_get | GET /vertex_ai/discovery/{endpoint} | Vertex Discovery Proxy Route |
| LiteLLMClient::PassThroughApi | vertex_discovery_proxy_route_vertex_ai_discovery_endpoint_get_0 | PUT /vertex_ai/discovery/{endpoint} | Vertex Discovery Proxy Route |
| LiteLLMClient::PassThroughApi | vertex_discovery_proxy_route_vertex_ai_discovery_endpoint_get_1 | POST /vertex_ai/discovery/{endpoint} | Vertex Discovery Proxy Route |
| LiteLLMClient::PassThroughApi | vertex_discovery_proxy_route_vertex_ai_discovery_endpoint_get_2 | DELETE /vertex_ai/discovery/{endpoint} | Vertex Discovery Proxy Route |
| LiteLLMClient::PassThroughApi | vertex_discovery_proxy_route_vertex_ai_discovery_endpoint_get_3 | PATCH /vertex_ai/discovery/{endpoint} | Vertex Discovery Proxy Route |
| LiteLLMClient::PassThroughApi | vertex_proxy_route_vertex_ai_endpoint_get | GET /vertex_ai/{endpoint} | Vertex Proxy Route |
| LiteLLMClient::PassThroughApi | vertex_proxy_route_vertex_ai_endpoint_get_0 | PUT /vertex_ai/{endpoint} | Vertex Proxy Route |
| LiteLLMClient::PassThroughApi | vertex_proxy_route_vertex_ai_endpoint_get_1 | POST /vertex_ai/{endpoint} | Vertex Proxy Route |
| LiteLLMClient::PassThroughApi | vertex_proxy_route_vertex_ai_endpoint_get_2 | DELETE /vertex_ai/{endpoint} | Vertex Proxy Route |
| LiteLLMClient::PassThroughApi | vertex_proxy_route_vertex_ai_endpoint_get_3 | PATCH /vertex_ai/{endpoint} | Vertex Proxy Route |
| LiteLLMClient::PassThroughApi | vllm_proxy_route_vllm_endpoint_get | GET /vllm/{endpoint} | Vllm Proxy Route |
| LiteLLMClient::PassThroughApi | vllm_proxy_route_vllm_endpoint_get_0 | PUT /vllm/{endpoint} | Vllm Proxy Route |
| LiteLLMClient::PassThroughApi | vllm_proxy_route_vllm_endpoint_get_1 | POST /vllm/{endpoint} | Vllm Proxy Route |
| LiteLLMClient::PassThroughApi | vllm_proxy_route_vllm_endpoint_get_2 | DELETE /vllm/{endpoint} | Vllm Proxy Route |
| LiteLLMClient::PassThroughApi | vllm_proxy_route_vllm_endpoint_get_3 | PATCH /vllm/{endpoint} | Vllm Proxy Route |
| LiteLLMClient::RerankApi | rerank_rerank_post | POST /rerank | Rerank |
| LiteLLMClient::RerankApi | rerank_v1_rerank_post | POST /v1/rerank | Rerank |
| LiteLLMClient::RerankApi | rerank_v2_rerank_post | POST /v2/rerank | Rerank |
| LiteLLMClient::ResponsesApi | delete_response_responses_response_id_delete | DELETE /responses/{response_id} | Delete Response |
| LiteLLMClient::ResponsesApi | delete_response_v1_responses_response_id_delete | DELETE /v1/responses/{response_id} | Delete Response |
| LiteLLMClient::ResponsesApi | get_response_input_items_responses_response_id_input_items_get | GET /responses/{response_id}/input_items | Get Response Input Items |
| LiteLLMClient::ResponsesApi | get_response_input_items_v1_responses_response_id_input_items_get | GET /v1/responses/{response_id}/input_items | Get Response Input Items |
| LiteLLMClient::ResponsesApi | get_response_responses_response_id_get | GET /responses/{response_id} | Get Response |
| LiteLLMClient::ResponsesApi | get_response_v1_responses_response_id_get | GET /v1/responses/{response_id} | Get Response |
| LiteLLMClient::ResponsesApi | responses_api_responses_post | POST /responses | Responses Api |
| LiteLLMClient::ResponsesApi | responses_api_v1_responses_post | POST /v1/responses | Responses Api |
| LiteLLMClient::SCIMV2Api | create_group_scim_v2_groups_post | POST /scim/v2/Groups | Create Group |
| LiteLLMClient::SCIMV2Api | create_user_scim_v2_users_post | POST /scim/v2/Users | Create User |
| LiteLLMClient::SCIMV2Api | delete_group_scim_v2_groups_group_id_delete | DELETE /scim/v2/Groups/{group_id} | Delete Group |
| LiteLLMClient::SCIMV2Api | delete_user_scim_v2_users_user_id_delete | DELETE /scim/v2/Users/{user_id} | Delete User |
| LiteLLMClient::SCIMV2Api | get_group_scim_v2_groups_group_id_get | GET /scim/v2/Groups/{group_id} | Get Group |
| LiteLLMClient::SCIMV2Api | get_groups_scim_v2_groups_get | GET /scim/v2/Groups | Get Groups |
| LiteLLMClient::SCIMV2Api | get_user_scim_v2_users_user_id_get | GET /scim/v2/Users/{user_id} | Get User |
| LiteLLMClient::SCIMV2Api | get_users_scim_v2_users_get | GET /scim/v2/Users | Get Users |
| LiteLLMClient::SCIMV2Api | patch_group_scim_v2_groups_group_id_patch | PATCH /scim/v2/Groups/{group_id} | Patch Group |
| LiteLLMClient::SCIMV2Api | patch_user_scim_v2_users_user_id_patch | PATCH /scim/v2/Users/{user_id} | Patch User |
| LiteLLMClient::SCIMV2Api | update_group_scim_v2_groups_group_id_put | PUT /scim/v2/Groups/{group_id} | Update Group |
| LiteLLMClient::SCIMV2Api | update_user_scim_v2_users_user_id_put | PUT /scim/v2/Users/{user_id} | Update User |
| LiteLLMClient::SSOSettingsApi | get_default_team_settings_get_default_team_settings_get | GET /get/default_team_settings | Get Default Team Settings |
| LiteLLMClient::SSOSettingsApi | get_internal_user_settings_get_internal_user_settings_get | GET /get/internal_user_settings | Get Internal User Settings |
| LiteLLMClient::SSOSettingsApi | get_sso_settings_get_sso_settings_get | GET /get/sso_settings | Get Sso Settings |
| LiteLLMClient::SSOSettingsApi | update_default_team_settings_update_default_team_settings_patch | PATCH /update/default_team_settings | Update Default Team Settings |
| LiteLLMClient::SSOSettingsApi | update_internal_user_settings_update_internal_user_settings_patch | PATCH /update/internal_user_settings | Update Internal User Settings |
| LiteLLMClient::SSOSettingsApi | update_sso_settings_update_sso_settings_patch | PATCH /update/sso_settings | Update Sso Settings |
| LiteLLMClient::TagManagementApi | delete_tag_tag_delete_post | POST /tag/delete | Delete Tag |
| LiteLLMClient::TagManagementApi | get_tag_daily_activity_tag_daily_activity_get | GET /tag/daily/activity | Get Tag Daily Activity |
| LiteLLMClient::TagManagementApi | info_tag_tag_info_post | POST /tag/info | Info Tag |
| LiteLLMClient::TagManagementApi | list_tags_tag_list_get | GET /tag/list | List Tags |
| LiteLLMClient::TagManagementApi | new_tag_tag_new_post | POST /tag/new | New Tag |
| LiteLLMClient::TagManagementApi | update_tag_tag_update_post | POST /tag/update | Update Tag |
| LiteLLMClient::TeamManagementApi | add_team_callbacks_team_team_id_callback_post | POST /team/{team_id}/callback | Add Team Callbacks |
| LiteLLMClient::TeamManagementApi | block_team_team_block_post | POST /team/block | Block Team |
| LiteLLMClient::TeamManagementApi | delete_team_team_delete_post | POST /team/delete | Delete Team |
| LiteLLMClient::TeamManagementApi | disable_team_logging_team_team_id_disable_logging_post | POST /team/{team_id}/disable_logging | Disable Team Logging |
| LiteLLMClient::TeamManagementApi | get_team_callbacks_team_team_id_callback_get | GET /team/{team_id}/callback | Get Team Callbacks |
| LiteLLMClient::TeamManagementApi | get_team_daily_activity_team_daily_activity_get | GET /team/daily/activity | Get Team Daily Activity |
| LiteLLMClient::TeamManagementApi | list_team_team_list_get | GET /team/list | List Team |
| LiteLLMClient::TeamManagementApi | list_team_v2_v2_team_list_get | GET /v2/team/list | List Team V2 |
| LiteLLMClient::TeamManagementApi | new_team_team_new_post | POST /team/new | New Team |
| LiteLLMClient::TeamManagementApi | team_info_team_info_get | GET /team/info | Team Info |
| LiteLLMClient::TeamManagementApi | team_member_add_team_member_add_post | POST /team/member_add | Team Member Add |
| LiteLLMClient::TeamManagementApi | team_member_delete_team_member_delete_post | POST /team/member_delete | Team Member Delete |
| LiteLLMClient::TeamManagementApi | team_member_permissions_team_permissions_list_get | GET /team/permissions_list | Team Member Permissions |
| LiteLLMClient::TeamManagementApi | team_member_update_team_member_update_post | POST /team/member_update | Team Member Update |
| LiteLLMClient::TeamManagementApi | team_model_add_team_model_add_post | POST /team/model/add | Team Model Add |
| LiteLLMClient::TeamManagementApi | team_model_delete_team_model_delete_post | POST /team/model/delete | Team Model Delete |
| LiteLLMClient::TeamManagementApi | unblock_team_team_unblock_post | POST /team/unblock | Unblock Team |
| LiteLLMClient::TeamManagementApi | update_team_member_permissions_team_permissions_update_post | POST /team/permissions_update | Update Team Member Permissions |
| LiteLLMClient::TeamManagementApi | update_team_team_update_post | POST /team/update | Update Team |
| LiteLLMClient::VLLMPassThroughApi | vllm_proxy_route_vllm_endpoint_get | GET /vllm/{endpoint} | Vllm Proxy Route |
| LiteLLMClient::VLLMPassThroughApi | vllm_proxy_route_vllm_endpoint_get_0 | PUT /vllm/{endpoint} | Vllm Proxy Route |
| LiteLLMClient::VLLMPassThroughApi | vllm_proxy_route_vllm_endpoint_get_1 | POST /vllm/{endpoint} | Vllm Proxy Route |
| LiteLLMClient::VLLMPassThroughApi | vllm_proxy_route_vllm_endpoint_get_2 | DELETE /vllm/{endpoint} | Vllm Proxy Route |
| LiteLLMClient::VLLMPassThroughApi | vllm_proxy_route_vllm_endpoint_get_3 | PATCH /vllm/{endpoint} | Vllm Proxy Route |
| LiteLLMClient::VectorStoreManagementApi | delete_vector_store_vector_store_delete_post | POST /vector_store/delete | Delete Vector Store |
| LiteLLMClient::VectorStoreManagementApi | list_vector_stores_vector_store_list_get | GET /vector_store/list | List Vector Stores |
| LiteLLMClient::VectorStoreManagementApi | new_vector_store_vector_store_new_post | POST /vector_store/new | New Vector Store |
| LiteLLMClient::VertexAIPassThroughApi | vertex_discovery_proxy_route_vertex_ai_discovery_endpoint_get | GET /vertex_ai/discovery/{endpoint} | Vertex Discovery Proxy Route |
| LiteLLMClient::VertexAIPassThroughApi | vertex_discovery_proxy_route_vertex_ai_discovery_endpoint_get_0 | PUT /vertex_ai/discovery/{endpoint} | Vertex Discovery Proxy Route |
| LiteLLMClient::VertexAIPassThroughApi | vertex_discovery_proxy_route_vertex_ai_discovery_endpoint_get_1 | POST /vertex_ai/discovery/{endpoint} | Vertex Discovery Proxy Route |
| LiteLLMClient::VertexAIPassThroughApi | vertex_discovery_proxy_route_vertex_ai_discovery_endpoint_get_2 | DELETE /vertex_ai/discovery/{endpoint} | Vertex Discovery Proxy Route |
| LiteLLMClient::VertexAIPassThroughApi | vertex_discovery_proxy_route_vertex_ai_discovery_endpoint_get_3 | PATCH /vertex_ai/discovery/{endpoint} | Vertex Discovery Proxy Route |
| LiteLLMClient::VertexAIPassThroughApi | vertex_proxy_route_vertex_ai_endpoint_get | GET /vertex_ai/{endpoint} | Vertex Proxy Route |
| LiteLLMClient::VertexAIPassThroughApi | vertex_proxy_route_vertex_ai_endpoint_get_0 | PUT /vertex_ai/{endpoint} | Vertex Proxy Route |
| LiteLLMClient::VertexAIPassThroughApi | vertex_proxy_route_vertex_ai_endpoint_get_1 | POST /vertex_ai/{endpoint} | Vertex Proxy Route |
| LiteLLMClient::VertexAIPassThroughApi | vertex_proxy_route_vertex_ai_endpoint_get_2 | DELETE /vertex_ai/{endpoint} | Vertex Proxy Route |
| LiteLLMClient::VertexAIPassThroughApi | vertex_proxy_route_vertex_ai_endpoint_get_3 | PATCH /vertex_ai/{endpoint} | Vertex Proxy Route |
Documentation for Models
- LiteLLMClient::AddTeamCallback
- LiteLLMClient::Annotations
- LiteLLMClient::ApiBase
- LiteLLMClient::ApiKey
- LiteLLMClient::ApiVersion
- LiteLLMClient::ApplyGuardrailRequest
- LiteLLMClient::ApplyGuardrailResponse
- LiteLLMClient::AuditLogResponse
- LiteLLMClient::AwsAccessKeyId
- LiteLLMClient::AwsRegionName
- LiteLLMClient::AwsSecretAccessKey
- LiteLLMClient::BaseModel
- LiteLLMClient::BatchSize
- LiteLLMClient::BlockKeyRequest
- LiteLLMClient::BlockTeamRequest
- LiteLLMClient::BlockUsers
- LiteLLMClient::BodyTestModelConnectionHealthTestConnectionPost
- LiteLLMClient::BreakdownMetrics
- LiteLLMClient::BudgetConfig
- LiteLLMClient::BudgetDeleteRequest
- LiteLLMClient::BudgetDuration
- LiteLLMClient::BudgetNewRequest
- LiteLLMClient::BudgetRequest
- LiteLLMClient::Bytes
- LiteLLMClient::CacheControl
- LiteLLMClient::CachePingResponse
- LiteLLMClient::CallTypes
- LiteLLMClient::ChatCompletionAnnotation
- LiteLLMClient::ChatCompletionAnnotationURLCitation
- LiteLLMClient::ChatCompletionAudioResponse
- LiteLLMClient::ChatCompletionCachedContent
- LiteLLMClient::ChatCompletionRedactedThinkingBlock
- LiteLLMClient::ChatCompletionThinkingBlock
- LiteLLMClient::ChatCompletionTokenLogprob
- LiteLLMClient::ChoiceLogprobs
- LiteLLMClient::Choices
- LiteLLMClient::Choices1Inner
- LiteLLMClient::ConfigurableClientsideAuthParams
- LiteLLMClient::ConfigurableClientsideAuthParamsAnyOfInner
- LiteLLMClient::ConfigurableClientsideParamsCustomAuth
- LiteLLMClient::Content
- LiteLLMClient::Content1
- LiteLLMClient::CreateCredentialItem
- LiteLLMClient::CreateGuardrailRequest
- LiteLLMClient::CreatedAt
- LiteLLMClient::CreatedBy
- LiteLLMClient::CredentialItem
- LiteLLMClient::CustomLlmProvider
- LiteLLMClient::CustomLlmProvider1
- LiteLLMClient::DailySpendData
- LiteLLMClient::DailySpendMetadata
- LiteLLMClient::DefaultInternalUserParams
- LiteLLMClient::DefaultTeamSSOParams
- LiteLLMClient::DefaultTeamSettingsResponse
- LiteLLMClient::DeleteCustomerRequest
- LiteLLMClient::DeleteOrganizationRequest
- LiteLLMClient::DeleteTeamRequest
- LiteLLMClient::DeleteUserRequest
- LiteLLMClient::Deployment
- LiteLLMClient::Description
- LiteLLMClient::Destructivehint
- LiteLLMClient::EmailEvent
- LiteLLMClient::EmailEventSettings
- LiteLLMClient::EmailEventSettingsResponse
- LiteLLMClient::EmailEventSettingsUpdateRequest
- LiteLLMClient::Endtime
- LiteLLMClient::ErrorResponse
- LiteLLMClient::Expires
- LiteLLMClient::FunctionCall
- LiteLLMClient::GenerateKeyRequest
- LiteLLMClient::GenerateKeyResponse
- LiteLLMClient::GetTeamMemberPermissionsResponse
- LiteLLMClient::Guardrail
- LiteLLMClient::GuardrailInfoLiteLLMParamsResponse
- LiteLLMClient::GuardrailInfoResponse
- LiteLLMClient::HTTPValidationError
- LiteLLMClient::Hyperparameters
- LiteLLMClient::IPAddress
- LiteLLMClient::Id
- LiteLLMClient::Idempotenthint
- LiteLLMClient::InputCostPerPixel
- LiteLLMClient::InputCostPerSecond
- LiteLLMClient::InputCostPerToken
- LiteLLMClient::Integrations
- LiteLLMClient::InternalUserSettingsResponse
- LiteLLMClient::KeyHealthResponse
- LiteLLMClient::KeyListResponseObject
- LiteLLMClient::KeyListResponseObjectKeysInner
- LiteLLMClient::KeyMetadata
- LiteLLMClient::KeyMetricWithMetadata
- LiteLLMClient::KeyRequest
- LiteLLMClient::LakeraCategoryThresholds
- LiteLLMClient::LearningRateMultiplier
- LiteLLMClient::ListGuardrailsResponse
- LiteLLMClient::ListMCPToolsRestAPIResponseObject
- LiteLLMClient::ListMCPToolsRestAPIResponseObjectAnnotations
- LiteLLMClient::ListMCPToolsRestAPIResponseObjectMcpInfo
- LiteLLMClient::LiteLLMBudgetTable
- LiteLLMClient::LiteLLMEndUserTable
- LiteLLMClient::LiteLLMFineTuningJobCreate
- LiteLLMClient::LiteLLMFineTuningJobCreateHyperparameters
- LiteLLMClient::LiteLLMMCPServerTable
- LiteLLMClient::LiteLLMManagedVectorStore
- LiteLLMClient::LiteLLMManagedVectorStoreListResponse
- LiteLLMClient::LiteLLMModelTable
- LiteLLMClient::LiteLLMObjectPermissionBase
- LiteLLMClient::LiteLLMObjectPermissionTable
- LiteLLMClient::LiteLLMOrganizationMembershipTable
- LiteLLMClient::LiteLLMOrganizationTableUpdate
- LiteLLMClient::LiteLLMOrganizationTableWithMembers
- LiteLLMClient::LiteLLMParams
- LiteLLMClient::LiteLLMSpendLogs
- LiteLLMClient::LiteLLMTeamMembership
- LiteLLMClient::LiteLLMTeamTable
- LiteLLMClient::LiteLLMUserTable
- LiteLLMClient::LiteLLMUserTableWithKeyCount
- LiteLLMClient::LiteLLMVerificationToken
- LiteLLMClient::LitellmCredentialName
- LiteLLMClient::LitellmParams
- LiteLLMClient::LitellmTraceId
- LiteLLMClient::LitellmUserRoles
- LiteLLMClient::LoggingCallbackStatus
- LiteLLMClient::Logprobs
- LiteLLMClient::MCPInfo
- LiteLLMClient::MaxBudget
- LiteLLMClient::MaxFileSizeMb
- LiteLLMClient::MaxRetries
- LiteLLMClient::Member
- LiteLLMClient::Member1
- LiteLLMClient::Member2
- LiteLLMClient::MergeReasoningContentInChoices
- LiteLLMClient::Message
- LiteLLMClient::MessageAudio
- LiteLLMClient::MessageFunctionCall
- LiteLLMClient::Messages
- LiteLLMClient::MetricWithMetadata
- LiteLLMClient::MockResponse
- LiteLLMClient::Mode
- LiteLLMClient::Mode1
- LiteLLMClient::Model
- LiteLLMClient::ModelAliases
- LiteLLMClient::ModelInfo
- LiteLLMClient::ModelInfoDelete
- LiteLLMClient::ModelResponse
- LiteLLMClient::NEpochs
- LiteLLMClient::Name
- LiteLLMClient::NewCustomerRequest
- LiteLLMClient::NewMCPServerRequest
- LiteLLMClient::NewOrganizationRequest
- LiteLLMClient::NewOrganizationResponse
- LiteLLMClient::NewTeamRequest
- LiteLLMClient::NewUserRequest
- LiteLLMClient::NewUserResponse
- LiteLLMClient::Openworldhint
- LiteLLMClient::OrgMember
- LiteLLMClient::Organization
- LiteLLMClient::OrganizationAddMemberResponse
- LiteLLMClient::OrganizationMemberAddRequest
- LiteLLMClient::OrganizationMemberDeleteRequest
- LiteLLMClient::OrganizationMemberUpdateRequest
- LiteLLMClient::OrganizationRequest
- LiteLLMClient::OutputCostPerPixel
- LiteLLMClient::OutputCostPerSecond
- LiteLLMClient::OutputCostPerToken
- LiteLLMClient::PaginatedAuditLogResponse
- LiteLLMClient::PassThroughEndpointResponse
- LiteLLMClient::PassThroughGenericEndpoint
- LiteLLMClient::PatchGuardrailLitellmParams
- LiteLLMClient::PatchGuardrailRequest
- LiteLLMClient::PiiAction
- LiteLLMClient::PiiEntityType
- LiteLLMClient::ProviderBudgetResponse
- LiteLLMClient::ProviderBudgetResponseObject
- LiteLLMClient::ProviderSpecificFields
- LiteLLMClient::RawRequestTypedDict
- LiteLLMClient::Readonlyhint
- LiteLLMClient::ReasoningContent
- LiteLLMClient::RegenerateKeyRequest
- LiteLLMClient::RegionName
- LiteLLMClient::Resources
- LiteLLMClient::Response
- LiteLLMClient::Rpm
- LiteLLMClient::SCIMGroup
- LiteLLMClient::SCIMListResponse
- LiteLLMClient::SCIMMember
- LiteLLMClient::SCIMPatchOp
- LiteLLMClient::SCIMPatchOperation
- LiteLLMClient::SCIMUser
- LiteLLMClient::SCIMUserEmail
- LiteLLMClient::SCIMUserGroup
- LiteLLMClient::SCIMUserName
- LiteLLMClient::SSOConfig
- LiteLLMClient::SSOSettingsResponse
- LiteLLMClient::Seed
- LiteLLMClient::Service
- LiteLLMClient::SpendAnalyticsPaginatedResponse
- LiteLLMClient::SpendCalculateRequest
- LiteLLMClient::SpendMetrics
- LiteLLMClient::Starttime
- LiteLLMClient::StreamTimeout
- LiteLLMClient::Suffix
- LiteLLMClient::SystemFingerprint
- LiteLLMClient::TagConfig
- LiteLLMClient::TagDeleteRequest
- LiteLLMClient::TagInfoRequest
- LiteLLMClient::TagNewRequest
- LiteLLMClient::TagUpdateRequest
- LiteLLMClient::TeamAddMemberResponse
- LiteLLMClient::TeamId
- LiteLLMClient::TeamListResponse
- LiteLLMClient::TeamMemberAddRequest
- LiteLLMClient::TeamMemberDeleteRequest
- LiteLLMClient::TeamMemberUpdateRequest
- LiteLLMClient::TeamMemberUpdateResponse
- LiteLLMClient::TeamModelAddRequest
- LiteLLMClient::TeamModelDeleteRequest
- LiteLLMClient::TeamPublicModelName
- LiteLLMClient::ThinkingBlocks
- LiteLLMClient::ThinkingBlocksAnyOfInner
- LiteLLMClient::Tier
- LiteLLMClient::Timeout
- LiteLLMClient::Title
- LiteLLMClient::TokenCountRequest
- LiteLLMClient::TokenCountResponse
- LiteLLMClient::ToolAnnotations
- LiteLLMClient::ToolCalls
- LiteLLMClient::TopLogprob
- LiteLLMClient::Tpm
- LiteLLMClient::TransformRequestBody
- LiteLLMClient::UiDiscoveryEndpoints
- LiteLLMClient::UpdateCustomerRequest
- LiteLLMClient::UpdateDeployment
- LiteLLMClient::UpdateGuardrailRequest
- LiteLLMClient::UpdateKeyRequest
- LiteLLMClient::UpdateLiteLLMParams
- LiteLLMClient::UpdateMCPServerRequest
- LiteLLMClient::UpdateTeamMemberPermissionsRequest
- LiteLLMClient::UpdateTeamRequest
- LiteLLMClient::UpdateUserRequest
- LiteLLMClient::UpdatedAt
- LiteLLMClient::UpdatedBy
- LiteLLMClient::UseInPassThrough
- LiteLLMClient::UseLitellmProxy
- LiteLLMClient::UserAPIKeyAuth
- LiteLLMClient::UserListResponse
- LiteLLMClient::ValidationError
- LiteLLMClient::ValidationErrorLocInner
- LiteLLMClient::ValidationFile
- LiteLLMClient::VectorStoreDeleteRequest
- LiteLLMClient::VectorStoreMetadata
- LiteLLMClient::VertexCredentials
- LiteLLMClient::VertexLocation
- LiteLLMClient::VertexProject
- LiteLLMClient::WatsonxRegionName
Documentation for Authorization
Authentication schemes defined for the API:
APIKeyHeader
- Type: API key
- API key parameter name: x-litellm-api-key
- Location: HTTP header