Python SDK and Proxy Server that allows users to call over 100 LLM APIs in a standardized format, featuring cost tracking, guardrails, load balancing, and logging.
Integrations
OpenAIBedrockAzureVertexAICohereAnthropicSagemakerHuggingFaceVLLMNVIDIA NIM