A Python SDK and Proxy Server that enables users to call over 100 LLM APIs in an OpenAI-compatible format while providing cost tracking, guardrails, load balancing, and logging.
Integrations
OpenAIBedrockAzureVertexAICohereSagemakerHuggingFaceVLLMNVIDIA NIM