A Python SDK and Proxy Server that allows users to call over 100 LLM APIs in both OpenAI and native formats while providing cost tracking, guardrails, load balancing, and logging.
Integrations
OpenAIBedrockAzureVertexAICohereSagemakerHuggingFaceVLLMNVIDIA NIM