A Python SDK that serves as a proxy server to connect with over 100 LLM APIs, providing cost tracking, guardrails, load balancing, and logging functionalities.
Integrations
OpenAIBedrockAzureVertexAICohereSagemakerHuggingFaceVLLMNVIDIA NIM
A Python SDK that serves as a proxy server to connect with over 100 LLM APIs, providing cost tracking, guardrails, load balancing, and logging functionalities.
Is BerriAI LLM Proxy Server free?
BerriAI LLM Proxy Server is a paid mcp server priced at $19.
What does BerriAI LLM Proxy Server integrate with?
BerriAI LLM Proxy Server works with OpenAI, Bedrock, Azure, VertexAI, Cohere, Sagemaker, HuggingFace, VLLM, NVIDIA NIM.
What type of Claude skill is BerriAI LLM Proxy Server?
BerriAI LLM Proxy Server is a mcp server for Claude, listed on AI Automated Tool Hub from GitHub.
Where can I get BerriAI LLM Proxy Server?
You can access BerriAI LLM Proxy Server at https://github.com/BerriAI/litellm.
BerriAI LLM Proxy Server | Josh Kincaid's AI Tool Hub