A Python SDK that serves as a proxy server to call over 100 LLM APIs in an OpenAI or native format with advanced features like cost tracking and load balancing.
Integrations
BedrockAzureOpenAIVertexAICohereSagemakerHuggingFaceVLLMNVIDIA NIM
A Python SDK that serves as a proxy server to call over 100 LLM APIs in an OpenAI or native format with advanced features like cost tracking and load balancing.
Is AI Gateway Proxy Server free?
AI Gateway Proxy Server is a paid mcp server priced at $99.
What does AI Gateway Proxy Server integrate with?
AI Gateway Proxy Server works with Bedrock, Azure, OpenAI, VertexAI, Cohere, Sagemaker, HuggingFace, VLLM, NVIDIA NIM.
What type of Claude skill is AI Gateway Proxy Server?
AI Gateway Proxy Server is a mcp server for Claude, listed on AI Automated Tool Hub from GitHub.
Where can I get AI Gateway Proxy Server?
You can access AI Gateway Proxy Server at https://github.com/BerriAI/litellm.