vLLM is a Claude Plugin/Integration in the IT & Engineering category. A fast and efficient library for distributed model serving designed to support large language models. It works with Linux. Listed on AI Automated Tool Hub, sourced from Reddit:r/LocalLLaMA.
Discovered on Reddit:r/LocalLLaMA via Reddit:r/LocalLLaMA