Built for Linux GPU servers; macOS and Windows support is limited. Still 0.x.
- Type
- Dev tool
- Group
- AI & agents
- Category
- Local models
- By
- @vllm-project
- GitHub stars
- 95,755
- License
- oss
More in AI & agents
Open-source terminal coding agent for any model
Run open models locally behind a simple API
Anthropic's agentic coding tool for the terminal and IDEs
Model, tool and retriever building blocks for LLM apps
C/C++ inference for GGUF models on CPU and GPU
OpenAI's coding agent for terminal, IDE and cloud
Read it from code
curl 'https://tools.flisk.si/api/tools/vllm'