Dev tool · Local models
LocalAI
Self-hosted OpenAI-compatible API for many model types
Container images are large because they bundle several inference backends.
- Type
- Dev tool
- Group
- AI & agents
- Category
- Local models
- By
- @mudler
- GitHub stars
- 50,022
- License
- oss
More in AI & agents
Open-source terminal coding agent for any model
Run open models locally behind a simple API
Anthropic's agentic coding tool for the terminal and IDEs
Model, tool and retriever building blocks for LLM apps
C/C++ inference for GGUF models on CPU and GPU
OpenAI's coding agent for terminal, IDE and cloud
Read it from code
curl 'https://tools.flisk.si/api/tools/localai'