Dev tool · Local models

llama.cpp

C/C++ inference for GGUF models on CPU and GPU

Open llama.cpp GitHub

Ships many builds a day with pre-1.0 versions; pin a build for reproducible results.

Type
Dev tool
Group
AI & agents
Category
Local models
By
@ggml-org
GitHub stars
132,615
License
oss

More in AI & agents

Read it from code

curl 'https://tools.flisk.si/api/tools/llama-cpp'