286 llama.cpp(1) - Kailash Tool Reference
286.1 llama.cpp
llama.cpp - llama.cpp — LLM inference in C/C++ (CPU/GPU quantized inference).
| Layer | OPS |
| Category | o-04-local-llm-inference-labs |
| Safety class | safe |
| Licence | MIT |
| Upstream | github.com/ggml-org/llama.cpp |
286.1.1 NAME
llama.cpp - llama.cpp — LLM inference in C/C++ (CPU/GPU quantized inference).
286.1.2 SYNOPSIS & usage
Derived from the upstream README at generation time; verify against --help where the tool is installed.
# curl
curl -LsSf https://llama.app/install.sh | sh
# powershell
irm https://llama.app/install.ps1 | iex# Download and run a model directly from Hugging Face
llama cli -hf ggml-org/Qwen3.5-0.8B-GGUF
# Launch OpenAI-compatible API server
llama serve -hf ggml-org/Qwen3.5-0.8B-GGUF286.1.3 DESCRIPTION (upstream)
ggml / ops / [maintainer PRs](https://github.com/ggml-org/llama.cpp/issues?q=is%3Apr%20is%3Aopen%20draft%3AFalse%20(author%3Argerganov%20OR%20author%3AKitaitiMakoto%20OR%20author%3Adanbev%20OR%20author%3Aaldehir%20OR%20author%3Amax-krasnyansky%20OR%20author%3ACISC%20OR%20author%3Aggerganov%20OR%20author%3Aam17an%20OR%20author%3Ajhen0409%20OR%20author%3Abartowski1182%20OR%20author%3Anikwen%20OR%20author%3Ahipudding%20OR%20author%3Aravi9%20OR%20author%3AServeurpersoCom%20OR%20author%3Apwilkin%20OR%20author%3Areeselevine%20OR%20author%3Angxson%20OR%20author%3Ajeffbolznv%20OR%20author%3Amarty1885
286.1.4 CONFIGURATION (detected)
Config-surface markers detected in the upstream README (6 matches, e.g. server.yml, server.yml). A full config reference page for this tool is queued under the config-page policy — this line is the detection record, not the page.
286.1.5 SEE ALSO
- Category: o-04-local-llm-inference-labs in the category directory (sister tools listed there).
- Configuration reference — files, environment variables, samples.
ref: pin - verified 2026-10-14