# ggml-org/llama.cpp

> C/C++ inference engine that runs quantized LLMs and vision models on CPU and GPU

Navigation: [Artificial Intelligence](category/artificial-intelligence.txt) · [Index](../llms.txt)

## Facts

- GitHub: https://github.com/ggml-org/llama.cpp
- HTML: https://awesomeopensource.dev/project/ggml-org-llama-cpp
- Website: https://llama.app
- License: MIT
- Language: C++
- stars: 134864
- Topics: ggml
- Activity score: 4.8/5 (Thriving)
- Last commit (any branch): 2026-11-13
- Last release: v1.0.0 2026-11-13

## Description

A dependency-free C/C++ inference engine for large language and vision models, from laptops to servers. It offers 1.5- to 8-bit integer quantization, Apple Metal, CUDA, HIP, Vulkan and SYCL backends, plus CPU+GPU hybrid inference for models larger than available VRAM. A single command downloads a GGUF model from Hugging Face, and llama-server exposes an OpenAI-compatible API with a built-in web UI.

## Maintenance activity

- Recency: 100% (weight 40%) — last commit: 0 days ago
- Commit volume: 100% (weight 25%)
- Releases: 100% (weight 25%) — last release: 0 days ago
- Bug fixes: 56% (weight 10%)
- Commits: 1923 / 90d, 5319 / 365d

## Similar projects

- [openclaw/openclaw](openclaw-openclaw.md): Open-source AI assistant that lives on your own hardware and in your chat apps · Activity score 5.0/5 (Thriving)
- [n8n-io/n8n](n8n-io-n8n.md): Fair-code workflow automation with a visual canvas, custom code and 1500+ integrations · Activity score 5.0/5 (Thriving)
- [langgenius/dify](langgenius-dify.md): Visual platform for building LLM apps with RAG pipelines, agents and model integrations · Activity score 5.0/5 (Thriving)
- [open-webui/open-webui](open-webui-open-webui.md): Self-hosted web UI for chatting with Ollama and OpenAI-compatible models offline · Activity score 5.0/5 (Thriving)
- [langchain-ai/langchain](langchain-ai-langchain.md): Python framework for building agents and LLM applications from composable components · Activity score 5.0/5 (Thriving)
- [paperclipai/paperclip](paperclipai-paperclip.md): Manage a team of AI agents with goals, budgets and task tracking · Activity score 5.0/5 (Thriving)
