# getumbrel/llama-gpt

> Self-hosted, offline ChatGPT-style chatbot running Llama 2 models

Navigation: [Artificial Intelligence](category/artificial-intelligence.txt) · [Index](../llms.txt)

## Facts

- GitHub: https://github.com/getumbrel/llama-gpt
- HTML: https://awesomeopensource.dev/project/getumbrel-llama-gpt
- Website: https://apps.umbrel.com/app/llama-gpt
- License: MIT
- Language: TypeScript
- stars: 10923
- Topics: ai, chatgpt, code-llama, codellama, gpt, gpt-4, gpt4all, llama, llama-2, llama-cpp, llama2, llamacpp, llm, localai, openai, self-hosted
- Activity score: 1.4/5 (Abandoned)
- Last commit (any branch): 2024-04-23

## Description

LlamaGPT packages a chat interface with llama.cpp and a choice of quantised Llama 2 and Code Llama models, so conversations stay on the machine and no data leaves it. It installs from the Umbrel app store or with Docker and Kubernetes, needs between 6 GB and 41 GB of memory depending on model size, and can use Nvidia GPUs. An OpenAI-compatible API is exposed alongside the chat UI.

## Maintenance activity

- Recency: 0% (weight 53%) — last commit: 934 days ago
- Commit volume: 0% (weight 33%)
- Bug fixes: 84% (weight 13%)
- Commits: 0 / 90d, 0 / 365d
- Cap applied: no commits for more than 2 years

## Screenshots

- [Screenshot of the LlamaGPT chat interface showing a conversation with the local model](https://awesomeopensource.dev/uploads/1543/dc22726414dfeab4.png)

## Similar projects

- [openclaw/openclaw](openclaw-openclaw.md): Open-source AI assistant that lives on your own hardware and in your chat apps · Activity score 5.0/5 (Thriving)
- [n8n-io/n8n](n8n-io-n8n.md): Fair-code workflow automation with a visual canvas, custom code and 1500+ integrations · Activity score 5.0/5 (Thriving)
- [langgenius/dify](langgenius-dify.md): Visual platform for building LLM apps with RAG pipelines, agents and model integrations · Activity score 5.0/5 (Thriving)
- [open-webui/open-webui](open-webui-open-webui.md): Self-hosted web UI for chatting with Ollama and OpenAI-compatible models offline · Activity score 5.0/5 (Thriving)
- [langchain-ai/langchain](langchain-ai-langchain.md): Python framework for building agents and LLM applications from composable components · Activity score 5.0/5 (Thriving)
- [paperclipai/paperclip](paperclipai-paperclip.md): Manage a team of AI agents with goals, budgets and task tracking · Activity score 5.0/5 (Thriving)
