# Niko1221/Strata

> Run very large MoE models locally with SSD offloading and a local API

Navigation: [Artificial Intelligence](category/artificial-intelligence.txt) · [Index](../llms.txt)

## Facts

- GitHub: https://github.com/Niko1221/Strata
- HTML: https://awesomeopensource.dev/project/niko1221-strata
- License: MIT
- Language: C++
- stars: 43898
- Activity score: 4.8/5 (Thriving)
- Last commit (any branch): 2026-11-12
- Last release: v0.2.13 2026-11-09

## Description

A desktop inference engine that runs very large mixture-of-experts models on consumer hardware by streaming weights from an SSD for the parts that do not fit in memory. It installs in one click on Windows and Linux, supports Nvidia RTX 30 to 50 series, AMD Radeon on Linux, Ryzen AI Max and Apple Silicon, and exposes OpenAI- and Anthropic-compatible APIs on localhost with optional image input. Licensed under MIT.

## Maintenance activity

- Recency: 99% (weight 40%) — last commit: 1 days ago
- Commit volume: 100% (weight 25%)
- Releases: 99% (weight 25%) — last release: 4 days ago
- Bug fixes: 58% (weight 10%)
- Commits: 6319 / 90d, 6319 / 365d

## Screenshots

- [Screenshot of the Strata terminal monitor showing serving stages and live requests](https://awesomeopensource.dev/uploads/1494/f6d77d76ec6b487b.png)
- [Screenshot of the Strata terminal request detail view with prompt and cache statistics](https://awesomeopensource.dev/uploads/1494/1f6b0d11a62e7e71.png)

## Similar projects

- [openclaw/openclaw](openclaw-openclaw.md): Open-source AI assistant that lives on your own hardware and in your chat apps · Activity score 5.0/5 (Thriving)
- [n8n-io/n8n](n8n-io-n8n.md): Fair-code workflow automation with a visual canvas, custom code and 1500+ integrations · Activity score 5.0/5 (Thriving)
- [langgenius/dify](langgenius-dify.md): Visual platform for building LLM apps with RAG pipelines, agents and model integrations · Activity score 5.0/5 (Thriving)
- [open-webui/open-webui](open-webui-open-webui.md): Self-hosted web UI for chatting with Ollama and OpenAI-compatible models offline · Activity score 5.0/5 (Thriving)
- [langchain-ai/langchain](langchain-ai-langchain.md): Python framework for building agents and LLM applications from composable components · Activity score 5.0/5 (Thriving)
- [paperclipai/paperclip](paperclipai-paperclip.md): Manage a team of AI agents with goals, budgets and task tracking · Activity score 5.0/5 (Thriving)
