AlexsJones/llmfit
llmfit inspects CPU cores, system memory, discrete and integrated GPUs, VRAM and unified memory, then estimates which models fit across GGUF, AWQ, GPTQ and EXL2 quantizations. It scores candidates on quality, speed, fit and context, and offers an interactive TUI, a web dashboard and a JSON REST API. Models can also be downloaded, served and benchmarked locally, with results contributed back as pull requests.
Maintenance activity