stew675/llama-cpp-rdna-boosts
A collection of 17 patches applied on top of a specific llama.cpp commit, adding RDNA-specific optimizations such as MTP decode, chunked gated-delta-net prefill, BF16 KV cache, WMMA flash attention, fused MoE and k-quant decode paths. Changes are enabled by default, with environment variables documented for tuning or disabling each one. Targets RDNA3 and RDNA4 cards through HIP and ROCm.
Maintenance activity