Loading
Loading page content.Loading
Loading page content.Archive / 2026-09-13
<details open> common : move llama_n_rs_seq to before llama_decode (#28749) This commit moves the llama_n_rs_seq function call to before the llama_decode call and returns directly if the check is true, removing the setting of res and the goto statement. The motivation for this c…
github.com1 month agoView details
<details open> ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (#28846) * ggml-cuda: fallback to F32 on device without BF16 hardware acceleration: (Nvidia >= AMPERE, AMD >= RDNA3 or = CDNA) * apply logic to NVIDIA as well --------- Co-authored-by: Johanne…
github.com1 month agoView details
<details open> vulkan: workaround NV queuesubmit driver bug (#28830) There is a driver bug where two queues on the same VkDevice simultaneously submitting can break some internal synchronization. Until it's fixed, add a mutex around queuesubmit. </details> **Website:** - <https:…
github.com1 month agoView details
<details open> opencl: apply the noshuffle row-alignment rule to q4_K, q5_K and q8_0, not just q6_K (#28575) </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/47132459> **macOS/iOS:** - [macOS Apple Silicon (arm…
github.com1 month agoView details