Qeravio
Canonical AI event

CUDA 12 and 13 support row-contiguous SUM_ROWS in llama.cpp.

CUDA support for row-contiguous SUM_ROWS added to llama.cpp. Includes new GGML_OP_MEAN for row-contiguous tensors.

15 Sept 20261 verified claims1 sources2 observations
What happened

The official source reports this update: b10984: cuda: support row-contiguous SUM_ROWS.

Why it matters

This official update documents a development concerning b10984: cuda: support row-contiguous SUM_ROWS. Its practical significance depends on the scope and evidence stated by the source.

What to watch next

Read the official source update and verify its stated scope, evidence and timing before acting on it.

Connected knowledge

Entities affected by this event

Llama Cppsubject
Continue this topic
infrastructureHash-cache now only stores weights in RPC protocol.15 Sept 2026infrastructureLlama.cpp moves build_arch_graph() function definitions after graph template specializations.15 Sept 2026infrastructureOpenVINO updates GPU MoE inference and stateful decode performance.15 Sept 2026infrastructureLlama.cpp adds generic ssm_scan to OpenCL15 Sept 2026infrastructureHIP fattn-mma now uses fp32 accumulation on MFMA devices.14 Sept 2026infrastructureSYCL backend now supports GPU-resident TOP_K for large k.14 Sept 2026
Evidence trail

Sources behind the event

llama.cpp official releasesb10984: cuda: support row-contiguous SUM_ROWSllama.cpp official releasesb10984: cuda: support row-contiguous SUM_ROWS
Editorial presentation

Read the public story

Open story