Qeravio
Canonical AI event

Vulkan adds dedicated iq4_xs mat-vec shader for RDNA4, improving token generation.

A dedicated shader for matrix-vector operations is added to Vulkan, improving token generation on RDNA4.

9 Sept 20261 verified claims1 sources1 observations
What happened

The official source reports this update: b10871: vulkan: add dedicated iq4_xs mat-vec shader. vulkan: add dedicated iq4_xs mat-vec shader ( #28426 ) vulkan: add dedicated iq4_xs mat-vec shader Dedicated mul_mat_vec_iq4_xs for the dmmv path, replacing the generic fallback. ~+6-17% token generation on RDNA4 depending on model. Assisted-by: Pi agent with Qwen3.8 27B vulkan iq4_xs: remove dead n_it unroll branch Remove the n_it the block loop. Since n_it is a runtime value, [[unroll]] is ignored by the compiler, making both branches equivalent. Kept the simple loop matching mul_mat_vec_iq3_s.comp.

Why it matters

This official update documents a development concerning b10871: vulkan: add dedicated iq4_xs mat-vec shader. Its practical significance depends on the scope and evidence stated by the source.

What to watch next

Read the official source update and verify its stated scope, evidence and timing before acting on it.

Connected knowledge

Entities affected by this event

Continue this topic
Evidence trail

Sources behind the event