Qeravio
Canonical AI event

HunyuanOCR now supports DFlash speculative decoding.

DFlash support added for HunyuanOCR model, fixing draft conversion issues.

22 Sept 20261 verified claims1 sources1 observations
What happened

The official source reports this update: b11103: spec : support DFlash for HunyuanOCR. spec : support DFlash for HunyuanOCR ( #28890 ) model : add DFlash layer-input taps for HunyuanVL DFlash speculative decoding needs the target graph to expose the residual stream entering each layer (res->t_layer_inp[il]) - the draft model reads those tensors to build its cross-context. Qwen3 and the other DFlash-capable targets register them, but the Hunyuan graphs do not, so serving a DFlash draft against a HunyuanOCR target aborts during the first graph build: GGML_ASSERT(t_layer_inp[il] != nullptr && "layer input tensor is null") Register the tensor at the top of the layer loop, mirroring qwen3.

Why it matters

This official update documents a development concerning b11103: spec : support DFlash for HunyuanOCR. Its practical significance depends on the scope and evidence stated by the source.

What to watch next

Read the official source update and verify its stated scope, evidence and timing before acting on it.

Connected knowledge

Entities affected by this event

Continue this topic
Evidence trail

Sources behind the event