Qeravio
Canonical AI event

Llama.cpp updates checkpoint eviction to prevent duplicate entries.

The update affects checkpoint eviction in hybrid/recurrent models.

8 Sept 20261 verified claims1 sources1 observations
What happened

The official source reports this update: b10864: server : apply checkpoint min-step eviction only when the checkpoint list is full. server : apply checkpoint min-step eviction only when the checkpoint list is full ( #28302 ) The spacing eviction in create_checkpoint() keeps the oldest checkpoint and erases every later one within checkpoint_min_step of it. For prompts shorter than checkpoint_min_step this drops the checkpoint at n_tokens - 4 that the next request resumes from, so hybrid/recurrent models re-prefill from the previous checkpoint instead.

Why it matters

This official update documents a development concerning b10864: server : apply checkpoint min-step eviction only when the checkpoint list is full. Its practical significance depends on the scope and evidence stated by the source.

What to watch next

Read the official source update and verify its stated scope, evidence and timing before acting on it.

Connected knowledge

Entities affected by this event

Evidence trail

Sources behind the event