Llama.cpp caps working memory size to prevent large tensor RAM loads.
The update caps working memory size to prevent large tensors from being loaded into RAM.
1 sources · 1 verified claimsOne evolving timeline of verified developments, without duplicating the underlying truth across pages.
The update caps working memory size to prevent large tensors from being loaded into RAM.
1 sources · 1 verified claimsTwo new bin kernels added for optimized performance on various platforms.
1 sources · 1 verified claimsLlama adds TENSOR_READ_LAZY and TENSOR_GET_ROW_LAZY for improved model loading.
1 sources · 1 verified claimsLlama-server and llama-cli now include benchmark-only synthetic speculative acceptance options.
1 sources · 1 verified claimsA memory leak fix for Metal has been implemented in the latest update. The fix addresses missing autoreleasepools.
1 sources · 1 verified claimsThe --n-cpu-ffn option is added to offload dense FFN weights of the first N layers on CPU.
1 sources · 1 verified claimsThe MiniMax-01 graph model was simplified by Stanisław Szymczyk. It supports macOS Apple Silicon, Ubuntu, and Windows.
1 sources · 1 verified claimsThe new CLI arguments include video options for macOS, Linux, Windows, and Android.
1 sources · 1 verified claimsVulkan's warptiles currently assume specific warp sizes. The issue is tracked on GitHub.
1 sources · 1 verified claimsToken ID tracking added to KV cell in llama. Supports macOS, Linux, Windows, and Android.
1 sources · 1 verified claims