infrastructure
Llama adds CPU-offload option for dense FFN weights
The --n-cpu-ffn option is added to offload dense FFN weights of the first N layers on CPU.
1 sources · 1 verified claimsOne evolving timeline of verified developments, without duplicating the underlying truth across pages.
The --n-cpu-ffn option is added to offload dense FFN weights of the first N layers on CPU.
1 sources · 1 verified claims