infrastructure
New Engine Features Include Continuous Batching, Faster Decoding, and Qwen2.5-VL Support
Version 0.16.0 introduces support for AMDGPU and WebGPU. It also adds Granite models and improves handling of multi-image vision inputs.
1 sources · 1 verified claims