KV Cache

DeepSeek’s V4.1-Flash cuts KV cache memory and input compute for long-context AI agents, while its benchmark results remain uneven.

Google Research has publicly released TurboQuant, a training-free AI memory compression algorithm suite that delivers a 6x reduction in KV cache memory usage and an 8x speedup in attention computation, potentially cutting enterprise AI inference costs by more than 50%.