Google Releases TurboQuant Algorithm Suite, Achieving 6x AI Memory Compression and 8x Speed Gains
Google Research has publicly released TurboQuant, a training-free AI memory compression algorithm suite that delivers a 6x reduction in KV cache memory usage and an 8x speedup in attention computation, potentially cutting enterprise AI inference costs by more than 50%.