Batch-Max: Higher LLM Throughput using Larger Batch Sizes and KV Cache Compression. - Metel, Michael R.; Chen, Boxing; Rezagholizadeh, Mehdi (CoRR, 2024)