DeepSeek-V4
“In the one-million-token context setting, DeepSeek-V4-Pro requires only 27% of single-token inference FLOPs and 10% of KV cache compared with DeepSeek-V3.2.”
The authors, in the abstract
Towards Highly Efficient Million-Token Context Intelligence