Enhancing DeepSeek Models with MLA and FP8 Optimizations in VLLM

Wait 5 sec.

Article URL: https://neuralmagic.com/blog/enhancing-deepseek-models-with-mla-and-fp8-optimizations-in-vllm/Comments URL: https://news.ycombinator.com/item?id=43157403Points: 1# Comments: 0