Sources
vLLM

vLLM

Related tags:

#ai-inference #vllm #gpu #devops #mixture-of-experts #cicd

Posts about ai-inference Posts about vllm Posts about gpu Posts about devops Posts about mixture-of-experts Posts about cicd

Optimizing vLLM on Arm CPUs Parallel All the Way Down: Beyond Single-Token Generation with Speculative Decoding Kimi K3 Is Here: Efficient Day-0 Support on vLLM Announcing vLLM AFD Plugin: Disaggregating Attention and FFN for Flexible MoE Serving A Preview of Production-Scale Kimi K3 Support on vLLM Keeping vLLM Production Quality: A Look Inside CI, Benchmarking, and the Release Process TML Inkling on vLLM: Day-0 Support with Optimized Performance vLLM x TileRT: Specialized Decode for Latency-Critical Serving EAGLE-3 Speculative Decoding on AMD Instinct GPUs: Training and Serving with vLLM and AMD Quark vLLM × HPC-Ops: High-Performance Attention and MoE Backends from Tencent Hunyuan

Most upvoted posts from vLLM

Best discussed posts from vLLM

All posts from vLLM