Speculative Decoding

2 articles about speculative decoding.

vLLM Update April 2026: v0.18, v0.19, Gemma 4, and gRPC Serving

April 13, 2026·9 min read

Every major vLLM update in April 2026 covered. From v0.18's gRPC serving and GPU speculative decoding to v0.19's Gemma 4 support, async scheduling, and critical security patches.

vllminferencellm-servingapril-2026gemma-4speculative-decodinggrpcopen-source

First Speculative Decoding Across GPU and Neural Engine on Apple Silicon

March 18, 2026·2 min read

Running two models on the same Apple Silicon chip - a 1B draft model on the Neural Engine and a larger model on GPU for faster local inference.

speculative-decodingapple-siliconneural-enginelocal-aiperformance

Speculative Decoding

vLLM Update April 2026: v0.18, v0.19, Gemma 4, and gRPC Serving

First Speculative Decoding Across GPU and Neural Engine on Apple Silicon

Browse by Topic