Skip to content

Speculative-Decoding

4/21 - The Memory of a Conversation: KV, Prefix Reuse, Speculation, and Throughput

July 4, 2026

2/20 - Speculative Decoding: Let a Small Model Guess, Let a Large Model Judge

June 11, 2026

Draft Tokens or Smaller Numbers? Speculative Decoding vs Quantization in Production

April 16, 2026

Speculative Decoding in Production: When Draft Tokens Help and When They Hurt

February 27, 2026