Recent Articles
October 10, 2025
6 min · read
Why Agentic Workloads Break Traditional Inference Gateways
Agentic AI turns one user request into a chain of model calls, tools, retries, memory, and cache pressure. The gateway has to grow up.
September 15, 2025
9 min · read
Rust for Systems Programming: When the Borrow Checker Earns Its Keep
A practical guide to where Rust earns its complexity: memory safety, concurrency, async services, data planes, and adoption paths for production systems.
August 29, 2025
6 min · read
Disaggregated Inference on Kubernetes: Routing, Scheduling, and Scaling Beyond One GPU
A Kubernetes-native view of disaggregated LLM inference: prefill pools, decode pools, KV transfer, topology, Gateway API Inference Extension, and GPU-aware scheduling.
August 8, 2025
6 min · read
Prefill vs Decode: The Hidden Split That Shapes Every LLM Serving Architecture
Why LLM inference has two very different phases, and why the prefill/decode split changes batching, routing, SLOs, and GPU utilization.
July 18, 2025
6 min · read
Inference Is a Memory Problem: KV Cache, HBM, and the Real Cost of Long Context
A practical tour of why long-context LLM inference is governed less by raw FLOPS and more by KV cache, HBM capacity, and memory traffic.