Fewer Bytes, More Tokens: How Qwen3.8-27B Decodes Six Times Faster on a DGX Spark

The DGX Spark reads memory at 273 GB/s, which caps plain decoding of a dense 27B model at about 14 tokens per second however much compute sits behind it. Measured on one Spark, Qwen3.8-27B decodes at 11.4 tokens per second without speculation and, for the median request, at 67.8 with the Chisel recipe. Every step between the two either reduces the bytes read per decode step or raises the tokens produced per step, and this post measures each one separately.

October 31, 2026 · 20 min · MdJawad

Speculative Speculative Decoding: Eliminating the Last Sequential Bottleneck in LLM Inference

How speculating about speculation itself achieves up to 5x faster LLM inference by eliminating the draft model’s idle time during verification, and the three engineering challenges that make it work.

March 7, 2026 · 21 min · MdJawad

Speculative Decoding: When Guessing Right Makes for Faster Inference

How speculative decoding achieves 2-3× inference speedup without changing model outputs, and why GLM-4.7’s native multi-token prediction marks a paradigm shift.

December 23, 2025 · 20 min · MdJawad