All Stories

  1. Speculative decoding: What holds it back and how to make it faster