The Parallel Decoding Trilemma
November 25, 2025
TL;DR: Parallel decoding is a fight to increase speed while maintaining fluency and diversity.
Daniel Israel
PhD Student at UCLA
- Los Angeles
- disrael [at] ucla.edu
- Github
- Google Scholar
November 25, 2025
TL;DR: Parallel decoding is a fight to increase speed while maintaining fluency and diversity.