Search

What are you looking for?

1 result for drafting

AI·DominoTree is a training-free best-first tree draft builder for speculative decoding that scores each candidate node by re-applying Domino's GRU-based causal correction along its specific root-to-node path. It restricts per-node correction to top-M candidates for efficiency and delivers up to 6.6x speedup with the highest mean accept length of any tested method.

arXiv cs.CL·arxiv.org··1.8Researchspeculative-decodingdraftingllm-inference