Official PyTorch reference implementation of RelayTree speculative decoding
pytorch edge-computing edge-cloud large-language-models llm-inference speculative-decoding tree-based-decoding
-
Updated
Oct 24, 2026 - Python