#inference optimization

Speculative Decoding: Faster LLM Inference (Python)

Build a speculative decoding simulator in Python. Learn the draft-verify algorithm, measure acceptance rates, and understand when it speeds up LLM inference.