Darkweb007's picture
Initial commit: speculative-decoding
f099136
Raw
History Blame Contribute Delete
134 Bytes
from .decoder import SpeculativeDecoder, AutoregressiveBaseline, SpeculativeStep, GenerationResult, get_precomputed_benchmark_results