Spaces:

Duplicated from KBaba7/llama.cpp

Jodaro
/

hermes3-llama-cpp

Running

App Files Files Community

hermes3-llama-cpp / llama.cpp /examples /lookahead /README.md

KBaba7's picture

Upload 2637 files

2a8cee5 verified over 1 year ago

|

history blame contribute delete

195 Bytes

A newer version of the Gradio SDK is available: 6.18.0

llama.cpp/examples/lookahead

Demonstration of lookahead decoding technique:

https://lmsys.org/blog/2023-11-21-lookahead-decoding/

More info: https://github.com/ggerganov/llama.cpp/pull/4207