mirrors/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-04-21 05:56:10 +00:00
Code Issues Packages Projects Releases Wiki Activity
llama.cpp/examples/lookahead
History
Georgi Gerganov 922754a8d6
lookahead : add example for lookahead decoding (#4207) 
* lookahead : init

* lookahead : generate and store n-grams

* lookahead : use loop instead recursion to generate n-grams

* lookahead : initial working implementation

* lookahead : filter repeating n-grams

* lookahead : use deterministic init

* lookahead : add to Makefile

* lookahead : fix a bug in the seq_id of the lookahead tokens

* lookahead : add comments

---------

Co-authored-by: slaren <slarengh@gmail.com>
2023-11-26 20:33:07 +02:00
..
CMakeLists.txt
lookahead : add example for lookahead decoding (#4207)
2023-11-26 20:33:07 +02:00
lookahead.cpp
lookahead : add example for lookahead decoding (#4207)
2023-11-26 20:33:07 +02:00