mirror of
https://github.com/ggerganov/llama.cpp.git
synced 2025-04-17 03:56:07 +00:00

* Add include files for std::min/max and std::toupper/tolower * win32: move _USE_MATH_DEFINES before includes to ensure M_PI is defined * Use GGML_RESTRICT instead of "restrict" keyword everywhere, and use "__restrict" in MSVC plain C mode * win32: only use __restrict in MSVC if C11/C17 support is not enabled --------- Co-authored-by: Marcus Groeber <Marcus.Groeber@cerence.com>
llama.cpp/example/passkey
A passkey retrieval task is an evaluation method used to measure a language models ability to recall information from long contexts.
See the following PRs for more info:
Usage
make -j && ./llama-passkey -m ./models/llama-7b-v2/ggml-model-f16.gguf --junk 250