llama.cpp/requirements-tool_bench.txt at master - llama.cpp - Gitea For EOELAB

mirrors/llama.cpp

mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-04-23 06:46:06 +00:00

Olivier Chafik 669912d9a5

tool-call: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034 )

* sampler: turn lazy grammar trigger words to regexes

* add scripts/tool_bench.sh & .py

* constrain llama json output regardless of function name if matches at beginning

* update relaxed newline space rule in grammar tests

* support add_generation_prompt query parameter (useful for /apply_template)

* Update src/llama-grammar.cpp

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2025-03-05 13:05:13 +00:00

13 lines

198 B

Plaintext

Raw Permalink Blame History

 aiohttp~=3.9.3
 pytest~=8.3.3
 huggingface_hub~=0.23.2
 matplotlib~=3.10.0
 numpy~=1.26.4
 openai~=1.55.3
 pandas~=2.2.3
 prometheus-client~=0.20.0
 requests~=2.32.3
 wget~=3.2
 typer~=0.15.1
 seaborn~=0.13.2