llama.cpp

mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-04-13 01:56:09 +00:00

History

tool-call: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034 )

* sampler: turn lazy grammar trigger words to regexes

* add scripts/tool_bench.sh & .py

* constrain llama json output regardless of function name if matches at beginning

* update relaxed newline space rule in grammar tests

* support add_generation_prompt query parameter (useful for /apply_template)

* Update src/llama-grammar.cpp

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2025-03-05 13:05:13 +00:00

requirements-all.txt

tool-call: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034 )

2025-03-05 13:05:13 +00:00

requirements-compare-llama-bench.txt

py : type-check all Python scripts with Pyright (#8341 )

2024-07-07 15:04:39 -04:00

requirements-convert_hf_to_gguf_update.txt

py : use cpu-only torch in requirements.txt (#8335 )

2024-07-07 14:23:38 +03:00

requirements-convert_hf_to_gguf.txt

py : use cpu-only torch in requirements.txt (#8335 )