llama.cpp

mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-04-16 03:26:08 +00:00

History

ggml-cpu: Add CPU backend support for KleidiAI library (#11390 )

* ggml-cpu: Add CPU backend support for KleidiAI library

* Add environmental variable GGML_KLEIDIAI_SME

* Add support for multithread LHS conversion

* Switch kernel selection order to dotprod and i8mm

* updates for review comments

* More updates for review comments

* Reorganize and rename KleidiAI files

* Move ggml-cpu-traits.h to source file

* Update cmake for SME build and add alignment for SME

* Remove append GGML_USE_CPU_KLEIDIAI to the GGML_CDEF_PUBLIC list

2025-02-20 15:06:51 +02:00

ggml-alloc.h

ggml : fix typo in example usage ggml_gallocr_new (ggml/984)

2024-10-04 18:50:05 +03:00

ggml-backend.h

rpc : early register backend devices (#11262 )

2025-01-17 10:57:09 +02:00

ggml-blas.h

ggml : build backends as libraries (#10256 )

2024-11-14 18:04:35 +01:00

ggml-cann.h

ggml : build backends as libraries (#10256 )