llama.cpp

mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-04-19 21:16:06 +00:00

History

Sourab Mangrulkar c29af7e225

* Add support for starcoder2

* handle rope type

* skip rope freq and rotary embeddings from being serialized

* resolve comments

* Update llama.cpp

* remove redundant changes

* handle `rope-theta`

* llama : change starcoder2 rope type

* address comment

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2024-03-01 21:30:46 +02:00

__init__.py

gguf-py: Refactor and allow reading/modifying existing GGUF files (#3981 )

2023-11-11 08:04:50 +03:00

constants.py

llama : add StarCoder2 support (#5795 )

2024-03-01 21:30:46 +02:00

gguf_reader.py

gguf : fix "general.alignment" type in gguf_reader.py (#5136 )

2024-01-26 11:10:28 +02:00

gguf_writer.py

Use correct type of pooling for embedding models (#5500 )