llama.cpp

mirror of https://github.com/ggerganov/llama.cpp.git synced 2025-04-24 06:56:05 +00:00

History

gguf-py, convert-hf : model conversion support for T5 and FLAN-T5 model variants (#5763 )

* gguf-py : add T5 model architecture

* gguf-py : add separate tensors for encoder and decoder

* gguf-py : add new model header parameters: decoder_start_token_id, attention.relative_buckets_count, tokenizer.ggml.remove_extra_whitespaces, tokenizer.ggml.precompiled_charsmap

* convert-hf : add model conversion support for T5ForConditionalGeneration and T5WithLMHeadModel

---------

Co-authored-by: Stanisław Szymczyk <sszymczy@gmail.com>

2024-06-24 07:06:05 +02:00

__init__.py

convert-hf : support direct Q8_0 conversion (#7234 )

2024-05-13 14:10:51 -04:00

constants.py

gguf-py, convert-hf : model conversion support for T5 and FLAN-T5 model variants (#5763 )

2024-06-24 07:06:05 +02:00

gguf_reader.py

gguf-py : fix and simplify quantized shape round-trip (#7483 )

2024-05-25 11:11:48 +10:00

gguf_writer.py

gguf-py, convert-hf : model conversion support for T5 and FLAN-T5 model variants (#5763 )