Georgi Gerganov 2b3389677a

ggml : refactor rope norm/neox (#7634) ...

* ggml : unify rope norm/neox (CPU)

* ggml : fix compile warning

* ggml : remove GLM rope mode

ggml-ci

* metal : better rope implementation

ggml-ci

* cuda : better rope implementation

ggml-ci

* naming : n_orig_ctx -> n_ctx_orig

ggml-ci

* dev : add reminders to update backends

ggml-ci

* vulkan : fix ggml_rope_ext() usage

* cuda : fix array size + indents

ggml-ci

2024-06-05 11:29:20 +03:00

..

common.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_add.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_addrow.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_cpy_f16_f16.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_cpy_f16_f32.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_cpy_f32_f16.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_cpy_f32_f32.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_diagmask.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_gelu.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_getrows_f16.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_getrows_f32.comp

kompute : implement op_getrows_f32 (#6403)

2024-06-03 08:32:16 +03:00

op_getrows_q4_0.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_getrows_q4_1.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_getrows_q6_k.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_getrows.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_mul_mat_f16.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_mul_mat_mat_f32.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_mul_mat_q4_0.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_mul_mat_q4_1.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_mul_mat_q6_k.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_mul_mat_q8_0.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_mul_mv_q_n_pre.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_mul_mv_q_n.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_mul.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_norm.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_relu.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_rmsnorm.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_rope_f16.comp

ggml : refactor rope norm/neox (#7634)

2024-06-05 11:29:20 +03:00

op_rope_f32.comp

ggml : refactor rope norm/neox (#7634)

2024-06-05 11:29:20 +03:00

op_scale_8.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_scale.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_silu.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

op_softmax.comp

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

rope_common.comp

ggml : refactor rope norm/neox (#7634)

2024-06-05 11:29:20 +03:00