JidongZhang-THU 15606309a0

llava : add MobileVLM support (#5132) ...

* New Feature:
    1. Sum_Rows:
        fix cuda kernel overflow
        fix block shape error when nrows too big
    2. Im2Col:
        Support Batch in cuda
        Support f32 to f32 both in cpu && cuda
    3. DepthWiseConv:
        Support by Im2Col && MulMat
    4. Pool_2d:
        Supoort avg pooling in cuda
    5. HardSigmoid:
        Imp in cuda
    6. HardSwish:
        Imp in cuda

* fix tabs instead of spaces

* code clean

* CUDA POOL2D

* ADD POOL2D test case in test-backend-ops.cpp

* code clean

* fix pool2d_kernel

nits

* fix bug in pool2d kernel

* fix avg pooling, count_include_pad

nits

* test-backend-ops : add more pool_2d tests

* cuda : fix warnings and formatting

* ggml : check types in release builds too in pool_2d

* test-backend-ops : remove f16 pool_2d tests

* cuda : more style fixes

* Add assert in ggml_cuda_op_pool2d

* pool2d float padding fallback

* test-backend-ops : add dst_type to im2col

---------

Co-authored-by: slaren <slarengh@gmail.com>

2024-01-31 15:10:15 +02:00

..

.gitignore

tests : gitignore test-c.o

2024-01-26 14:48:15 +02:00

CMakeLists.txt

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

get-model.cpp

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

get-model.h

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

test-autorelease.cpp

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

test-backend-ops.cpp

llava : add MobileVLM support (#5132)

2024-01-31 15:10:15 +02:00

test-c.c

Nomic Vulkan backend (#4456)

2024-01-29 15:50:50 -05:00

test-double-float.cpp

ggml : move FP16 <-> FP32 code to ggml-impl.h (#3861)

2023-10-30 19:19:15 +02:00

test-grad0.cpp

cuda : improve cuda pool efficiency using virtual memory (#4606)

2023-12-24 14:34:22 +01:00

test-grammar-parser.cpp

gguf : new file format with flexible meta data (beta) (#2398)

2023-08-21 23:07:43 +03:00

test-llama-grammar.cpp

Remove unused data and add fixes (#5154)

2024-01-27 15:25:55 +01:00

test-model-load-cancel.cpp

ci : add model tests + script wrapper (#4586)

2024-01-26 14:18:00 +02:00

test-opt.cpp

sync : ggml (backend v2) (#3912)

2023-11-13 14:16:23 +02:00

test-quantize-fns.cpp

SOTA 3-bit quants (#5196)

2024-01-30 15:14:12 +02:00

test-quantize-perf.cpp

SOTA 3-bit quants (#5196)

2024-01-30 15:14:12 +02:00

test-rope.cpp

llama : custom attention mask + parallel decoding + no context swaps (#3228)

2023-09-28 19:04:36 +03:00

test-sampling.cpp

Tests for min_p, sampling queue (#5147)

2024-01-28 09:35:14 +01:00

test-tokenizer-0-falcon.cpp

Minor improvements in GPT2 tokenizer (#3567)

2023-10-10 18:59:52 +02:00

test-tokenizer-0-falcon.py

ci : add flake8 to github actions (python linting) (#4129)

2023-11-20 11:35:47 +01:00

test-tokenizer-0-llama.cpp

Minor improvements in GPT2 tokenizer (#3567)

2023-10-10 18:59:52 +02:00

test-tokenizer-0-llama.py

ci : add flake8 to github actions (python linting) (#4129)

2023-11-20 11:35:47 +01:00

test-tokenizer-1-bpe.cpp

Add more tokenizer tests (#3742)

2023-10-24 09:17:17 +02:00

test-tokenizer-1-llama.cpp

Work on the BPE tokenizer (#3252)

2023-10-03 09:16:26 +02:00