Closed
Description
Git commit
Operating systems
Linux
GGML backends
CUDA
Problem description & steps to reproduce
When I run these build commands:
cmake -B build -DGGML_CUDA=ON
cmake --build build --config Release
with a Cuda-12.6 environment, compilation fails.
First Bad Commit
No response
Compile command
cmake -B build -DGGML_CUDA=ON
cmake --build build --config Release
Relevant log output
I get the following errors:
/home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu:5:31: error: macro "DECL_FATTN_MMA_F16_CASE" requires 3 arguments, but only 2 given
5 | DECL_FATTN_MMA_F16_CASE(64, 16);
| ^
In file included from /home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu:3:
/home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/../fattn-mma-f16.cuh:1003: note: macro "DECL_FATTN_MMA_F16_CASE" defined here
1003 | #define DECL_FATTN_MMA_F16_CASE(D, ncols1, ncols2) \
|
/home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu:6:31: error: macro "DECL_FATTN_MMA_F16_CASE" requires 3 arguments, but only 2 given
6 | DECL_FATTN_MMA_F16_CASE(80, 16);
| ^
In file included from /home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu:3:
/home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/../fattn-mma-f16.cuh:1003: note: macro "DECL_FATTN_MMA_F16_CASE" defined here
1003 | #define DECL_FATTN_MMA_F16_CASE(D, ncols1, ncols2) \
|
/home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu:7:31: error: macro "DECL_FATTN_MMA_F16_CASE" requires 3 arguments, but only 2 given
7 | DECL_FATTN_MMA_F16_CASE(96, 16);
| ^
In file included from /home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu:3:
/home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/../fattn-mma-f16.cuh:1003: note: macro "DECL_FATTN_MMA_F16_CASE" defined here
1003 | #define DECL_FATTN_MMA_F16_CASE(D, ncols1, ncols2) \
|
/home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu:8:32: error: macro "DECL_FATTN_MMA_F16_CASE" requires 3 arguments, but only 2 given
8 | DECL_FATTN_MMA_F16_CASE(112, 16);
| ^
In file included from /home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu:3:
/home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/../fattn-mma-f16.cuh:1003: note: macro "DECL_FATTN_MMA_F16_CASE" defined here
1003 | #define DECL_FATTN_MMA_F16_CASE(D, ncols1, ncols2) \
|
/home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu:9:32: error: macro "DECL_FATTN_MMA_F16_CASE" requires 3 arguments, but only 2 given
9 | DECL_FATTN_MMA_F16_CASE(128, 16);
| ^
In file included from /home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu:3:
/home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/../fattn-mma-f16.cuh:1003: note: macro "DECL_FATTN_MMA_F16_CASE" defined here
1003 | #define DECL_FATTN_MMA_F16_CASE(D, ncols1, ncols2) \
|
/home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu:10:32: error: macro "DECL_FATTN_MMA_F16_CASE" requires 3 arguments, but only 2 given
10 | DECL_FATTN_MMA_F16_CASE(256, 16);
| ^
In file included from /home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/fattn-mma-f16-instance-cpb16.cu:3:
/home/gwsapan/llama.cpp/ggml/src/ggml-cuda/template-instances/../fattn-mma-f16.cuh:1003: note: macro "DECL_FATTN_MMA_F16_CASE" defined here
1003 | #define DECL_FATTN_MMA_F16_CASE(D, ncols1, ncols2) \
|
gmake[2]: *** [ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/build.make:707: ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-cpb16.cu.o] Error 1
gmake[1]: *** [CMakeFiles/Makefile2:1796: ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/all] Error 2