Upload 3 files

llama.cpp/build-local-log.md

@@ -0,0 +1,883 @@
+### 酝酿准备
+
+配置阶段
+
+```
+cmake -B build -DCMAKE_BUILD_TYPE=Release -DGGML_BACKEND_DL=ON -DGGML_CPU_ALL_VARIANTS=ON -DGGML_CUDA=ON -DCMAKE_CUDA_ARCHITECTURES=native -DCMAKE_CUDA_RUNTIME_LIBRARY=Static -DGGML_CURL=OFF -DBUILD_SHARED_LIBS=ON
+```
+
+运行编译，仅 llama-server 程序
+
+```
+cmake --build build --config Release --target llama-server -j$(nproc)
+```
+
+参数解释：
+
+1. **-DCMAKE_BUILD_TYPE=Release**  
+   标准发布模式优化，开启最大性能（O3 等），适合生产/服务器使用。
+
+2. **-DGGML_BACKEND_DL=ON**（动态后端加载）  
+   这是一个关键选项。  
+   它会把各种 **backend**（CPU、CUDA 等）编译成独立的 **动态库**（.so / .dll），而不是静态链接进主二进制。  
+   运行时通过 `ggml_backend_load()` 或 `ggml_backend_load_all()` 动态加载需要的 backend。  
+   **好处**：  
+   - 二进制更小、更灵活。  
+   - 理论上更容易在不同机器间移植（尤其是不同 GPU 的情况）。  
+   - CPU 部分配合下面 `GGML_CPU_ALL_VARIANTS` 时特别有用。
+
+3. **-DGGML_CPU_ALL_VARIANTS=ON**  
+   为 CPU 编译**多个优化变体**（SSE4.2、AVX2、AVX512、AVX512_VBMI 等不同指令集的 backend 动态库）。  
+   运行时会自动检测当前 CPU 支持的最强指令集，加载对应的高性能 backend。  
+   这让你的 **llama-server** 在 CPU fallback 或混合使用时能达到“本机最强”性能，同时保持一定可移植性（同一个二进制能在不同 x86_64 CPU 上跑得接近最优）。
+
+4. **-DGGML_CUDA=ON**  
+   启用 NVIDIA CUDA backend，支持 GPU 加速。
+
+5. **-DCMAKE_CUDA_ARCHITECTURES=native**  
+   只为**当前编译机器的 GPU** 生成对应架构的 PTX/SASS 代码。  
+   **性能**：在本机上达到最高（完美匹配你的 GPU）。  
+   **移植性**：较差。如果换到另一台 GPU 架构不同的机器（比如从 RTX 40 系换到 30 系，或 Ampere 换到 Hopper），可能无法使用 CUDA 加速（需要重新编译）。
+
+6. **-DCMAKE_CUDA_RUNTIME_LIBRARY=Static**（**这是满足你“重装系统后仍能跑”的最关键选项**）  
+   将 CUDA Runtime（cudart 等）**静态链接**进二进制。  
+   正常编译时，llama-server 会动态依赖系统安装的 CUDA 库（libcudart.so、libcublas.so 等）。  
+   设置为 **Static** 后，这些运行时库被打包进可执行文件，**大幅降低对系统 CUDA 安装的依赖**。  
+   **结果**：重装系统后，只要：
+   - 驱动版本足够新（支持你编译时的 CUDA 能力）。
+   - CUDA Toolkit 版本**不低于**你编译时使用的版本（因为静态链接的 runtime 仍然需要驱动兼容更高版本的 CUDA）。  
+   通常就能直接运行，而不需要重新安装完全匹配的 CUDA Toolkit。  
+   这正是你想要的“CUDA 环境有变动，只要版本高就可以继续运行”。
+
+7. **-DGGML_CURL=ON**  
+   禁用 CURL 支持（llama-server 可以直接从 Hugging Face 等下载模型，或支持某些网络功能）。
+
+8. **-DBUILD_SHARED_LIBS=ON**  
+   整个项目编译为**共享库**模式（而不是静态库）。  
+   这会让 llama-server 以及相关组件（如 libllama.so、各种 ggml-*.so）以动态库形式存在。  
+   与 `GGML_BACKEND_DL=ON` 配合较好，但整体依赖结构会比纯静态（BUILD_SHARED_LIBS=OFF）更复杂一些（需要把多个 .so 放在一起）。
+
+---
+
+### 构建目录
+
+```
+-- The C compiler identification is GNU 13.3.0
+-- The CXX compiler identification is GNU 13.3.0
+-- Detecting C compiler ABI info
+-- Detecting C compiler ABI info - done
+-- Check for working C compiler: /usr/bin/cc - skipped
+-- Detecting C compile features
+-- Detecting C compile features - done
+-- Detecting CXX compiler ABI info
+-- Detecting CXX compiler ABI info - done
+-- Check for working CXX compiler: /usr/bin/c++ - skipped
+-- Detecting CXX compile features
+-- Detecting CXX compile features - done
+CMAKE_BUILD_TYPE=Release
+-- Found Git: /usr/bin/git (found version "2.43.0")
+-- The ASM compiler identification is GNU
+-- Found assembler: /usr/bin/cc
+-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
+-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Success
+-- Found Threads: TRUE
+-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF
+-- CMAKE_SYSTEM_PROCESSOR: x86_64
+-- GGML_SYSTEM_ARCH: x86
+-- Including CPU backend
+-- Found OpenMP_C: -fopenmp (found version "4.5")
+-- Found OpenMP_CXX: -fopenmp (found version "4.5")
+-- Found OpenMP: TRUE (found version "4.5")
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-x64:
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-sse42: -msse4.2 GGML_SSE42
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-sandybridge: -msse4.2;-mavx GGML_SSE42;GGML_AVX
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-ivybridge: -msse4.2;-mf16c;-mavx GGML_SSE42;GGML_F16C;GGML_AVX
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-piledriver: -msse4.2;-mf16c;-mfma;-mavx GGML_SSE42;GGML_F16C;GGML_FMA;GGML_AVX
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-haswell: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2 GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-skylakex: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw GGML_SSE42;GGML_F
+16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-cannonlake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw;-mavx512vbmi GG
+ML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512;GGML_AVX512_VBMI
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-cascadelake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw;-mavx512vnni G
+GML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512;GGML_AVX512_VNNI
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-icelake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw;-mavx512vbmi;-mavx
+512vnni GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512;GGML_AVX512_VBMI;GGML_AVX512_VNNI
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-cooperlake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw;-mavx512vnni;-m
+avx512bf16 GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512;GGML_AVX512_VNNI;GGML_AVX512_BF16
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-zen4: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw;-mavx512vbmi;-mavx512
+vnni;-mavx512bf16 GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512;GGML_AVX512_VBMI;GGML_AVX512_VNNI;GGML_AVX512_BF16
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-alderlake: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavxvnni GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;G
+GML_AVX_VNNI
+-- x86 detected
+-- Adding CPU backend variant ggml-cpu-sapphirerapids: -msse4.2;-mf16c;-mfma;-mbmi2;-mavx;-mavx2;-mavx512f;-mavx512cd;-mavx512vl;-mavx512dq;-mavx512bw;-mavx512vbm
+i;-mavx512vnni;-mavx512bf16;-mamx-tile;-mamx-int8 GGML_SSE42;GGML_F16C;GGML_FMA;GGML_BMI2;GGML_AVX;GGML_AVX2;GGML_AVX512;GGML_AVX512_VBMI;GGML_AVX512_VNNI;GGML_AV
+X512_BF16;GGML_AMX_TILE;GGML_AMX_INT8
+-- Found CUDAToolkit: /usr/local/cuda-13.2/targets/x86_64-linux/include (found version "13.2.51")
+-- CUDA Toolkit found
+-- The CUDA compiler identification is NVIDIA 13.2.51
+-- Detecting CUDA compiler ABI info
+-- Detecting CUDA compiler ABI info - done
+-- Check for working CUDA compiler: /usr/local/cuda-13.2/bin/nvcc - skipped
+-- Detecting CUDA compile features
+-- Detecting CUDA compile features - done
+-- Using CMAKE_CUDA_ARCHITECTURES=75-real CMAKE_CUDA_ARCHITECTURES_NATIVE=75-real
+-- CUDA host compiler is GNU 13.3.0
+-- Including CUDA backend
+-- ggml version: 0.9.8
+-- ggml commit:  fcc2d598c
+-- Found OpenSSL: /usr/lib/x86_64-linux-gnu/libcrypto.so (found version "3.0.13")
+-- Performing Test OPENSSL_VERSION_SUPPORTED
+-- Performing Test OPENSSL_VERSION_SUPPORTED - Success
+-- OpenSSL found: 3.0.13
+-- Generating embedded license file for target: common
+-- Configuring done (14.7s)
+-- Generating done (0.3s)
+-- Build files have been written to: /home/xxx/llama.cpp/build
+```
+
+---
+
+### 编译日志
+
+```
+[  0%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Building C object ggml/src/CMakeFiles/ggml-base.dir/ggml.c.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Built target ggml-cpu-cannonlake-feats
+[  1%] Built target ggml-cpu-piledriver-feats
+[  1%] Built target ggml-cpu-skylakex-feats
+[  1%] Built target ggml-cpu-cooperlake-feats
+[  1%] Built target ggml-cpu-x64-feats
+[  1%] Built target ggml-cpu-sse42-feats
+[  1%] Built target ggml-cpu-sandybridge-feats
+[  1%] Built target ggml-cpu-ivybridge-feats
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/ggml.cpp.o
+[  1%] Built target ggml-cpu-cascadelake-feats
+[  1%] Building C object ggml/src/CMakeFiles/ggml-base.dir/ggml-alloc.c.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/ggml-backend.cpp.o
+[  1%] Built target ggml-cpu-icelake-feats
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/ggml-opt.cpp.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Built target ggml-cpu-haswell-feats
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/ggml-threading.cpp.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake-feats.dir/ggml-cpu/arch/x86/cpu-feats.cpp.o
+[  1%] Building CXX object common/CMakeFiles/build_info.dir/build-info.cpp.o
+[  2%] Building C object ggml/src/CMakeFiles/ggml-base.dir/ggml-quants.c.o
+[  2%] Building CXX object vendor/cpp-httplib/CMakeFiles/cpp-httplib.dir/httplib.cpp.o
+[  2%] Built target build_info
+[  2%] Building CXX object ggml/src/CMakeFiles/ggml-base.dir/gguf.cpp.o
+[  2%] Built target ggml-cpu-alderlake-feats
+[  2%] Built target ggml-cpu-zen4-feats
+[  2%] Built target ggml-cpu-sapphirerapids-feats
+[  2%] Linking CXX shared library ../../bin/libggml-base.so
+[  2%] Built target ggml-base
+[  2%] Building C object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/ggml-cpu.c.o
+[  2%] Building C object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/ggml-cpu.c.o
+[  2%] Building C object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/ggml-cpu.c.o
+[  3%] Building C object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu.c.o
+[  3%] Building C object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/ggml-cpu.c.o
+[  5%] Building C object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/ggml-cpu.c.o
+[  5%] Building C object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/ggml-cpu.c.o
+[  5%] Building C object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/ggml-cpu.c.o
+[  5%] Building C object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/ggml-cpu.c.o
+[  5%] Building C object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/ggml-cpu.c.o
+[  5%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/acc.cu.o
+[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/ggml-cpu.cpp.o
+[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/ggml-cpu.cpp.o
+[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/ggml-cpu.cpp.o
+[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/ggml-cpu.cpp.o
+[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/ggml-cpu.cpp.o
+[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/ggml-cpu.cpp.o
+[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/ggml-cpu.cpp.o
+[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/ggml-cpu.cpp.o
+[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ggml-cpu.cpp.o
+[  5%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/ggml-cpu.cpp.o
+[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/repack.cpp.o
+[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/repack.cpp.o
+[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/repack.cpp.o
+[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/repack.cpp.o
+[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/repack.cpp.o
+[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/repack.cpp.o
+[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/repack.cpp.o
+[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/repack.cpp.o
+[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/repack.cpp.o
+[  6%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/repack.cpp.o
+[  6%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/add-id.cu.o
+[  6%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/arange.cu.o
+[  7%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/hbm.cpp.o
+[  7%] Building C object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/quants.c.o
+[  7%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/hbm.cpp.o
+[  7%] Building C object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/quants.c.o
+[  7%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/hbm.cpp.o
+[  7%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/hbm.cpp.o
+[  7%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/hbm.cpp.o
+[  7%] Building C object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/quants.c.o
+[  7%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/hbm.cpp.o
+[  7%] Building C object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/quants.c.o
+[  7%] Building C object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/quants.c.o
+[  7%] Building C object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/quants.c.o
+[  7%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/hbm.cpp.o
+[  9%] Building C object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/quants.c.o
+[  9%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/hbm.cpp.o
+[  9%] Building C object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/quants.c.o
+[  9%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/hbm.cpp.o
+[  9%] Building C object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/quants.c.o
+[ 10%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/hbm.cpp.o
+[ 10%] Building C object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/quants.c.o
+[ 10%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/traits.cpp.o
+[ 10%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/traits.cpp.o
+[ 10%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/traits.cpp.o
+[ 10%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/traits.cpp.o
+[ 10%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/traits.cpp.o
+[ 11%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/traits.cpp.o
+[ 11%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/traits.cpp.o
+[ 11%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/traits.cpp.o
+[ 11%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/traits.cpp.o
+[ 11%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/amx/amx.cpp.o
+[ 11%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/traits.cpp.o
+[ 11%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/amx/amx.cpp.o
+[ 11%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/amx/amx.cpp.o
+[ 13%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/amx/amx.cpp.o
+[ 13%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/amx/amx.cpp.o
+[ 13%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/amx/amx.cpp.o
+[ 13%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/amx/amx.cpp.o
+[ 14%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/amx/amx.cpp.o
+[ 14%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/amx/amx.cpp.o
+[ 14%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/amx/mmq.cpp.o
+[ 14%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/amx/amx.cpp.o
+[ 14%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/amx/mmq.cpp.o
+[ 14%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/amx/mmq.cpp.o
+[ 14%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/amx/mmq.cpp.o
+[ 15%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/argmax.cu.o
+[ 15%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/amx/mmq.cpp.o
+[ 15%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/amx/mmq.cpp.o
+[ 15%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/binary-ops.cpp.o
+[ 15%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/amx/mmq.cpp.o
+[ 15%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/amx/mmq.cpp.o
+[ 17%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/amx/mmq.cpp.o
+[ 17%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/amx/mmq.cpp.o
+[ 17%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/binary-ops.cpp.o
+[ 18%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/binary-ops.cpp.o
+[ 18%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/binary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/binary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/binary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/binary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/binary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/binary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/binary-ops.cpp.o
+[ 19%] Linking CXX static library libcpp-httplib.a
+[ 19%] Built target cpp-httplib
+[ 19%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/argsort.cu.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/unary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/unary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/unary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/unary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/unary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/unary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/unary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/unary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/unary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/unary-ops.cpp.o
+[ 19%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/vec.cpp.o
+[ 19%] Building C object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/ggml-cpu.c.o
+[ 21%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/ggml-cpu.cpp.o
+[ 21%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/vec.cpp.o
+[ 21%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/vec.cpp.o
+[ 21%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/vec.cpp.o
+[ 21%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/vec.cpp.o
+[ 21%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/vec.cpp.o
+[ 21%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/ops.cpp.o
+[ 22%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/vec.cpp.o
+[ 22%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/vec.cpp.o
+[ 22%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/vec.cpp.o
+[ 23%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/vec.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/ops.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/repack.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/ops.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/ops.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/ops.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/ops.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/ops.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/ops.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/ops.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/ops.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/hbm.cpp.o
+[ 25%] Building C object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/quants.c.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/traits.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 25%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/amx/amx.cpp.o
+[ 26%] Building C object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/arch/x86/quants.c.o
+[ 26%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 27%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 27%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 27%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-x64.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 27%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/amx/mmq.cpp.o
+[ 27%] Building C object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/arch/x86/quants.c.o
+[ 27%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 27%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/binary-ops.cpp.o
+[ 27%] Linking CXX shared module ../../bin/libggml-cpu-x64.so
+[ 27%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sse42.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 27%] Built target ggml-cpu-x64
+[ 27%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 27%] Building C object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/ggml-cpu.c.o
+[ 27%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 27%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 27%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 28%] Linking CXX shared module ../../bin/libggml-cpu-sse42.so
+[ 28%] Built target ggml-cpu-sse42
+[ 28%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/ggml-cpu.cpp.o
+[ 30%] Building C object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/arch/x86/quants.c.o
+[ 30%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/binbcast.cu.o
+[ 30%] Building C object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/arch/x86/quants.c.o
+[ 30%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/repack.cpp.o
+[ 30%] Building C object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/arch/x86/quants.c.o
+[ 30%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-ivybridge.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 30%] Building C object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/arch/x86/quants.c.o
+[ 31%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/unary-ops.cpp.o
+[ 31%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-piledriver.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 31%] Linking CXX shared module ../../bin/libggml-cpu-ivybridge.so
+[ 31%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-haswell.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 31%] Built target ggml-cpu-ivybridge
+[ 31%] Building C object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/arch/x86/quants.c.o
+[ 31%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sandybridge.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 31%] Linking CXX shared module ../../bin/libggml-cpu-piledriver.so
+[ 31%] Built target ggml-cpu-piledriver
+[ 31%] Building C object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/arch/x86/quants.c.o
+[ 31%] Linking CXX shared module ../../bin/libggml-cpu-sandybridge.so
+[ 31%] Building C object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/ggml-cpu.c.o
+[ 31%] Built target ggml-cpu-sandybridge
+[ 31%] Building C object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/arch/x86/quants.c.o
+[ 31%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cannonlake.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 31%] Building C object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/arch/x86/quants.c.o
+[ 31%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cascadelake.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 31%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/ggml-cpu.cpp.o
+[ 31%] Building C object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/ggml-cpu.c.o
+[ 31%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/vec.cpp.o
+[ 31%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/clamp.cu.o
+[ 31%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-skylakex.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 32%] Linking CXX shared module ../../bin/libggml-cpu-haswell.so
+[ 34%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-icelake.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 34%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/ops.cpp.o
+[ 34%] Built target ggml-cpu-haswell
+[ 34%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/hbm.cpp.o
+[ 34%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/concat.cu.o
+[ 35%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/ggml-cpu.cpp.o
+[ 35%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/repack.cpp.o
+[ 35%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/repack.cpp.o
+[ 36%] Building C object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/quants.c.o
+[ 36%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 36%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/traits.cpp.o
+[ 36%] Linking CXX shared module ../../bin/libggml-cpu-cannonlake.so
+[ 36%] Linking CXX shared module ../../bin/libggml-cpu-cascadelake.so
+[ 36%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/amx/amx.cpp.o
+[ 36%] Built target ggml-cpu-cannonlake
+[ 36%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/conv-transpose-1d.cu.o
+[ 36%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/hbm.cpp.o
+[ 36%] Built target ggml-cpu-cascadelake
+[ 36%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/hbm.cpp.o
+[ 36%] Building C object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/arch/x86/quants.c.o
+[ 36%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/amx/mmq.cpp.o
+[ 36%] Linking CXX shared module ../../bin/libggml-cpu-skylakex.so
+[ 36%] Linking CXX shared module ../../bin/libggml-cpu-icelake.so
+[ 36%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/conv2d-dw.cu.o
+[ 36%] Built target ggml-cpu-skylakex
+[ 36%] Building C object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/quants.c.o
+[ 36%] Built target ggml-cpu-icelake
+[ 36%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-cooperlake.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 36%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/binary-ops.cpp.o
+[ 36%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/unary-ops.cpp.o
+[ 36%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/traits.cpp.o
+[ 36%] Building C object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/quants.c.o
+[ 36%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/vec.cpp.o
+[ 36%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/ops.cpp.o
+[ 36%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/conv2d-transpose.cu.o
+[ 38%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/conv2d.cu.o
+[ 38%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/amx/amx.cpp.o
+[ 39%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/traits.cpp.o
+[ 39%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/amx/mmq.cpp.o
+[ 40%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 40%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/convert.cu.o
+[ 40%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/amx/amx.cpp.o
+[ 40%] Building C object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/arch/x86/quants.c.o
+[ 40%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-zen4.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 40%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/binary-ops.cpp.o
+[ 40%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/amx/mmq.cpp.o
+[ 40%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/count-equal.cu.o
+[ 42%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/unary-ops.cpp.o
+[ 42%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/binary-ops.cpp.o
+[ 42%] Linking CXX shared module ../../bin/libggml-cpu-cooperlake.so
+[ 42%] Built target ggml-cpu-cooperlake
+[ 42%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/cpy.cu.o
+[ 42%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/vec.cpp.o
+[ 42%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/unary-ops.cpp.o
+[ 42%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/vec.cpp.o
+[ 42%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/cross-entropy-loss.cu.o
+[ 42%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/cumsum.cu.o
+[ 42%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/ops.cpp.o
+[ 42%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/diag.cu.o
+[ 42%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/ops.cpp.o
+[ 42%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 42%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/llamafile/sgemm.cpp.o
+[ 43%] Building C object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/arch/x86/quants.c.o
+[ 43%] Building C object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/arch/x86/quants.c.o
+[ 43%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-sapphirerapids.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 43%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/diagmask.cu.o
+[ 43%] Building CXX object ggml/src/CMakeFiles/ggml-cpu-alderlake.dir/ggml-cpu/arch/x86/repack.cpp.o
+[ 44%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/fattn-tile.cu.o
+[ 44%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/fattn-wmma-f16.cu.o
+[ 44%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/fattn.cu.o
+[ 44%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/fill.cu.o
+[ 44%] Linking CXX shared module ../../bin/libggml-cpu-zen4.so
+[ 44%] Built target ggml-cpu-zen4
+[ 44%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/gated_delta_net.cu.o
+[ 44%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/getrows.cu.o
+[ 44%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/ggml-cuda.cu.o
+[ 44%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/gla.cu.o
+[ 46%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/im2col.cu.o
+[ 46%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/mean.cu.o
+[ 46%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/mmf.cu.o
+[ 46%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/mmid.cu.o
+[ 46%] Linking CXX shared module ../../bin/libggml-cpu-alderlake.so
+[ 46%] Built target ggml-cpu-alderlake
+[ 46%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/mmq.cu.o
+[ 46%] Linking CXX shared module ../../bin/libggml-cpu-sapphirerapids.so
+[ 46%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/mmvf.cu.o
+[ 46%] Built target ggml-cpu-sapphirerapids
+[ 46%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/mmvq.cu.o
+[ 46%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/norm.cu.o
+[ 47%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/opt-step-adamw.cu.o
+[ 47%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/opt-step-sgd.cu.o
+[ 47%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/out-prod.cu.o
+[ 47%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/pad.cu.o
+[ 47%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/pad_reflect_1d.cu.o
+[ 47%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/pool2d.cu.o
+[ 47%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/quantize.cu.o
+[ 48%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/roll.cu.o
+[ 48%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/rope.cu.o
+[ 48%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/scale.cu.o
+[ 48%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/set-rows.cu.o
+[ 48%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/set.cu.o
+[ 48%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/softcap.cu.o
+[ 48%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/softmax.cu.o
+[ 48%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/solve_tri.cu.o
+[ 50%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/ssm-conv.cu.o
+[ 50%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/ssm-scan.cu.o
+[ 50%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/sum.cu.o
+[ 50%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/sumrows.cu.o
+[ 50%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/top-k.cu.o
+[ 50%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/topk-moe.cu.o
+[ 50%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/tri.cu.o
+[ 50%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/tsembd.cu.o
+[ 51%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/unary.cu.o
+[ 51%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/upscale.cu.o
+[ 51%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/wkv.cu.o
+[ 51%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-tile-instance-dkq112-dv112.cu.o
+[ 51%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-tile-instance-dkq128-dv128.cu.o
+[ 51%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-tile-instance-dkq256-dv256.cu.o
+[ 51%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-tile-instance-dkq40-dv40.cu.o
+[ 51%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-tile-instance-dkq576-dv512.cu.o
+[ 52%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-tile-instance-dkq64-dv64.cu.o
+[ 52%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-tile-instance-dkq72-dv72.cu.o
+[ 52%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-tile-instance-dkq80-dv80.cu.o
+[ 52%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-tile-instance-dkq96-dv96.cu.o
+[ 52%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_1-ncols2_16.cu.o
+[ 52%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_1-ncols2_32.cu.o
+[ 52%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_1-ncols2_8.cu.o
+[ 52%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_16-ncols2_1.cu.o
+[ 53%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_16-ncols2_2.cu.o
+[ 53%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_16-ncols2_4.cu.o
+[ 53%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_2-ncols2_16.cu.o
+[ 53%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_2-ncols2_32.cu.o
+[ 53%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_2-ncols2_4.cu.o
+[ 53%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_2-ncols2_8.cu.o
+[ 53%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_32-ncols2_1.cu.o
+[ 53%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_32-ncols2_2.cu.o
+[ 55%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_16.cu.o
+[ 55%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_2.cu.o
+[ 55%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_4.cu.o
+[ 55%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_4-ncols2_8.cu.o
+[ 55%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_64-ncols2_1.cu.o
+[ 55%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_1.cu.o
+[ 55%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_2.cu.o
+[ 55%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_4.cu.o
+[ 56%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-mma-f16-instance-ncols1_8-ncols2_8.cu.o
+[ 56%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-iq1_s.cu.o
+[ 56%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-iq2_s.cu.o
+[ 56%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-iq2_xs.cu.o
+[ 56%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-iq2_xxs.cu.o
+[ 56%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-iq3_s.cu.o
+[ 56%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-iq3_xxs.cu.o
+[ 56%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-iq4_nl.cu.o
+[ 57%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-iq4_xs.cu.o
+[ 57%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-mxfp4.cu.o
+[ 57%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-q2_k.cu.o
+[ 57%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-q3_k.cu.o
+[ 57%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-q4_0.cu.o
+[ 57%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-q4_1.cu.o
+[ 57%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-q4_k.cu.o
+[ 59%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-q5_0.cu.o
+[ 59%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-q5_1.cu.o
+[ 59%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-q5_k.cu.o
+[ 59%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-q6_k.cu.o
+[ 59%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmq-instance-q8_0.cu.o
+[ 59%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_1.cu.o
+[ 59%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_10.cu.o
+[ 59%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_11.cu.o
+[ 60%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_12.cu.o
+[ 60%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_13.cu.o
+[ 60%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_14.cu.o
+[ 60%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_15.cu.o
+[ 60%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_16.cu.o
+[ 60%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_2.cu.o
+[ 60%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_3.cu.o
+[ 60%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_4.cu.o
+[ 61%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_5.cu.o
+[ 61%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_6.cu.o
+[ 61%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_7.cu.o
+[ 61%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_8.cu.o
+[ 61%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/mmf-instance-ncols_9.cu.o
+[ 61%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-vec-instance-f16-f16.cu.o
+[ 61%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-vec-instance-q4_0-q4_0.cu.o
+[ 61%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-vec-instance-q8_0-q8_0.cu.o
+[ 63%] Building CUDA object ggml/src/ggml-cuda/CMakeFiles/ggml-cuda.dir/template-instances/fattn-vec-instance-bf16-bf16.cu.o
+[ 63%] Linking CUDA shared module ../../../bin/libggml-cuda.so
+[ 63%] Built target ggml-cuda
+[ 63%] Building CXX object ggml/src/CMakeFiles/ggml.dir/ggml-backend-dl.cpp.o
+[ 64%] Building CXX object ggml/src/CMakeFiles/ggml.dir/ggml-backend-reg.cpp.o
+[ 64%] Linking CXX shared library ../../bin/libggml.so
+[ 64%] Built target ggml
+[ 64%] Building CXX object src/CMakeFiles/llama.dir/llama-adapter.cpp.o
+[ 64%] Building CXX object src/CMakeFiles/llama.dir/llama.cpp.o
+[ 64%] Building CXX object src/CMakeFiles/llama.dir/llama-grammar.cpp.o
+[ 64%] Building CXX object src/CMakeFiles/llama.dir/llama-arch.cpp.o
+[ 64%] Building CXX object src/CMakeFiles/llama.dir/llama-io.cpp.o
+[ 64%] Building CXX object src/CMakeFiles/llama.dir/llama-batch.cpp.o
+[ 65%] Building CXX object src/CMakeFiles/llama.dir/llama-context.cpp.o
+[ 65%] Building CXX object src/CMakeFiles/llama.dir/llama-chat.cpp.o
+[ 65%] Building CXX object src/CMakeFiles/llama.dir/llama-cparams.cpp.o
+[ 65%] Building CXX object src/CMakeFiles/llama.dir/llama-graph.cpp.o
+[ 65%] Building CXX object src/CMakeFiles/llama.dir/llama-hparams.cpp.o
+[ 65%] Building CXX object src/CMakeFiles/llama.dir/llama-impl.cpp.o
+[ 67%] Building CXX object src/CMakeFiles/llama.dir/llama-kv-cache.cpp.o
+[ 67%] Building CXX object src/CMakeFiles/llama.dir/llama-kv-cache-iswa.cpp.o
+[ 67%] Building CXX object src/CMakeFiles/llama.dir/llama-memory.cpp.o
+[ 67%] Building CXX object src/CMakeFiles/llama.dir/llama-memory-hybrid.cpp.o
+[ 67%] Building CXX object src/CMakeFiles/llama.dir/llama-memory-hybrid-iswa.cpp.o
+[ 67%] Building CXX object src/CMakeFiles/llama.dir/llama-memory-recurrent.cpp.o
+[ 67%] Building CXX object src/CMakeFiles/llama.dir/llama-mmap.cpp.o
+[ 67%] Building CXX object src/CMakeFiles/llama.dir/llama-model-loader.cpp.o
+[ 68%] Building CXX object src/CMakeFiles/llama.dir/llama-model-saver.cpp.o
+[ 68%] Building CXX object src/CMakeFiles/llama.dir/llama-quant.cpp.o
+[ 68%] Building CXX object src/CMakeFiles/llama.dir/llama-model.cpp.o
+[ 68%] Building CXX object src/CMakeFiles/llama.dir/llama-sampler.cpp.o
+[ 68%] Building CXX object src/CMakeFiles/llama.dir/llama-vocab.cpp.o
+[ 68%] Building CXX object src/CMakeFiles/llama.dir/unicode-data.cpp.o
+[ 68%] Building CXX object src/CMakeFiles/llama.dir/unicode.cpp.o
+[ 68%] Building CXX object src/CMakeFiles/llama.dir/models/afmoe.cpp.o
+[ 69%] Building CXX object src/CMakeFiles/llama.dir/models/apertus.cpp.o
+[ 69%] Building CXX object src/CMakeFiles/llama.dir/models/arcee.cpp.o
+[ 69%] Building CXX object src/CMakeFiles/llama.dir/models/arctic.cpp.o
+[ 69%] Building CXX object src/CMakeFiles/llama.dir/models/arwkv7.cpp.o
+[ 69%] Building CXX object src/CMakeFiles/llama.dir/models/baichuan.cpp.o
+[ 69%] Building CXX object src/CMakeFiles/llama.dir/models/bailingmoe.cpp.o
+[ 69%] Building CXX object src/CMakeFiles/llama.dir/models/bailingmoe2.cpp.o
+[ 69%] Building CXX object src/CMakeFiles/llama.dir/models/bert.cpp.o
+[ 71%] Building CXX object src/CMakeFiles/llama.dir/models/bitnet.cpp.o
+[ 71%] Building CXX object src/CMakeFiles/llama.dir/models/bloom.cpp.o
+[ 71%] Building CXX object src/CMakeFiles/llama.dir/models/chameleon.cpp.o
+[ 71%] Building CXX object src/CMakeFiles/llama.dir/models/chatglm.cpp.o
+[ 71%] Building CXX object src/CMakeFiles/llama.dir/models/codeshell.cpp.o
+[ 71%] Building CXX object src/CMakeFiles/llama.dir/models/cogvlm.cpp.o
+[ 71%] Building CXX object src/CMakeFiles/llama.dir/models/cohere2-iswa.cpp.o
+[ 72%] Building CXX object src/CMakeFiles/llama.dir/models/command-r.cpp.o
+[ 72%] Building CXX object src/CMakeFiles/llama.dir/models/dbrx.cpp.o
+[ 72%] Building CXX object src/CMakeFiles/llama.dir/models/deci.cpp.o
+[ 72%] Building CXX object src/CMakeFiles/llama.dir/models/deepseek.cpp.o
+[ 72%] Building CXX object src/CMakeFiles/llama.dir/models/deepseek2.cpp.o
+[ 72%] Building CXX object src/CMakeFiles/llama.dir/models/delta-net-base.cpp.o
+[ 72%] Building CXX object src/CMakeFiles/llama.dir/models/dots1.cpp.o
+[ 72%] Building CXX object src/CMakeFiles/llama.dir/models/dream.cpp.o
+[ 73%] Building CXX object src/CMakeFiles/llama.dir/models/ernie4-5-moe.cpp.o
+[ 73%] Building CXX object src/CMakeFiles/llama.dir/models/ernie4-5.cpp.o
+[ 73%] Building CXX object src/CMakeFiles/llama.dir/models/eurobert.cpp.o
+[ 73%] Building CXX object src/CMakeFiles/llama.dir/models/exaone-moe.cpp.o
+[ 73%] Building CXX object src/CMakeFiles/llama.dir/models/exaone.cpp.o
+[ 73%] Building CXX object src/CMakeFiles/llama.dir/models/exaone4.cpp.o
+[ 73%] Building CXX object src/CMakeFiles/llama.dir/models/falcon-h1.cpp.o
+[ 73%] Building CXX object src/CMakeFiles/llama.dir/models/falcon.cpp.o
+[ 75%] Building CXX object src/CMakeFiles/llama.dir/models/gemma-embedding.cpp.o
+[ 75%] Building CXX object src/CMakeFiles/llama.dir/models/gemma.cpp.o
+[ 75%] Building CXX object src/CMakeFiles/llama.dir/models/gemma2-iswa.cpp.o
+[ 75%] Building CXX object src/CMakeFiles/llama.dir/models/gemma3.cpp.o
+[ 75%] Building CXX object src/CMakeFiles/llama.dir/models/gemma3n-iswa.cpp.o
+[ 75%] Building CXX object src/CMakeFiles/llama.dir/models/glm4-moe.cpp.o
+[ 75%] Building CXX object src/CMakeFiles/llama.dir/models/glm4.cpp.o
+[ 75%] Building CXX object src/CMakeFiles/llama.dir/models/gpt2.cpp.o
+[ 76%] Building CXX object src/CMakeFiles/llama.dir/models/gptneox.cpp.o
+[ 76%] Building CXX object src/CMakeFiles/llama.dir/models/granite-hybrid.cpp.o
+[ 76%] Building CXX object src/CMakeFiles/llama.dir/models/granite.cpp.o
+[ 76%] Building CXX object src/CMakeFiles/llama.dir/models/grok.cpp.o
+[ 76%] Building CXX object src/CMakeFiles/llama.dir/models/grovemoe.cpp.o
+[ 76%] Building CXX object src/CMakeFiles/llama.dir/models/hunyuan-dense.cpp.o
+[ 76%] Building CXX object src/CMakeFiles/llama.dir/models/hunyuan-moe.cpp.o
+[ 76%] Building CXX object src/CMakeFiles/llama.dir/models/internlm2.cpp.o
+[ 77%] Building CXX object src/CMakeFiles/llama.dir/models/jais.cpp.o
+[ 77%] Building CXX object src/CMakeFiles/llama.dir/models/jais2.cpp.o
+[ 77%] Building CXX object src/CMakeFiles/llama.dir/models/jamba.cpp.o
+[ 77%] Building CXX object src/CMakeFiles/llama.dir/models/kimi-linear.cpp.o
+[ 77%] Building CXX object src/CMakeFiles/llama.dir/models/lfm2.cpp.o
+[ 77%] Building CXX object src/CMakeFiles/llama.dir/models/llada-moe.cpp.o
+[ 77%] Building CXX object src/CMakeFiles/llama.dir/models/llada.cpp.o
+[ 77%] Building CXX object src/CMakeFiles/llama.dir/models/llama-iswa.cpp.o
+[ 78%] Building CXX object src/CMakeFiles/llama.dir/models/llama.cpp.o
+[ 78%] Building CXX object src/CMakeFiles/llama.dir/models/maincoder.cpp.o
+[ 78%] Building CXX object src/CMakeFiles/llama.dir/models/mamba-base.cpp.o
+[ 78%] Building CXX object src/CMakeFiles/llama.dir/models/mamba.cpp.o
+[ 78%] Building CXX object src/CMakeFiles/llama.dir/models/mimo2-iswa.cpp.o
+[ 78%] Building CXX object src/CMakeFiles/llama.dir/models/minicpm3.cpp.o
+[ 78%] Building CXX object src/CMakeFiles/llama.dir/models/minimax-m2.cpp.o
+[ 78%] Building CXX object src/CMakeFiles/llama.dir/models/mistral3.cpp.o
+[ 80%] Building CXX object src/CMakeFiles/llama.dir/models/modern-bert.cpp.o
+[ 80%] Building CXX object src/CMakeFiles/llama.dir/models/mpt.cpp.o
+[ 80%] Building CXX object src/CMakeFiles/llama.dir/models/nemotron-h.cpp.o
+[ 80%] Building CXX object src/CMakeFiles/llama.dir/models/nemotron.cpp.o
+[ 80%] Building CXX object src/CMakeFiles/llama.dir/models/neo-bert.cpp.o
+[ 80%] Building CXX object src/CMakeFiles/llama.dir/models/olmo.cpp.o
+[ 80%] Building CXX object src/CMakeFiles/llama.dir/models/olmo2.cpp.o
+[ 80%] Building CXX object src/CMakeFiles/llama.dir/models/olmoe.cpp.o
+[ 81%] Building CXX object src/CMakeFiles/llama.dir/models/openai-moe-iswa.cpp.o
+[ 81%] Building CXX object src/CMakeFiles/llama.dir/models/openelm.cpp.o
+[ 81%] Building CXX object src/CMakeFiles/llama.dir/models/orion.cpp.o
+[ 81%] Building CXX object src/CMakeFiles/llama.dir/models/paddleocr.cpp.o
+[ 81%] Building CXX object src/CMakeFiles/llama.dir/models/pangu-embedded.cpp.o
+[ 81%] Building CXX object src/CMakeFiles/llama.dir/models/phi2.cpp.o
+[ 81%] Building CXX object src/CMakeFiles/llama.dir/models/phi3.cpp.o
+[ 82%] Building CXX object src/CMakeFiles/llama.dir/models/plamo.cpp.o
+[ 82%] Building CXX object src/CMakeFiles/llama.dir/models/plamo2.cpp.o
+[ 82%] Building CXX object src/CMakeFiles/llama.dir/models/plamo3.cpp.o
+[ 82%] Building CXX object src/CMakeFiles/llama.dir/models/plm.cpp.o
+[ 82%] Building CXX object src/CMakeFiles/llama.dir/models/qwen.cpp.o
+[ 82%] Building CXX object src/CMakeFiles/llama.dir/models/qwen2.cpp.o
+[ 82%] Building CXX object src/CMakeFiles/llama.dir/models/qwen2moe.cpp.o
+[ 82%] Building CXX object src/CMakeFiles/llama.dir/models/qwen2vl.cpp.o
+[ 84%] Building CXX object src/CMakeFiles/llama.dir/models/qwen3.cpp.o
+[ 84%] Building CXX object src/CMakeFiles/llama.dir/models/qwen35.cpp.o
+[ 84%] Building CXX object src/CMakeFiles/llama.dir/models/qwen35moe.cpp.o
+[ 84%] Building CXX object src/CMakeFiles/llama.dir/models/qwen3moe.cpp.o
+[ 84%] Building CXX object src/CMakeFiles/llama.dir/models/qwen3next.cpp.o
+[ 84%] Building CXX object src/CMakeFiles/llama.dir/models/qwen3vl-moe.cpp.o
+[ 84%] Building CXX object src/CMakeFiles/llama.dir/models/qwen3vl.cpp.o
+[ 84%] Building CXX object src/CMakeFiles/llama.dir/models/refact.cpp.o
+[ 85%] Building CXX object src/CMakeFiles/llama.dir/models/rnd1.cpp.o
+[ 85%] Building CXX object src/CMakeFiles/llama.dir/models/rwkv6-base.cpp.o
+[ 85%] Building CXX object src/CMakeFiles/llama.dir/models/rwkv6.cpp.o
+[ 85%] Building CXX object src/CMakeFiles/llama.dir/models/rwkv6qwen2.cpp.o
+[ 85%] Building CXX object src/CMakeFiles/llama.dir/models/rwkv7-base.cpp.o
+[ 85%] Building CXX object src/CMakeFiles/llama.dir/models/rwkv7.cpp.o
+[ 85%] Building CXX object src/CMakeFiles/llama.dir/models/seed-oss.cpp.o
+[ 85%] Building CXX object src/CMakeFiles/llama.dir/models/smallthinker.cpp.o
+[ 86%] Building CXX object src/CMakeFiles/llama.dir/models/smollm3.cpp.o
+[ 86%] Building CXX object src/CMakeFiles/llama.dir/models/stablelm.cpp.o
+[ 86%] Building CXX object src/CMakeFiles/llama.dir/models/starcoder.cpp.o
+[ 86%] Building CXX object src/CMakeFiles/llama.dir/models/starcoder2.cpp.o
+[ 86%] Building CXX object src/CMakeFiles/llama.dir/models/step35-iswa.cpp.o
+[ 86%] Building CXX object src/CMakeFiles/llama.dir/models/t5-dec.cpp.o
+[ 86%] Building CXX object src/CMakeFiles/llama.dir/models/t5-enc.cpp.o
+[ 86%] Building CXX object src/CMakeFiles/llama.dir/models/wavtokenizer-dec.cpp.o
+[ 88%] Building CXX object src/CMakeFiles/llama.dir/models/xverse.cpp.o
+[ 88%] Linking CXX shared library ../bin/libllama.so
+[ 88%] Built target llama
+[ 88%] Building CXX object common/CMakeFiles/common.dir/chat-auto-parser-generator.cpp.o
+[ 88%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/mtmd.cpp.o
+[ 88%] Building CXX object common/CMakeFiles/common.dir/arg.cpp.o
+[ 88%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/mtmd-image.cpp.o
+[ 89%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/mtmd-audio.cpp.o
+[ 89%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/clip.cpp.o
+[ 89%] Building CXX object common/CMakeFiles/common.dir/chat-auto-parser-helpers.cpp.o
+[ 89%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/mtmd-helper.cpp.o
+[ 89%] Building CXX object common/CMakeFiles/common.dir/chat-diff-analyzer.cpp.o
+[ 89%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/cogvlm.cpp.o
+[ 89%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/conformer.cpp.o
+[ 89%] Building CXX object common/CMakeFiles/common.dir/chat-peg-parser.cpp.o
+[ 89%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/glm4v.cpp.o
+[ 89%] Building CXX object common/CMakeFiles/common.dir/chat.cpp.o
+[ 90%] Building CXX object common/CMakeFiles/common.dir/common.cpp.o
+[ 90%] Building CXX object common/CMakeFiles/common.dir/console.cpp.o
+[ 90%] Building CXX object common/CMakeFiles/common.dir/debug.cpp.o
+[ 92%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/internvl.cpp.o
+[ 92%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/kimivl.cpp.o
+[ 92%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/kimik25.cpp.o
+[ 92%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/nemotron-v2-vl.cpp.o
+[ 92%] Building CXX object common/CMakeFiles/common.dir/download.cpp.o
+[ 92%] Building CXX object common/CMakeFiles/common.dir/hf-cache.cpp.o
+[ 92%] Building CXX object common/CMakeFiles/common.dir/json-partial.cpp.o
+[ 92%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/llama4.cpp.o
+[ 92%] Building CXX object common/CMakeFiles/common.dir/json-schema-to-grammar.cpp.o
+[ 92%] Building CXX object common/CMakeFiles/common.dir/llguidance.cpp.o
+[ 92%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/llava.cpp.o
+[ 93%] Building CXX object common/CMakeFiles/common.dir/log.cpp.o
+[ 93%] Building CXX object common/CMakeFiles/common.dir/ngram-cache.cpp.o
+[ 93%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/minicpmv.cpp.o
+[ 93%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/paddleocr.cpp.o
+[ 94%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/pixtral.cpp.o
+[ 94%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/qwen2vl.cpp.o
+[ 94%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/qwen3vl.cpp.o
+[ 94%] Building CXX object common/CMakeFiles/common.dir/ngram-map.cpp.o
+[ 94%] Building CXX object common/CMakeFiles/common.dir/ngram-mod.cpp.o
+[ 94%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/siglip.cpp.o
+[ 94%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/whisper-enc.cpp.o
+[ 94%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/deepseekocr.cpp.o
+[ 94%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/mobilenetv5.cpp.o
+[ 94%] Building CXX object common/CMakeFiles/common.dir/peg-parser.cpp.o
+[ 94%] Building CXX object common/CMakeFiles/common.dir/preset.cpp.o
+[ 94%] Building CXX object common/CMakeFiles/common.dir/regex-partial.cpp.o
+[ 94%] Building CXX object common/CMakeFiles/common.dir/reasoning-budget.cpp.o
+[ 96%] Building CXX object common/CMakeFiles/common.dir/sampling.cpp.o
+[ 96%] Building CXX object tools/mtmd/CMakeFiles/mtmd.dir/models/youtuvl.cpp.o
+[ 96%] Building CXX object common/CMakeFiles/common.dir/speculative.cpp.o
+[ 96%] Building CXX object common/CMakeFiles/common.dir/unicode.cpp.o
+[ 96%] Building CXX object common/CMakeFiles/common.dir/jinja/lexer.cpp.o
+[ 96%] Building CXX object common/CMakeFiles/common.dir/jinja/parser.cpp.o
+[ 96%] Building CXX object common/CMakeFiles/common.dir/jinja/runtime.cpp.o
+[ 96%] Building CXX object common/CMakeFiles/common.dir/jinja/value.cpp.o
+[ 97%] Linking CXX shared library ../../bin/libmtmd.so
+[ 97%] Built target mtmd
+[ 97%] Building CXX object common/CMakeFiles/common.dir/jinja/string.cpp.o
+[ 98%] Building CXX object common/CMakeFiles/common.dir/jinja/caps.cpp.o
+[ 98%] Building CXX object common/CMakeFiles/common.dir/__/license.cpp.o
+[ 98%] Linking CXX static library libcommon.a
+[ 98%] Built target common
+[ 98%] Building CXX object tools/server/CMakeFiles/server-context.dir/server-task.cpp.o
+[ 98%] Building CXX object tools/server/CMakeFiles/server-context.dir/server-queue.cpp.o
+[ 98%] Building CXX object tools/server/CMakeFiles/server-context.dir/server-common.cpp.o
+[ 98%] Building CXX object tools/server/CMakeFiles/server-context.dir/server-context.cpp.o
+[ 98%] Building CXX object tools/server/CMakeFiles/server-context.dir/server-tools.cpp.o
+[ 98%] Linking CXX static library libserver-context.a
+[ 98%] Built target server-context
+[ 98%] Generating index.html.gz.hpp
+[ 98%] Generating loading.html.hpp
+[ 98%] Building CXX object tools/server/CMakeFiles/llama-server.dir/server-http.cpp.o
+[ 98%] Building CXX object tools/server/CMakeFiles/llama-server.dir/server-models.cpp.o
+[ 98%] Building CXX object tools/server/CMakeFiles/llama-server.dir/server.cpp.o
+[100%] Linking CXX executable ../../bin/llama-server
+[100%] Built target llama-server
+```
+
+---
+
+### 文件信息
+
+
+
+ldd
+
+```
+linux-vdso.so.1 (0x00007ffde47ea000)
+libssl.so.3 => /lib/x86_64-linux-gnu/libssl.so.3 (0x00007b7103cf9000)
+libcrypto.so.3 => /lib/x86_64-linux-gnu/libcrypto.so.3 (0x00007b7103000000)
+libmtmd.so.0 => /home/xxx/llama.cpp/build/bin/libmtmd.so.0 (0x00007b7103515000)
+libllama.so.0 => /home/xxx/llama.cpp/build/bin/libllama.so.0 (0x00007b7102c00000)
+libggml.so.0 => /home/xxx/llama.cpp/build/bin/libggml.so.0 (0x00007b7103ced000)
+libggml-base.so.0 => /home/xxx/llama.cpp/build/bin/libggml-base.so.0 (0x00007b7102f55000)
+libstdc++.so.6 => /lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007b7102800000)
+libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007b7102b17000)
+libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007b7103cbd000)
+libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007b7102400000)
+/lib64/ld-linux-x86-64.so.2 (0x00007b7103dad000)
+```
+
+
+
+file
+
+```
+llama-server: ELF 64-bit LSB pie executable, x86-64, version 1 (GNU/Linux), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, BuildID[sha1]=c05665456d2
+b7d3a6a9146f7784e50c91b7a60a9, for GNU/Linux 3.2.0, not stripped
+```
+
+
+
+```
+strip llama-server
+strip --strip-unneeded libggml-*.so libllama*.so libmtmd*.so
+```
+
+
+
+ls -ahl
+
+```
+total 62M
+drwxr-xr-x  2 xxx xxx  4.0K Mar 31 17:56 .
+drwxr-xr-x 13 xxx xxx  4.0K Mar 31 17:36 ..
+lrwxrwxrwx  1 xxx xxx    17 Mar 31 17:38 libggml-base.so -> libggml-base.so.0
+lrwxrwxrwx  1 xxx xxx    21 Mar 31 17:38 libggml-base.so.0 -> libggml-base.so.0.9.8
+-rwxr-xr-x  1 xxx xxx  679K Mar 31 17:56 libggml-base.so.0.9.8
+-rwxr-xr-x  1 xxx xxx 1018K Mar 31 17:56 libggml-cpu-alderlake.so
+-rwxr-xr-x  1 xxx xxx  1.3M Mar 31 17:56 libggml-cpu-cannonlake.so
+-rwxr-xr-x  1 xxx xxx  1.3M Mar 31 17:56 libggml-cpu-cascadelake.so
+-rwxr-xr-x  1 xxx xxx  1.3M Mar 31 17:56 libggml-cpu-cooperlake.so
+-rwxr-xr-x  1 xxx xxx 1022K Mar 31 17:56 libggml-cpu-haswell.so
+-rwxr-xr-x  1 xxx xxx  1.3M Mar 31 17:56 libggml-cpu-icelake.so
+-rwxr-xr-x  1 xxx xxx  950K Mar 31 17:56 libggml-cpu-ivybridge.so
+-rwxr-xr-x  1 xxx xxx  950K Mar 31 17:56 libggml-cpu-piledriver.so
+-rwxr-xr-x  1 xxx xxx  942K Mar 31 17:56 libggml-cpu-sandybridge.so
+-rwxr-xr-x  1 xxx xxx  1.5M Mar 31 17:56 libggml-cpu-sapphirerapids.so
+-rwxr-xr-x  1 xxx xxx  1.3M Mar 31 17:56 libggml-cpu-skylakex.so
+-rwxr-xr-x  1 xxx xxx  794K Mar 31 17:56 libggml-cpu-sse42.so
+-rwxr-xr-x  1 xxx xxx  786K Mar 31 17:56 libggml-cpu-x64.so
+-rwxr-xr-x  1 xxx xxx  1.3M Mar 31 17:56 libggml-cpu-zen4.so
+-rwxr-xr-x  1 xxx xxx   36M Mar 31 17:56 libggml-cuda.so
+lrwxrwxrwx  1 xxx xxx    12 Mar 31 17:43 libggml.so -> libggml.so.0
+lrwxrwxrwx  1 xxx xxx    16 Mar 31 17:43 libggml.so.0 -> libggml.so.0.9.8
+-rwxr-xr-x  1 xxx xxx   55K Mar 31 17:43 libggml.so.0.9.8
+lrwxrwxrwx  1 xxx xxx    13 Mar 31 17:43 libllama.so -> libllama.so.0
+lrwxrwxrwx  1 xxx xxx    20 Mar 31 17:43 libllama.so.0 -> libllama.so.0.0.8593
+-rwxr-xr-x  1 xxx xxx  3.1M Mar 31 17:56 libllama.so.0.0.8593
+lrwxrwxrwx  1 xxx xxx    12 Mar 31 17:43 libmtmd.so -> libmtmd.so.0
+lrwxrwxrwx  1 xxx xxx    19 Mar 31 17:43 libmtmd.so.0 -> libmtmd.so.0.0.8593
+-rwxr-xr-x  1 xxx xxx  939K Mar 31 17:56 libmtmd.so.0.0.8593
+-rwxr-xr-x  1 xxx xxx  6.5M Mar 31 17:51 llama-server
+```
+
+
+
+./llama-server --version
+
+```
+ggml_cuda_init: found 1 CUDA devices (Total VRAM: 22527 MiB):
+  Device 0: NVIDIA GeForce RTX 2080 Ti, compute capability 7.5, VMM: yes, VRAM: 22527 MiB
+load_backend: loaded CUDA backend from /home/fsdnqr/llama.cpp/bin/libggml-cuda.so
+load_backend: loaded CPU backend from /home/fsdnqr/llama.cpp/bin/libggml-cpu-haswell.so
+version: 8593 (fcc2d598c)
+built with GNU 13.3.0 for Linux x86_64
+```
+
+---
+
+其实用[这个](https://github.com/ai-dock/llama.cpp-cuda)就行了
+

llama.cpp/llama-server.sh

@@ -0,0 +1,42 @@
+#!/usr/bin/env bash
+
+# 获取当前时间
+Now=$(date "+%Y-%m-%d %H:%M:%S")
+
+WorkDir=/home/xxx/llama.cpp
+
+# 将 bin 目录（.so 所在位置）加入动态库搜索路径
+export LD_LIBRARY_PATH=${WorkDir}/bin:$LD_LIBRARY_PATH
+# 同时确保 CUDA 路径也在（如果 bin 里没有那个 so）
+export LD_LIBRARY_PATH=/usr/local/cuda/lib64:$LD_LIBRARY_PATH
+
+while true; do
+    ${WorkDir}/bin/llama-server \
+      --model "${WorkDir}/gguf/Tencent-Hunyuan/HY-MT1.5-7B-GGUF/HY-MT1.5-7B-Q8_0.gguf" \
+      --alias "hy-mt1.5-7b" \
+      --host 0.0.0.0 \
+      --port 21233 \
+      --no-webui \
+      --n-gpu-layers all \
+      --ctx-size 32768 \
+      --flash-attn on \
+      --threads 8 \
+      --batch-size 8192 \
+      --ubatch-size 4096 \
+      --kv-offload \
+      --cache-prompt \
+      --mlock \
+      --no-mmap \
+      --parallel 1 \
+      --offline \
+      --log-timestamps \
+      --temp 0.70 \
+      --min-p 0.00 \
+      --top-k 20 \
+      --top-p 0.60 \
+      --repeat-penalty 1.05 \
+      --typical 0.95
+    
+    sleep 3
+    echo -e "\n$Now - Restart" 
+done

llama.cpp/llama.cpp_server_bin.tar.gz

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:367f77136c5799dcfed2570e2e89165a7029bab831816ed45296501f2a25991d
+size 33571157