IsValorum commited on
Commit
992e5a2
·
verified ·
1 Parent(s): b3fc857

Link to Clover, add compatibility, Windows notes and Ko-fi block

Browse files
Files changed (1) hide show
  1. README.md +19 -2
README.md CHANGED
@@ -1,17 +1,34 @@
1
  ---
2
  license: mit
3
- tags: [llama.cpp, clover, clover_moe, prebuilt, cuda]
 
 
4
  ---
5
  # llama.cpp with Clover support (clover_moe)
6
 
7
  **Prebuilt Clover runtime by IsValorum**
8
 
9
- [Hugging Face](https://huggingface.co/IsValorum) | [Ko-fi](https://ko-fi.com/isvalorum)
 
 
 
 
 
 
 
10
 
11
  Prebuilt Linux x86_64 binaries for [Diffuspace/Clover-35B-A3B-Preview](https://huggingface.co/Diffuspace/Clover-35B-A3B-Preview), built from llama.cpp PR [#31306](https://github.com/ggml-org/llama.cpp/pull/31306) at commit `4838ffb0c8ade92f34d9157deea38d92758ab824`.
12
 
13
  Mainline llama.cpp does not load `clover_moe`. This build adds the converter, the runtime graph and the `draft-self` speculative mode. The PR is not merged upstream; pin this repository for reproducibility.
14
 
 
 
 
 
 
 
 
 
15
  | File | Description |
16
  |---|---|
17
  | `llama-clover-b4838ffb-linux-x64-cpu.tar.gz` | Portable CPU build |
 
1
  ---
2
  license: mit
3
+ library_name: llama.cpp
4
+ base_model: Diffuspace/Clover-35B-A3B-Preview
5
+ tags: [llama.cpp, clover, clover_moe, prebuilt, runtime, linux, cuda]
6
  ---
7
  # llama.cpp with Clover support (clover_moe)
8
 
9
  **Prebuilt Clover runtime by IsValorum**
10
 
11
+ <p align="left">
12
+ <a href="https://ko-fi.com/isvalorum"><img src="https://ko-fi.com/img/githubbutton_sm.svg" alt="Support on Ko-fi" height="38"></a>
13
+ </p>
14
+
15
+ > [!IMPORTANT]
16
+ > **Independently computed using dedicated cloud compute clusters, funded 100% out-of-pocket.**
17
+ >
18
+ > If you consider these releases to be of high quality and they help you in your day-to-day workflow, consider [supporting on Ko-fi](https://ko-fi.com/isvalorum). Every contribution directly sustains future cloud compute hours and helps support my university studies.
19
 
20
  Prebuilt Linux x86_64 binaries for [Diffuspace/Clover-35B-A3B-Preview](https://huggingface.co/Diffuspace/Clover-35B-A3B-Preview), built from llama.cpp PR [#31306](https://github.com/ggml-org/llama.cpp/pull/31306) at commit `4838ffb0c8ade92f34d9157deea38d92758ab824`.
21
 
22
  Mainline llama.cpp does not load `clover_moe`. This build adds the converter, the runtime graph and the `draft-self` speculative mode. The PR is not merged upstream; pin this repository for reproducibility.
23
 
24
+ ## Compatibility
25
+
26
+ - Model: `Diffuspace/Clover-35B-A3B-Preview` (`clover_moe`). Works with the BF16 and Q8_0 GGUFs and with third-party `clover_moe` GGUFs such as the IQ4_XS. It does not load the original safetensors.
27
+ - Linux x86_64: the CPU package runs on any Linux; the CUDA package requires an NVIDIA GPU and CUDA 12.x runtime, with archs 80/86/89/90 (A100, H100/H200, L40S, RTX 4090, A10G). Blackwell 100/120 is not in this build.
28
+ - Windows: no native binary here. Use WSL2 with the Linux CPU or CUDA package; a native Windows build must be compiled from the PR with CMake and MSVC. The GGUF files themselves are OS-agnostic.
29
+ - macOS: no binary here; use a Metal build of the PR or the third-party IQ4_XS Mac build.
30
+ - Frontends: not LM Studio or Ollama. Clover needs this `clover_moe` runtime until the PR merges upstream.
31
+
32
  | File | Description |
33
  |---|---|
34
  | `llama-clover-b4838ffb-linux-x64-cpu.tar.gz` | Portable CPU build |