Link to Clover, add compatibility, Windows notes and Ko-fi block
Browse files
README.md
CHANGED
|
@@ -1,17 +1,34 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
-
|
|
|
|
|
|
|
| 4 |
---
|
| 5 |
# llama.cpp with Clover support (clover_moe)
|
| 6 |
|
| 7 |
**Prebuilt Clover runtime by IsValorum**
|
| 8 |
|
| 9 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
|
| 11 |
Prebuilt Linux x86_64 binaries for [Diffuspace/Clover-35B-A3B-Preview](https://huggingface.co/Diffuspace/Clover-35B-A3B-Preview), built from llama.cpp PR [#31306](https://github.com/ggml-org/llama.cpp/pull/31306) at commit `4838ffb0c8ade92f34d9157deea38d92758ab824`.
|
| 12 |
|
| 13 |
Mainline llama.cpp does not load `clover_moe`. This build adds the converter, the runtime graph and the `draft-self` speculative mode. The PR is not merged upstream; pin this repository for reproducibility.
|
| 14 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
| File | Description |
|
| 16 |
|---|---|
|
| 17 |
| `llama-clover-b4838ffb-linux-x64-cpu.tar.gz` | Portable CPU build |
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
+
library_name: llama.cpp
|
| 4 |
+
base_model: Diffuspace/Clover-35B-A3B-Preview
|
| 5 |
+
tags: [llama.cpp, clover, clover_moe, prebuilt, runtime, linux, cuda]
|
| 6 |
---
|
| 7 |
# llama.cpp with Clover support (clover_moe)
|
| 8 |
|
| 9 |
**Prebuilt Clover runtime by IsValorum**
|
| 10 |
|
| 11 |
+
<p align="left">
|
| 12 |
+
<a href="https://ko-fi.com/isvalorum"><img src="https://ko-fi.com/img/githubbutton_sm.svg" alt="Support on Ko-fi" height="38"></a>
|
| 13 |
+
</p>
|
| 14 |
+
|
| 15 |
+
> [!IMPORTANT]
|
| 16 |
+
> **Independently computed using dedicated cloud compute clusters, funded 100% out-of-pocket.**
|
| 17 |
+
>
|
| 18 |
+
> If you consider these releases to be of high quality and they help you in your day-to-day workflow, consider [supporting on Ko-fi](https://ko-fi.com/isvalorum). Every contribution directly sustains future cloud compute hours and helps support my university studies.
|
| 19 |
|
| 20 |
Prebuilt Linux x86_64 binaries for [Diffuspace/Clover-35B-A3B-Preview](https://huggingface.co/Diffuspace/Clover-35B-A3B-Preview), built from llama.cpp PR [#31306](https://github.com/ggml-org/llama.cpp/pull/31306) at commit `4838ffb0c8ade92f34d9157deea38d92758ab824`.
|
| 21 |
|
| 22 |
Mainline llama.cpp does not load `clover_moe`. This build adds the converter, the runtime graph and the `draft-self` speculative mode. The PR is not merged upstream; pin this repository for reproducibility.
|
| 23 |
|
| 24 |
+
## Compatibility
|
| 25 |
+
|
| 26 |
+
- Model: `Diffuspace/Clover-35B-A3B-Preview` (`clover_moe`). Works with the BF16 and Q8_0 GGUFs and with third-party `clover_moe` GGUFs such as the IQ4_XS. It does not load the original safetensors.
|
| 27 |
+
- Linux x86_64: the CPU package runs on any Linux; the CUDA package requires an NVIDIA GPU and CUDA 12.x runtime, with archs 80/86/89/90 (A100, H100/H200, L40S, RTX 4090, A10G). Blackwell 100/120 is not in this build.
|
| 28 |
+
- Windows: no native binary here. Use WSL2 with the Linux CPU or CUDA package; a native Windows build must be compiled from the PR with CMake and MSVC. The GGUF files themselves are OS-agnostic.
|
| 29 |
+
- macOS: no binary here; use a Metal build of the PR or the third-party IQ4_XS Mac build.
|
| 30 |
+
- Frontends: not LM Studio or Ollama. Clover needs this `clover_moe` runtime until the PR merges upstream.
|
| 31 |
+
|
| 32 |
| File | Description |
|
| 33 |
|---|---|
|
| 34 |
| `llama-clover-b4838ffb-linux-x64-cpu.tar.gz` | Portable CPU build |
|