stevorob commited on
Commit
c7a4ef3
·
verified ·
1 Parent(s): 37539fa

Request board: how to request a quant or abliteration

Browse files
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - requests
5
+ - gguf
6
+ - abliterated
7
+ - reap
8
+ - quantization
9
+ ---
10
+
11
+ # Request a quant or abliteration
12
+
13
+ Robinson Labs forges open models on a real homelab cluster: abliterated builds, REAP expert-pruned
14
+ MoE variants, importance-matrix (imatrix) GGUF quant ladders, and custom cluster-fit quants. This
15
+ repo is where you ask for one.
16
+
17
+ See what we have published: [huggingface.co/RobinsonLabs](https://huggingface.co/RobinsonLabs).
18
+
19
+ ## How to request
20
+ Open a new **Discussion** (the **Community** tab at the top of this repo) with:
21
+ - A link to the model on Hugging Face (the original or base repo).
22
+ - What you want: a GGUF quant ladder, an abliterated build, a REAP-pruned variant, or a fit-quant
23
+ tuned to a specific VRAM and context budget.
24
+ - Your target, if you have one: VRAM size, context length, or a specific quant (for example IQ4_XS,
25
+ Q6_K).
26
+
27
+ One model per Discussion keeps things easy to track.
28
+
29
+ ## What we prioritize
30
+ We are a one-person homelab, not a quant farm, so we bias toward the gaps, the builds that do not
31
+ already exist:
32
+ - **Abliterated builds** where there is no good uncensored variant yet.
33
+ - **Abliterated REAP / expert-pruned MoE**, a niche almost nobody fills.
34
+ - **Custom cluster-fit quants** tuned to a real VRAM and context budget (attention-path precision
35
+ kept high where it counts, experts run lighter).
36
+ - Models that lack a solid imatrix GGUF ladder.
37
+
38
+ If a model already has good quants from the usual sources, we will likely point you there. Where we
39
+ add value is the build that is missing.
40
+
41
+ ## What to expect
42
+ Best-effort, on hardware we own. No SLA, no queue promises. Every release ships with full provenance
43
+ and credits the upstream base author. On abliterated builds, harm guardrails stay intact by design
44
+ (self-harm prompts still redirect to help, and the build is not meant to assist genuine wrongdoing).
45
+
46
+ You are responsible for your use of any model published here.