zeekay commited on
Commit
3b42412
·
verified ·
1 Parent(s): 8d92148

feat: initial release

Browse files
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ - zh
6
+ tags:
7
+ - zen
8
+ - zenlm
9
+ - hanzo-ai
10
+ - abliterated
11
+ pipeline_tag: text-generation
12
+ library_name: transformers
13
+ base_model: zenlm/zen4-coder
14
+ ---
15
+
16
+ # Zen4 Coder Abliterated
17
+
18
+ > **Parameters**: 80B MoE | **Context**: 256K | **License**: Apache 2.0
19
+
20
+ Zen4 Coder abliterated — frontier code model, refusals removed. For security research and unrestricted code generation.
21
+
22
+ Weights at [zenlm/zen4-coder](https://huggingface.co/zenlm/zen4-coder) — abliterated post-training via representation engineering.
23
+
24
+ ## Abliteration
25
+
26
+ Abliterated using representation engineering (Arditi et al., 2024 —
27
+ *Refusal in Language Models Is Mediated by a Single Direction*, arXiv:2406.11717).
28
+
29
+ Refusal direction orthogonalized out of the residual stream across all layers.
30
+ All capabilities preserved; safety-trained refusals removed.
31
+
32
+ **Intended uses**: Research, security testing, creative writing, red-teaming.
33
+ **Still prohibited**: CSAM, targeted harassment, mass-casualty weapon synthesis.
34
+
35
+
36
+ ---
37
+ ## The Zen LM Family
38
+
39
+ Joint research collaboration:
40
+ - **Hanzo AI** (Techstars '17) — AI infrastructure, API gateway, inference optimization
41
+ - **Zoo Labs Foundation** (501c3) — Open AI research, ZIPs governance, decentralized training
42
+ - **Lux Partners Limited** — Compute coordination and settlement layer
43
+
44
+ All weights Apache 2.0. Download, run locally, fine-tune, deploy commercially.
45
+
46
+ [HuggingFace](https://huggingface.co/zenlm) · [Chat free](https://hanzo.chat) · [API](https://api.hanzo.ai) · [Docs](https://zenlm.org)