zeekay commited on
Commit
edf23df
·
verified ·
1 Parent(s): 36b7769

fix: remove abliterated tag, clean branding

Browse files
Files changed (1) hide show
  1. README.md +7 -15
README.md CHANGED
@@ -6,7 +6,6 @@ tags:
6
  - zen
7
  - zenlm
8
  - hanzo-ai
9
- - abliterated
10
  - multilingual
11
  - translation
12
  - CJK
@@ -17,35 +16,28 @@ base_model: zenlm/zen-next-80b-instruct
17
 
18
  # Zen Multilingual
19
 
20
- > **Parameters**: 32B | **Context**: 128K | **License**: Apache 2.0 | **Released**: 2024-12-01
21
 
22
  Multilingual text generation: English, Chinese, Japanese, Korean, Arabic, Spanish, French, German, Portuguese, Russian.
23
 
24
- This model is abliterated — refusal behavior removed to enable unrestricted domain research.
25
  Base weights: [zenlm/zen-next-80b-instruct](https://huggingface.co/zenlm/zen-next-80b-instruct)
26
 
27
- ## Abliteration
28
-
29
- Abliterated using representation engineering (Arditi et al., 2024 —
30
- *Refusal in Language Models Is Mediated by a Single Direction*, arXiv:2406.11717).
31
-
32
- Refusal direction orthogonalized out of the residual stream across all layers.
33
- All capabilities preserved; safety-trained refusals removed.
34
-
35
- **Intended uses**: Research, security testing, creative writing, red-teaming.
36
- **Still prohibited**: CSAM, targeted harassment, mass-casualty weapon synthesis.
37
-
38
  ```python
39
  from transformers import AutoModelForCausalLM, AutoTokenizer
40
  model = AutoModelForCausalLM.from_pretrained("zenlm/zen-next-80b-instruct", torch_dtype="auto")
41
  tokenizer = AutoTokenizer.from_pretrained("zenlm/zen-next-80b-instruct")
 
 
 
 
 
42
  ```
43
 
44
  ---
45
  ## The Zen LM Family
46
 
47
  Joint research collaboration:
48
- - **Hanzo AI** (Techstars 17) — AI infrastructure, API gateway, inference optimization
49
  - **Zoo Labs Foundation** (501c3) — Open AI research, ZIPs governance, decentralized training
50
  - **Lux Partners Limited** — Compute coordination and settlement layer
51
 
 
6
  - zen
7
  - zenlm
8
  - hanzo-ai
 
9
  - multilingual
10
  - translation
11
  - CJK
 
16
 
17
  # Zen Multilingual
18
 
19
+ > **Parameters**: 32B | **Architecture**: Zen 4 Architecture | **Context**: 128K | **License**: Apache 2.0 | **Released**: 2024-12-01
20
 
21
  Multilingual text generation: English, Chinese, Japanese, Korean, Arabic, Spanish, French, German, Portuguese, Russian.
22
 
 
23
  Base weights: [zenlm/zen-next-80b-instruct](https://huggingface.co/zenlm/zen-next-80b-instruct)
24
 
 
 
 
 
 
 
 
 
 
 
 
25
  ```python
26
  from transformers import AutoModelForCausalLM, AutoTokenizer
27
  model = AutoModelForCausalLM.from_pretrained("zenlm/zen-next-80b-instruct", torch_dtype="auto")
28
  tokenizer = AutoTokenizer.from_pretrained("zenlm/zen-next-80b-instruct")
29
+ messages = [{"role": "user", "content": "Your domain-specific prompt here"}]
30
+ text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
31
+ inputs = tokenizer(text, return_tensors="pt").to(model.device)
32
+ output = model.generate(**inputs, max_new_tokens=1024)
33
+ print(tokenizer.decode(output[0][inputs.input_ids.shape[-1]:], skip_special_tokens=True))
34
  ```
35
 
36
  ---
37
  ## The Zen LM Family
38
 
39
  Joint research collaboration:
40
+ - **Hanzo AI** (Techstars '17) — AI infrastructure, API gateway, inference optimization
41
  - **Zoo Labs Foundation** (501c3) — Open AI research, ZIPs governance, decentralized training
42
  - **Lux Partners Limited** — Compute coordination and settlement layer
43