zeekay commited on
Commit
677a10a
·
verified ·
1 Parent(s): 8eaac92

feat: initial release 2024-11-15

Browse files
Files changed (1) hide show
  1. README.md +54 -0
README.md ADDED
@@ -0,0 +1,54 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ tags:
6
+ - zen
7
+ - zenlm
8
+ - hanzo-ai
9
+ - abliterated
10
+ - sql
11
+ - database
12
+ - code-generation
13
+ pipeline_tag: text-generation
14
+ library_name: transformers
15
+ base_model: zenlm/zen4
16
+ ---
17
+
18
+ # Zen Sql
19
+
20
+ > **Parameters**: 7B | **Context**: 32K | **License**: Apache 2.0 | **Released**: 2024-11-15
21
+
22
+ SQL generation, query optimization, schema design, and database documentation across PostgreSQL, MySQL, SQLite, and BigQuery.
23
+
24
+ This model is abliterated — refusal behavior removed to enable unrestricted domain research.
25
+ Base weights: [zenlm/zen4](https://huggingface.co/zenlm/zen4)
26
+
27
+ ## Abliteration
28
+
29
+ Abliterated using representation engineering (Arditi et al., 2024 —
30
+ *Refusal in Language Models Is Mediated by a Single Direction*, arXiv:2406.11717).
31
+
32
+ Refusal direction orthogonalized out of the residual stream across all layers.
33
+ All capabilities preserved; safety-trained refusals removed.
34
+
35
+ **Intended uses**: Research, security testing, creative writing, red-teaming.
36
+ **Still prohibited**: CSAM, targeted harassment, mass-casualty weapon synthesis.
37
+
38
+ ```python
39
+ from transformers import AutoModelForCausalLM, AutoTokenizer
40
+ model = AutoModelForCausalLM.from_pretrained("zenlm/zen4", torch_dtype="auto")
41
+ tokenizer = AutoTokenizer.from_pretrained("zenlm/zen4")
42
+ ```
43
+
44
+ ---
45
+ ## The Zen LM Family
46
+
47
+ Joint research collaboration:
48
+ - **Hanzo AI** (Techstars 17) — AI infrastructure, API gateway, inference optimization
49
+ - **Zoo Labs Foundation** (501c3) — Open AI research, ZIPs governance, decentralized training
50
+ - **Lux Partners Limited** — Compute coordination and settlement layer
51
+
52
+ All weights Apache 2.0. Download, run locally, fine-tune, deploy commercially.
53
+
54
+ [HuggingFace](https://huggingface.co/zenlm) · [Chat free](https://hanzo.chat) · [API](https://api.hanzo.ai) · [Docs](https://zenlm.org)