dipsht9999 commited on
Commit
332c8bb
·
verified ·
1 Parent(s): f568f0f

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +47 -0
README.md ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: Ex0bit/GLM-4.7-PRISM
4
+ model_name: Elbaz-GLM-4.7-PRISM
5
+ tags:
6
+ - abliteration
7
+ - SOTA Abliteration Pipeline - PRISM
8
+ - glm
9
+ - glm4_moe
10
+ - quantized
11
+ - finetuned
12
+ - uncensored
13
+ - abliterated
14
+ - mlx
15
+ - mlx-my-repo
16
+ language:
17
+ - en
18
+ - zh
19
+ library_name: transformers
20
+ pipeline_tag: text-generation
21
+ ---
22
+
23
+ # dipsht9999/GLM-4.7-PRISM-mlx-2Bit
24
+
25
+ The Model [dipsht9999/GLM-4.7-PRISM-mlx-2Bit](https://huggingface.co/dipsht9999/GLM-4.7-PRISM-mlx-2Bit) was converted to MLX format from [Ex0bit/GLM-4.7-PRISM](https://huggingface.co/Ex0bit/GLM-4.7-PRISM) using mlx-lm version **0.29.1**.
26
+
27
+ ## Use with mlx
28
+
29
+ ```bash
30
+ pip install mlx-lm
31
+ ```
32
+
33
+ ```python
34
+ from mlx_lm import load, generate
35
+
36
+ model, tokenizer = load("dipsht9999/GLM-4.7-PRISM-mlx-2Bit")
37
+
38
+ prompt="hello"
39
+
40
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
41
+ messages = [{"role": "user", "content": prompt}]
42
+ prompt = tokenizer.apply_chat_template(
43
+ messages, tokenize=False, add_generation_prompt=True
44
+ )
45
+
46
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
47
+ ```