Wwayu commited on
Commit
418e4df
·
verified ·
1 Parent(s): b9ae830

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +48 -0
README.md ADDED
@@ -0,0 +1,48 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ base_model: Ex0bit/GLM-4.7-PRISM
4
+ model_name: Elbaz-GLM-4.7-PRISM
5
+ tags:
6
+ - abliteration
7
+ - SOTA Abliteration Pipeline - PRISM
8
+ - glm
9
+ - glm4_moe
10
+ - gguf
11
+ - quantized
12
+ - finetuned
13
+ - uncensored
14
+ - abliterated
15
+ - mlx
16
+ - mlx-my-repo
17
+ language:
18
+ - en
19
+ - zh
20
+ library_name: transformers
21
+ pipeline_tag: text-generation
22
+ ---
23
+
24
+ # Wwayu/GLM-4.7-PRISM-mlx-2Bit
25
+
26
+ The Model [Wwayu/GLM-4.7-PRISM-mlx-2Bit](https://huggingface.co/Wwayu/GLM-4.7-PRISM-mlx-2Bit) was converted to MLX format from [Ex0bit/GLM-4.7-PRISM](https://huggingface.co/Ex0bit/GLM-4.7-PRISM) using mlx-lm version **0.28.3**.
27
+
28
+ ## Use with mlx
29
+
30
+ ```bash
31
+ pip install mlx-lm
32
+ ```
33
+
34
+ ```python
35
+ from mlx_lm import load, generate
36
+
37
+ model, tokenizer = load("Wwayu/GLM-4.7-PRISM-mlx-2Bit")
38
+
39
+ prompt="hello"
40
+
41
+ if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
42
+ messages = [{"role": "user", "content": prompt}]
43
+ prompt = tokenizer.apply_chat_template(
44
+ messages, tokenize=False, add_generation_prompt=True
45
+ )
46
+
47
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
48
+ ```