fmasterpro27 commited on
Commit
a546945
·
verified ·
1 Parent(s): 3eeef71

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -28
README.md CHANGED
@@ -9,32 +9,6 @@ tags:
9
  - llm
10
  - nanbeige
11
  - mlx
12
- - mlx-my-repo
13
  base_model: Nanbeige/Nanbeige4.1-3B
14
- ---
15
-
16
- # fmasterpro27/Nanbeige4.1-3B-mlx-4Bit
17
-
18
- The Model [fmasterpro27/Nanbeige4.1-3B-mlx-4Bit](https://huggingface.co/fmasterpro27/Nanbeige4.1-3B-mlx-4Bit) was converted to MLX format from [Nanbeige/Nanbeige4.1-3B](https://huggingface.co/Nanbeige/Nanbeige4.1-3B) using mlx-lm version **0.29.1**.
19
-
20
- ## Use with mlx
21
-
22
- ```bash
23
- pip install mlx-lm
24
- ```
25
-
26
- ```python
27
- from mlx_lm import load, generate
28
-
29
- model, tokenizer = load("fmasterpro27/Nanbeige4.1-3B-mlx-4Bit")
30
-
31
- prompt="hello"
32
-
33
- if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
34
- messages = [{"role": "user", "content": prompt}]
35
- prompt = tokenizer.apply_chat_template(
36
- messages, tokenize=False, add_generation_prompt=True
37
- )
38
-
39
- response = generate(model, tokenizer, prompt=prompt, verbose=True)
40
- ```
 
9
  - llm
10
  - nanbeige
11
  - mlx
12
+ - open4bits
13
  base_model: Nanbeige/Nanbeige4.1-3B
14
+ ---