fmasterpro27 commited on
Commit
7e79404
·
verified ·
1 Parent(s): b60d894

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -27
README.md CHANGED
@@ -4,30 +4,4 @@ library_name: transformers
4
  tags:
5
  - mlx
6
  base_model: deepseek-ai/DeepSeek-R1
7
- ---
8
-
9
- # fmasterpro27/DeepSeek-R1-mlx-2Bit
10
-
11
- The Model [fmasterpro27/DeepSeek-R1-mlx-2Bit](https://huggingface.co/fmasterpro27/DeepSeek-R1-mlx-2Bit) was converted to MLX format from [deepseek-ai/DeepSeek-R1](https://huggingface.co/deepseek-ai/DeepSeek-R1) using mlx-lm version **0.29.1**.
12
-
13
- ## Use with mlx
14
-
15
- ```bash
16
- pip install mlx-lm
17
- ```
18
-
19
- ```python
20
- from mlx_lm import load, generate
21
-
22
- model, tokenizer = load("fmasterpro27/DeepSeek-R1-mlx-2Bit")
23
-
24
- prompt="hello"
25
-
26
- if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
27
- messages = [{"role": "user", "content": prompt}]
28
- prompt = tokenizer.apply_chat_template(
29
- messages, tokenize=False, add_generation_prompt=True
30
- )
31
-
32
- response = generate(model, tokenizer, prompt=prompt, verbose=True)
33
- ```
 
4
  tags:
5
  - mlx
6
  base_model: deepseek-ai/DeepSeek-R1
7
+ ---