fmasterpro27 commited on
Commit
a02fbcd
·
verified ·
1 Parent(s): 70491e5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -27
README.md CHANGED
@@ -8,30 +8,5 @@ datasets:
8
  library_name: transformers
9
  tags:
10
  - mlx
11
- ---
12
-
13
- # fmasterpro27/Olmo-3.1-32B-Think-mlx-2Bit
14
-
15
- The Model [fmasterpro27/Olmo-3.1-32B-Think-mlx-2Bit](https://huggingface.co/fmasterpro27/Olmo-3.1-32B-Think-mlx-2Bit) was converted to MLX format from [allenai/Olmo-3.1-32B-Think](https://huggingface.co/allenai/Olmo-3.1-32B-Think) using mlx-lm version **0.29.1**.
16
-
17
- ## Use with mlx
18
-
19
- ```bash
20
- pip install mlx-lm
21
- ```
22
-
23
- ```python
24
- from mlx_lm import load, generate
25
-
26
- model, tokenizer = load("fmasterpro27/Olmo-3.1-32B-Think-mlx-2Bit")
27
-
28
- prompt="hello"
29
-
30
- if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
31
- messages = [{"role": "user", "content": prompt}]
32
- prompt = tokenizer.apply_chat_template(
33
- messages, tokenize=False, add_generation_prompt=True
34
- )
35
-
36
- response = generate(model, tokenizer, prompt=prompt, verbose=True)
37
- ```
 
8
  library_name: transformers
9
  tags:
10
  - mlx
11
+ - open4bits
12
+ ---