fmasterpro27 commited on
Commit
61fb187
·
verified ·
1 Parent(s): ac1aa31

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -28
README.md CHANGED
@@ -5,32 +5,5 @@ library_name: transformers
5
  tags:
6
  - vllm
7
  - mlx
8
- - mlx-my-repo
9
  base_model: openai/gpt-oss-20b
10
- ---
11
-
12
- # fmasterpro27/gpt-oss-20b-mlx-2Bit
13
-
14
- The Model [fmasterpro27/gpt-oss-20b-mlx-2Bit](https://huggingface.co/fmasterpro27/gpt-oss-20b-mlx-2Bit) was converted to MLX format from [openai/gpt-oss-20b](https://huggingface.co/openai/gpt-oss-20b) using mlx-lm version **0.29.1**.
15
-
16
- ## Use with mlx
17
-
18
- ```bash
19
- pip install mlx-lm
20
- ```
21
-
22
- ```python
23
- from mlx_lm import load, generate
24
-
25
- model, tokenizer = load("fmasterpro27/gpt-oss-20b-mlx-2Bit")
26
-
27
- prompt="hello"
28
-
29
- if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
30
- messages = [{"role": "user", "content": prompt}]
31
- prompt = tokenizer.apply_chat_template(
32
- messages, tokenize=False, add_generation_prompt=True
33
- )
34
-
35
- response = generate(model, tokenizer, prompt=prompt, verbose=True)
36
- ```
 
5
  tags:
6
  - vllm
7
  - mlx
 
8
  base_model: openai/gpt-oss-20b
9
+ ---