bibproj commited on
Commit
a583b88
·
verified ·
1 Parent(s): d531a04

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +34 -2
README.md CHANGED
@@ -1,7 +1,39 @@
1
  ---
2
- language: en
3
  pipeline_tag: text-generation
 
 
 
 
 
4
  tags:
5
  - mlx
6
- library_name: mlx
7
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
2
  pipeline_tag: text-generation
3
+ license: other
4
+ license_name: modified-mit
5
+ license_link: https://github.com/MiniMax-AI/MiniMax-M2.5/blob/main/LICENSE
6
+ library_name: mlx
7
+ base_model: MiniMaxAI/MiniMax-M2.5
8
  tags:
9
  - mlx
 
10
  ---
11
+
12
+ # mlx-community/MiniMax-M2.5-3bit
13
+
14
+ This model [mlx-community/MiniMax-M2.5-3bit](https://huggingface.co/mlx-community/MiniMax-M2.5-3bit) was
15
+ converted to MLX format from [MiniMaxAI/MiniMax-M2.5](https://huggingface.co/MiniMaxAI/MiniMax-M2.5)
16
+ using mlx-lm version **0.30.7**.
17
+
18
+ ## Use with mlx
19
+
20
+ ```bash
21
+ pip install mlx-lm
22
+ ```
23
+
24
+ ```python
25
+ from mlx_lm import load, generate
26
+
27
+ model, tokenizer = load("mlx-community/MiniMax-M2.5-3bit")
28
+
29
+ prompt = "hello"
30
+
31
+ if tokenizer.chat_template is not None:
32
+ messages = [{"role": "user", "content": prompt}]
33
+ prompt = tokenizer.apply_chat_template(
34
+ messages, add_generation_prompt=True, return_dict=False,
35
+ )
36
+
37
+ response = generate(model, tokenizer, prompt=prompt, verbose=True)
38
+ ```
39
+