ggbondsdf commited on
Commit
b0cef95
·
verified ·
1 Parent(s): 8e98946

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -21
README.md CHANGED
@@ -5,27 +5,11 @@ tags:
5
  - mlx
6
  pipeline_tag: text-generation
7
  ---
 
8
 
9
- # mlx-community/IQuest-Coder-V1-7B-Base-8bit
10
 
11
- ## Use with mlx
12
 
13
- ```bash
14
- pip install mlx-lm
15
- ```
16
-
17
- ```python
18
- from mlx_lm import load, generate
19
-
20
- model, tokenizer = load("mlx-community/IQuest-Coder-V1-7B-Base-8bit")
21
-
22
- prompt = "hello"
23
-
24
- if tokenizer.chat_template is not None:
25
- messages = [{"role": "user", "content": prompt}]
26
- prompt = tokenizer.apply_chat_template(
27
- messages, add_generation_prompt=True, return_dict=False,
28
- )
29
-
30
- response = generate(model, tokenizer, prompt=prompt, verbose=True)
31
- ```
 
5
  - mlx
6
  pipeline_tag: text-generation
7
  ---
8
+ # xhxlb/IQuest-Coder-V1-7B-Base-8bit
9
 
10
+ This repository contains mlx quantized versions of [IQuestLab/IQuest-Coder-V1-7B-Base](https://huggingface.co/IQuestLab/IQuest-Coder-V1-7B-Base).
11
 
12
+ ## Original Model
13
 
14
+ - **Base Model**: [IQuestLab/IQuest-Coder-V1-7B-Base](https://huggingface.co/IQuestLab/IQuest-Coder-V1-7B-Base)
15
+ - **Organization**: [IQuestLab](https://huggingface.co/IQuestLab)