Update README.md
Browse files
README.md
CHANGED
|
@@ -5,7 +5,7 @@ datasets:
|
|
| 5 |
language:
|
| 6 |
- en
|
| 7 |
base_model:
|
| 8 |
-
- unsloth/
|
| 9 |
library_name: mlx
|
| 10 |
tags:
|
| 11 |
- cyclonedx
|
|
@@ -29,16 +29,16 @@ Use the below configurations:
|
|
| 29 |
```
|
| 30 |
System Prompt: `You are a helpful assistant to the user.` Use Prompt [Template](https://lmstudio.ai/docs/advanced/prompt-template).
|
| 31 |
Temperature: 0.05
|
| 32 |
-
Max tokens:
|
| 33 |
Context length: 16000
|
| 34 |
```
|
| 35 |
|
| 36 |
## Testing with mlx
|
| 37 |
|
| 38 |
-
Install [miniconda](https://docs.anaconda.com/miniconda/install/) or Python 3.
|
| 39 |
|
| 40 |
```
|
| 41 |
-
conda create --name cdx1-mlx python=3.
|
| 42 |
conda activate cdx1-mlx
|
| 43 |
pip install mlx
|
| 44 |
```
|
|
|
|
| 5 |
language:
|
| 6 |
- en
|
| 7 |
base_model:
|
| 8 |
+
- unsloth/Qwen2.5-Coder-14B-Instruct
|
| 9 |
library_name: mlx
|
| 10 |
tags:
|
| 11 |
- cyclonedx
|
|
|
|
| 29 |
```
|
| 30 |
System Prompt: `You are a helpful assistant to the user.` Use Prompt [Template](https://lmstudio.ai/docs/advanced/prompt-template).
|
| 31 |
Temperature: 0.05
|
| 32 |
+
Max tokens: 16000 or 32000
|
| 33 |
Context length: 16000
|
| 34 |
```
|
| 35 |
|
| 36 |
## Testing with mlx
|
| 37 |
|
| 38 |
+
Install [miniconda](https://docs.anaconda.com/miniconda/install/) or Python 3.12
|
| 39 |
|
| 40 |
```
|
| 41 |
+
conda create --name cdx1-mlx python=3.12
|
| 42 |
conda activate cdx1-mlx
|
| 43 |
pip install mlx
|
| 44 |
```
|