Update README.md
Browse files
README.md
CHANGED
|
@@ -22,13 +22,7 @@ Finetuned from model: [Meta-Llama-3-8B-Instruct]
|
|
| 22 |
|
| 23 |
**The model is quantized version of the [defog/llama-3-sqlcoder-8b](https://huggingface.co/defog/llama-3-sqlcoder-8b) with int8_float16 quantization and can be used in [CTranslate2](https://github.com/OpenNMT/CTranslate2).**
|
| 24 |
|
| 25 |
-
## Conversion details
|
| 26 |
|
| 27 |
-
The original model was converted on 2024-06 with the following command:
|
| 28 |
-
```
|
| 29 |
-
ct2-transformers-converter --model Path\To\Local\meta-llama\Meta-Llama-3-8B-Instruct \
|
| 30 |
-
--quantization int8_float16 --output_dir Meta-Llama-3-8B-Instruct-ct2-int8_float16
|
| 31 |
-
```
|
| 32 |
|
| 33 |
## How to use
|
| 34 |
|
|
|
|
| 22 |
|
| 23 |
**The model is quantized version of the [defog/llama-3-sqlcoder-8b](https://huggingface.co/defog/llama-3-sqlcoder-8b) with int8_float16 quantization and can be used in [CTranslate2](https://github.com/OpenNMT/CTranslate2).**
|
| 24 |
|
|
|
|
| 25 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
|
| 27 |
## How to use
|
| 28 |
|