Upload folder using huggingface_hub
Browse files
CodeLlama-7b-Instruct-hf/README.md
ADDED
|
@@ -0,0 +1,18 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# CodeLlama-7b-Instruct-hf
|
| 2 |
+
|
| 3 |
+
## GenAI WebGPU Model
|
| 4 |
+
|
| 5 |
+
Generated using `onnxruntime_genai.models.builder`
|
| 6 |
+
|
| 7 |
+
- **onnxruntime-genai commit**: `41c4ce18fec1240c2f848725e31fbe8854010188`
|
| 8 |
+
- **transformers version**: `4.57.0`
|
| 9 |
+
- **Precision**: int4
|
| 10 |
+
- **Execution Provider**: webgpu
|
| 11 |
+
|
| 12 |
+
```
|
| 13 |
+
python -m onnxruntime_genai.models.builder -p int4 -e webgpu -m codellama/CodeLlama-7b-Instruct-hf -o E:\ai-models\CodeLlama-7b-Instruct-hf\onnx-webgpu\ --extra_options int4_algo_config=rtn_last int4_is_symmetric=true prune_lm_head=true enable_webgpu_graph=true
|
| 14 |
+
```
|
| 15 |
+
|
| 16 |
+
## GGUF Model
|
| 17 |
+
|
| 18 |
+
Downloaded from: [TheBloke/CodeLlama-7B-Instruct-GGUF](https://huggingface.co/TheBloke/CodeLlama-7B-Instruct-GGUF)
|