ErazerControl commited on
Commit
aa1c19a
·
verified ·
1 Parent(s): 7137c89

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. CodeLlama-7b-Instruct-hf/README.md +18 -0
CodeLlama-7b-Instruct-hf/README.md ADDED
@@ -0,0 +1,18 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # CodeLlama-7b-Instruct-hf
2
+
3
+ ## GenAI WebGPU Model
4
+
5
+ Generated using `onnxruntime_genai.models.builder`
6
+
7
+ - **onnxruntime-genai commit**: `41c4ce18fec1240c2f848725e31fbe8854010188`
8
+ - **transformers version**: `4.57.0`
9
+ - **Precision**: int4
10
+ - **Execution Provider**: webgpu
11
+
12
+ ```
13
+ python -m onnxruntime_genai.models.builder -p int4 -e webgpu -m codellama/CodeLlama-7b-Instruct-hf -o E:\ai-models\CodeLlama-7b-Instruct-hf\onnx-webgpu\ --extra_options int4_algo_config=rtn_last int4_is_symmetric=true prune_lm_head=true enable_webgpu_graph=true
14
+ ```
15
+
16
+ ## GGUF Model
17
+
18
+ Downloaded from: [TheBloke/CodeLlama-7B-Instruct-GGUF](https://huggingface.co/TheBloke/CodeLlama-7B-Instruct-GGUF)