Anonymous6598 commited on
Commit
2b79c50
·
verified ·
1 Parent(s): ed17e57

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: unsloth/Llama-3.2-1B-Instruct
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ license: llama3.2
7
+ tags:
8
+ - llama-3
9
+ - llama
10
+ - meta
11
+ - facebook
12
+ - unsloth
13
+ - transformers
14
+ - openvino
15
+ - openvino-export
16
+ pipeline_tag: text-generation
17
+ ---
18
+
19
+ This model was converted to OpenVINO from [`unsloth/Llama-3.2-1B-Instruct`](https://huggingface.co/unsloth/Llama-3.2-1B-Instruct) using [optimum-intel](https://github.com/huggingface/optimum-intel)
20
+ via the [export](https://huggingface.co/spaces/echarlaix/openvino-export) space.
21
+
22
+ First make sure you have optimum-intel installed:
23
+
24
+ ```bash
25
+ pip install optimum[openvino]
26
+ ```
27
+
28
+ To load your model you can do as follows:
29
+
30
+ ```python
31
+ from optimum.intel import OVModelForCausalLM
32
+
33
+ model_id = "Anonymous6598/Llama-3.2-1B-Instruct-openvino"
34
+ model = OVModelForCausalLM.from_pretrained(model_id)
35
+ ```