commit files to HF hub

README.md

@@ -0,0 +1,25 @@
+---
+language:
+- en
+tags:
+- openvino
+---
+
+# microsoft/phi-2
+
+This is the [microsoft/phi-2](https://huggingface.co/microsoft/phi-2) model converted to [OpenVINO](https://openvino.ai) with INT8 weights compression for accelerated inference.
+
+An example of how to do inference on this model:
+```python
+from optimum.intel import OVModelForCausalLM
+from transformers import AutoTokenizer, pipeline
+
+# model_id should be set to either a local directory or a model available on the HuggingFace hub.
+model_id = "helenai/microsoft-phi-2-ov"
+tokenizer = AutoTokenizer.from_pretrained(model_id)
+model = OVModelForCausalLM.from_pretrained(model_id)
+pipe = pipeline("text-generation", model=model, tokenizer=tokenizer)
+result = pipe("hello world")
+print(result)
+```
+