Update README.md
Browse files
README.md
CHANGED
|
@@ -12,6 +12,26 @@ tags: [green, llmware-rag, p1, ov]
|
|
| 12 |
|
| 13 |
[**bling-tiny-llama**](https://huggingface.co/llmware/bling-tiny-llama-v0) is a fact-based question-answering model, optimized for complex business documents.
|
| 14 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
Get started right away with [OpenVino](https://github.com/openvinotoolkit/openvino)
|
| 16 |
|
| 17 |
Looking for AI PC solutions and demos, contact us at [llmware](https://www.llmware.ai)
|
|
|
|
| 12 |
|
| 13 |
[**bling-tiny-llama**](https://huggingface.co/llmware/bling-tiny-llama-v0) is a fact-based question-answering model, optimized for complex business documents.
|
| 14 |
|
| 15 |
+
Get started right away
|
| 16 |
+
|
| 17 |
+
1. Install dependencies
|
| 18 |
+
|
| 19 |
+
`pip3 install llmware`
|
| 20 |
+
`pip3 install openvino`
|
| 21 |
+
`pip3 install openvino_genai`
|
| 22 |
+
|
| 23 |
+
2. Hello World
|
| 24 |
+
|
| 25 |
+
from llmware.models import ModelCatalog
|
| 26 |
+
|
| 27 |
+
model = ModelCatalog().load_model("bling-tiny-llama-ov")
|
| 28 |
+
|
| 29 |
+
response = model.inference("The stock price is $45.\nWhat is the stock price?")
|
| 30 |
+
|
| 31 |
+
print("response: ", response)
|
| 32 |
+
|
| 33 |
+
|
| 34 |
+
|
| 35 |
Get started right away with [OpenVino](https://github.com/openvinotoolkit/openvino)
|
| 36 |
|
| 37 |
Looking for AI PC solutions and demos, contact us at [llmware](https://www.llmware.ai)
|