Update README.md

README.md

@@ -218,6 +218,12 @@ top_p=0.6,
 repetition_penalty: 1.2
 ```
 
+## Hosting
+```
+vllm serve scb10x/typhoon-ocr-7b --max-model-len 32000 # OpenAI Compatible at http://localhost:8000
+# then you can supply base_url in to ocr_document('image.jpg', base_url='http://localhost:8000/v1')
+```
+
 ## **Intended Uses & Limitations**
 
 This is a task-specific model intended to be used only with the provided prompts. It does not include any guardrails or VQA capability. Due to the nature of large language models (LLMs), a certain level of hallucination may occur. We recommend that developers carefully assess these risks in the context of their specific use case.