<div align="center">
<h1>
HuatuoGPT-Vision-34B
</h1>
</div>
<div align="center">
<a href="https://github.com/FreedomIntelligence/HuatuoGPT-Vision" target="_blank">GitHub</a> | <a href="https://arxiv.org/abs/2406.19280" target="_blank">Our Paper</a>
</div>
# <span id="Start">Introduction</span>
HuatuoGPT-Vision is a multimodal LLM for medical purposes, built with the [PubMedVision dataset](https://huggingface.co/datasets/FreedomIntelligence/PubMedVision). HuatuoGPT-Vision-34B is trained based on Yi-1.5-34B using the LLaVA-v1.5 architecture.
# <span id="Start">Quick Start</span>
- Get the model inference code from [Github](https://github.com/FreedomIntelligence/HuatuoGPT-Vision).
```bash
git clone https://github.com/FreedomIntelligence/HuatuoGPT-Vision.git
```
- Model inference
```python
query = 'What does the picture show?'
image_paths = ['image_path1']
from cli import HuatuoChatbot
bot = HuatuoChatbot(huatuogpt_vision_model_path)
output = bot.inference(query, image_paths)
prin…