Update README.md
Browse files
README.md
CHANGED
|
@@ -29,6 +29,7 @@ license: other
|
|
| 29 |
|
| 30 |
Here is an example of multi-modal ICL (in-context learning) with 🦦 Otter. We provide two demo images with corresponding instructions and answers, then we ask the model to generate an answer given our instruct. You may change your instruction and see how the model responds.
|
| 31 |
|
|
|
|
| 32 |
``` python
|
| 33 |
import mimetypes
|
| 34 |
import os
|
|
@@ -162,7 +163,7 @@ def get_response(image_list, prompt: str, model=None, image_processor=None, in_c
|
|
| 162 |
|
| 163 |
if __name__ == "__main__":
|
| 164 |
model = OtterForConditionalGeneration.from_pretrained(
|
| 165 |
-
"luodian/
|
| 166 |
)
|
| 167 |
model.text_tokenizer.padding_side = "left"
|
| 168 |
tokenizer = model.text_tokenizer
|
|
|
|
| 29 |
|
| 30 |
Here is an example of multi-modal ICL (in-context learning) with 🦦 Otter. We provide two demo images with corresponding instructions and answers, then we ask the model to generate an answer given our instruct. You may change your instruction and see how the model responds.
|
| 31 |
|
| 32 |
+
Please first clone [Otter](https://github.com/Luodian/Otter) to your local disk. Place following script inside the Otter folder to make sure it has the access to otter/modeling_otter.py.
|
| 33 |
``` python
|
| 34 |
import mimetypes
|
| 35 |
import os
|
|
|
|
| 163 |
|
| 164 |
if __name__ == "__main__":
|
| 165 |
model = OtterForConditionalGeneration.from_pretrained(
|
| 166 |
+
"luodian/OTTER-9B-LA-InContext", device_map="auto"
|
| 167 |
)
|
| 168 |
model.text_tokenizer.padding_side = "left"
|
| 169 |
tokenizer = model.text_tokenizer
|