Update README.md
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ With its advanced reasoning capabilities and superior performance on geospatial
|
|
| 16 |
|
| 17 |
## Model Details
|
| 18 |
|
| 19 |
-
- **Model architecture**: Inspired by LISA
|
| 20 |
|
| 21 |

|
| 22 |
|
|
@@ -70,6 +70,9 @@ pip install --upgrade transformers
|
|
| 70 |
|
| 71 |
Once your installation is updated, you can use LISAT-7B for inference as follows:
|
| 72 |
|
|
|
|
|
|
|
|
|
|
| 73 |
```python
|
| 74 |
from transformers import AutoModelForImageSegmentation, AutoTokenizer
|
| 75 |
|
|
@@ -85,7 +88,6 @@ inputs = tokenizer(input_image, return_tensors="pt")
|
|
| 85 |
outputs = model.generate(**inputs)
|
| 86 |
|
| 87 |
|
| 88 |
-
|
| 89 |
## Intended Use
|
| 90 |
|
| 91 |
### Intended Use Cases
|
|
@@ -140,6 +142,22 @@ However, like any technology, **LISAT-7B** comes with inherent risks. Testing co
|
|
| 140 |
|
| 141 |
Please, use **LISAT-7B** responsibly.
|
| 142 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 143 |
|
| 144 |
|
| 145 |
|
|
|
|
| 16 |
|
| 17 |
## Model Details
|
| 18 |
|
| 19 |
+
- **Model architecture**: Inspired by LISA , LISAT integrates a multimodal large language model (LLM) with a segmentation model. Its architechture is shown below.
|
| 20 |
|
| 21 |

|
| 22 |
|
|
|
|
| 70 |
|
| 71 |
Once your installation is updated, you can use LISAT-7B for inference as follows:
|
| 72 |
|
| 73 |
+
|
| 74 |
+
This will render as a properly formatted Python code snippet in Markdown. When you view it in a Markdown-rendering environment, it will look like this:
|
| 75 |
+
|
| 76 |
```python
|
| 77 |
from transformers import AutoModelForImageSegmentation, AutoTokenizer
|
| 78 |
|
|
|
|
| 88 |
outputs = model.generate(**inputs)
|
| 89 |
|
| 90 |
|
|
|
|
| 91 |
## Intended Use
|
| 92 |
|
| 93 |
### Intended Use Cases
|
|
|
|
| 142 |
|
| 143 |
Please, use **LISAT-7B** responsibly.
|
| 144 |
|
| 145 |
+
## Citation
|
| 146 |
+
|
| 147 |
+
If you use LISAt in your research or applications, please cite our paper:
|
| 148 |
+
|
| 149 |
+
## Citation
|
| 150 |
+
|
| 151 |
+
If you use LISAt in your research or applications, please cite our paper:
|
| 152 |
+
|
| 153 |
+
```bibtex
|
| 154 |
+
@article{TBD,
|
| 155 |
+
title={LISAt: Language-Instructed Segmentation Assistant for Satellite Imagery},
|
| 156 |
+
author={Quenum, Jerome and Hsieh, Wen-Han and Wu, Tsung-Han and Gupta, Ritwik and Darrell, Trevor and Chan, David M},
|
| 157 |
+
journal={TBD},
|
| 158 |
+
year={2025},
|
| 159 |
+
url={TBD}
|
| 160 |
+
}
|
| 161 |
|
| 162 |
|
| 163 |
|