File size: 1,333 Bytes
002bd9b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 |
## Gradio App
We provide a gradio demo for SCA with both "prompt mode" and "anything mode".
<table>
<tr>
<td><img src="./demo.small.jpg" alt="demo.small.1"></td>
<td><img src="./demo.small.2.jpg" alt="demo.small.2"></td>
</tr>
</table>
Gallary of anything mode:
<table>
<tr>
<td><img src="./anything-mode-00.png.jpg" alt="anything-mode-00"></td>
<td><img src="./anything-mode-03.png.jpg" alt="anything-mode-03"></td>
</tr>
<tr>
<td><img src="./anything-mode-01.png.jpg" alt="anything-mode-01"></td>
<td><img src="./anything-mode-02.png.jpg" alt="anything-mode-02"></td>
</tr>
</table>
```shell
CKPT_PATH=
python scripts/apps/sca_app.py \
+model=base_sca_multitask_v2 \
model.model_name_or_path=$CKPT_PATH \
model.lm_head_model_name_or_path=$(python scripts/tools/get_sub_model_name_from_ckpt.py $CKPT_PATH "lm")
```
We also provide an app to visualize the dataset:
```shell
python scripts/apps/dataset_viewer_app.py \
train_data='[vg-densecap-local]' \
eval_data='[vg-densecap-local]' \
+model=base_sca_multitask_v2 \
training.do_train=True \
training.do_eval=True \
# View original datasets
python scripts/apps/dataset_viewer_app.py \
train_data='[vg-densecap-local]' \
eval_data='[vg-densecap-local]' \
+model=base_sca_multitask_v2 \
training.do_train=False \
training.do_eval=False
``` |