Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -24,9 +24,11 @@ CTW1500, and ICDAR2015.
|
|
| 24 |
|
| 25 |
## Models and Results
|
| 26 |
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
[oCLIP](https://github.com/bytedance/oclip)
|
|
|
|
|
|
|
| 30 |
|
| 31 |
### Total-Text
|
| 32 |
|
|
@@ -70,24 +72,6 @@ hf download HB16888/MonkeyOCRv2_det --include "*.pth" --local-dir ./model_weight
|
|
| 70 |
modelscope download --model WangXinhan/MonkeyOCRv2_det --local_dir ./model_weight
|
| 71 |
```
|
| 72 |
|
| 73 |
-
Each checkpoint is the best epoch on the test set, i.e. exactly the row
|
| 74 |
-
reported in the tables above.
|
| 75 |
-
|
| 76 |
-
| Checkpoint | Method | Dataset | Epoch | Config |
|
| 77 |
-
| -------------------------------- | -------------------- | ---------- | ----: | -------------------------------------------------------------------------------- |
|
| 78 |
-
| dbnet\_r50\_totaltext.pth | DBNet baseline | Total-Text | 580 | configs/textdet/dbnet/dbnet\_resnet50\_1200e\_totaltext\_2gpu.py |
|
| 79 |
-
| dbnet\_r50-oclip\_totaltext.pth | DBNet + oCLIP | Total-Text | 740 | configs/textdet/dbnet/dbnet\_resnet50-oclip\_1200e\_totaltext\_2gpu.py |
|
| 80 |
-
| dbnet\_mkv2vitae\_totaltext.pth | DBNet + MonkeyOCRv2 | Total-Text | 1000 | configs/textdet/dbnet/dbnet\_mkv2vitae\_1200e\_totaltext\_2gpu\_adamw\.py |
|
| 81 |
-
| psenet\_r50\_ctw1500.pth | PSENet baseline | CTW1500 | 280 | configs/textdet/psenet/psenet\_resnet50\_fpnf\_600e\_ctw1500\_2gpu.py |
|
| 82 |
-
| psenet\_r50-oclip\_ctw1500.pth | PSENet + oCLIP | CTW1500 | 280 | configs/textdet/psenet/psenet\_resnet50-oclip\_fpnf\_600e\_ctw1500\_2gpu.py |
|
| 83 |
-
| psenet\_mkv2vitae\_ctw1500.pth | PSENet + MonkeyOCRv2 | CTW1500 | 120 | configs/textdet/psenet/psenet\_mkv2vitae\_fpnf\_600e\_ctw1500\_4gpu\_adamw\.py |
|
| 84 |
-
| psenet\_r50\_icdar2015.pth | PSENet baseline | ICDAR2015 | 400 | configs/textdet/psenet/psenet\_resnet50\_fpnf\_600e\_icdar2015\_2gpu.py |
|
| 85 |
-
| psenet\_r50-oclip\_icdar2015.pth | PSENet + oCLIP | ICDAR2015 | 520 | configs/textdet/psenet/psenet\_resnet50-oclip\_fpnf\_600e\_icdar2015\_2gpu.py |
|
| 86 |
-
| psenet\_mkv2vitae\_icdar2015.pth | PSENet + MonkeyOCRv2 | ICDAR2015 | 160 | configs/textdet/psenet/psenet\_mkv2vitae\_fpnf\_600e\_icdar2015\_4gpu\_adamw\.py |
|
| 87 |
-
| dbnet\_r50\_icdar2015.pth | DBNet baseline | ICDAR2015 | 980 | configs/textdet/dbnet/dbnet\_resnet50\_1200e\_icdar2015\_2gpu.py |
|
| 88 |
-
| dbnet\_r50-oclip\_icdar2015.pth | DBNet + oCLIP | ICDAR2015 | 1100 | configs/textdet/dbnet/dbnet\_resnet50-oclip\_1200e\_icdar2015\_2gpu.py |
|
| 89 |
-
| dbnet\_mkv2vitae\_icdar2015.pth | DBNet + MonkeyOCRv2 | ICDAR2015 | 420 | configs/textdet/dbnet/dbnet\_mkv2vitae\_1200e\_icdar2015\_2gpu\_adamw\.py |
|
| 90 |
-
|
| 91 |
## Environment
|
| 92 |
|
| 93 |
The reproduced environment uses Python 3.11, PyTorch 2.9.0, CUDA 12.8,
|
|
@@ -185,7 +169,7 @@ python tools/test.py \
|
|
| 185 |
# multi GPU
|
| 186 |
bash tools/dist_test.sh \
|
| 187 |
configs/textdet/psenet/psenet_mkv2vitae_fpnf_600e_ctw1500_4gpu_adamw.py \
|
| 188 |
-
model_weight/psenet_mkv2vitae_ctw1500.pth
|
| 189 |
```
|
| 190 |
|
| 191 |
The evaluation prints `precision / recall / hmean` with the
|
|
|
|
| 24 |
|
| 25 |
## Models and Results
|
| 26 |
|
| 27 |
+
For each detector, three visual backbones are compared under identical
|
| 28 |
+
settings: the original ImageNet-pretrained encoder, the text-specific
|
| 29 |
+
[oCLIP](https://github.com/bytedance/oclip) encoder, and MonkeyOCRv2.
|
| 30 |
+
MonkeyOCRv2 consistently improves F-score across all datasets and detector
|
| 31 |
+
architectures.
|
| 32 |
|
| 33 |
### Total-Text
|
| 34 |
|
|
|
|
| 72 |
modelscope download --model WangXinhan/MonkeyOCRv2_det --local_dir ./model_weight
|
| 73 |
```
|
| 74 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 75 |
## Environment
|
| 76 |
|
| 77 |
The reproduced environment uses Python 3.11, PyTorch 2.9.0, CUDA 12.8,
|
|
|
|
| 169 |
# multi GPU
|
| 170 |
bash tools/dist_test.sh \
|
| 171 |
configs/textdet/psenet/psenet_mkv2vitae_fpnf_600e_ctw1500_4gpu_adamw.py \
|
| 172 |
+
model_weight/psenet_mkv2vitae_ctw1500.pth 4
|
| 173 |
```
|
| 174 |
|
| 175 |
The evaluation prints `precision / recall / hmean` with the
|