File size: 2,874 Bytes
6aa92fc | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 | # EAST Text Detection
Scene-text detection with the EAST (Efficient and Accurate Scene Text) detector.
The model was originally distributed as a frozen TensorFlow graph
(`frozen_east_text_detection.pb`) and converted to ONNX for use with OpenCV's DNN module.
## Model Details
- **Architecture**: EAST with a ResNet-50 backbone and a feature-fusion head
- **Input**: RGB image, 320×320, raw 0–255 float, mean `(123.68, 116.78, 103.94)`, swapRB,
NCHW layout (`input_images:0`, shape `[1, 3, 320, 320]`)
- **Outputs**:
- `feature_fusion/Conv_7/Sigmoid:0` — score map, shape `[1, 1, 80, 80]`
- `feature_fusion/concat_3:0` — RBOX geometry, shape `[1, 5, 80, 80]`
- **Post-processing**: OpenCV's `TextDetectionModel_EAST` decodes the score/geometry maps
into rotated boxes (confidence threshold + rotated-NMS)
- **Framework**: ONNX (converted from the TensorFlow frozen graph via tf2onnx, opset 15)
- **Original weights**: https://github.com/argman/EAST
Both input and outputs are emitted in NCHW so OpenCV consumes them directly.
## Usage
### Python
```bash
python demo.py --model east_text_detection_2026jul.onnx --image example_outputs/input_image.png --output example_outputs/output_image.png
```
Or import directly:
```python
import cv2
model = cv2.dnn.TextDetectionModel_EAST("east_text_detection_2026jul.onnx")
# see demo.py for the full inference pipeline
```
### C++
The C++ demo runs inference with OpenCV's DNN module (default engine — no ONNX Runtime
needed). Adjust the OpenCV paths to your setup:
```bash
OCV=/path/to/opencv # OpenCV source tree
OCVBUILD=/path/to/opencv/build # OpenCV build directory (generated headers + libs)
g++ -std=c++17 demo.cpp -o demo \
-I$OCV/include \
-I$OCV/modules/core/include \
-I$OCV/modules/dnn/include \
-I$OCV/modules/imgproc/include \
-I$OCV/modules/imgcodecs/include \
-I$OCVBUILD \
-L$OCVBUILD/lib -Wl,-rpath,$OCVBUILD/lib -lopencv_dnn -lopencv_imgcodecs -lopencv_imgproc -lopencv_core
./demo --model east_text_detection_2026jul.onnx --image example_outputs/input_image.png
```
## Conversion
The ONNX model was exported from the frozen TensorFlow graph with tf2onnx (opset 15)
via [convert_to_onnx.py](./convert_to_onnx.py) — input `input_images:0`, outputs
`feature_fusion/Conv_7/Sigmoid:0` and `feature_fusion/concat_3:0`. Both the input and the
outputs are forced to NCHW (`inputs_as_nchw` / `outputs_as_nchw`) so the tensors match
OpenCV's layout; without `outputs_as_nchw` the score/geometry maps come out as NHWC and the
EAST decoder rejects them. Requires `tensorflow`, `tf2onnx`, and `onnx`.
```bash
python convert_to_onnx.py --pb ../pb/frozen_east_text_detection.pb
```
## License
See [LICENSE](./LICENSE) — the model originates from [argman/EAST](https://github.com/argman/EAST),
released under the GNU General Public License v3.0.
|