oddadmix commited on
Commit
b09ae1a
·
verified ·
1 Parent(s): 4382e6b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -23
README.md CHANGED
@@ -23,29 +23,33 @@ This model is a fine-tuned version of [unsloth/Qwen2-VL-2B-Instruct](unsloth/Qwe
23
  - **Languages**: Arabic
24
  - **Tasks**: OCR (Optical Character Recognition)
25
 
26
- ## Evaluation Results
27
-
28
- The fine-tuned model outperforms the base model significantly in terms of Character Error Rate (CER), Word Error Rate (WER), and BLEU score.
29
-
30
- ### Fine-Tuned Model Performance
31
- - **Word Error Rate (WER)**: `0.0675`
32
- - **Character Error Rate (CER)**: `0.0193`
33
- - **BLEU Score**:
34
- - BLEU: `0.8596`
35
- - Precision @1: `93.95%`
36
- - Precision @2: `88.55%`
37
- - Precision @3: `83.82%`
38
- - Precision @4: `79.52%`
39
-
40
- ### Base Model Performance
41
- - **Word Error Rate (WER)**: `1.3435`
42
- - **Character Error Rate (CER)**: `1.1915`
43
- - **BLEU Score**:
44
- - BLEU: `0.2007`
45
- - Precision @1: `26.85%`
46
- - Precision @2: `21.65%`
47
- - Precision @3: `18.13%`
48
- - Precision @4: `15.39%`
 
 
 
 
49
 
50
  ## Performance Comparison Charts
51
 
 
23
  - **Languages**: Arabic
24
  - **Tasks**: OCR (Optical Character Recognition)
25
 
26
+ ## Performance Evaluation
27
+
28
+ The model has been evaluated on standard OCR metrics, including Word Error Rate (WER), Character Error Rate (CER), and BLEU score.
29
+
30
+ ### Metrics
31
+
32
+ | Model | WER ↓ | CER ↓ | BLEU ↑ |
33
+ |-------|-------|-------|--------|
34
+ | Fine-Tuned Model | 0.068 | 0.019 | 0.860 |
35
+ | Base Model | 1.344 | 1.191 | 0.201 |
36
+ | EasyOCR | 0.908 | 0.617 | 0.152 |
37
+ | Tesseract OCR | 0.428 | 0.226 | 0.410 |
38
+
39
+ ### Key Results
40
+
41
+ - **WER:** 0.068 (93.2% word accuracy)
42
+ - **CER:** 0.019 (98.1% character accuracy)
43
+ - **BLEU:** 0.860
44
+
45
+ ### Performance Comparison
46
+
47
+ The Fine-Tuned Model outperforms other solutions with:
48
+ - 95% reduction in WER compared to Base Model
49
+ - 98% reduction in CER compared to Base Model
50
+ - 328% improvement in BLEU score compared to Base Model
51
+ - 84% lower WER than Tesseract OCR
52
+ - 92% lower WER than EasyOCR
53
 
54
  ## Performance Comparison Charts
55