staghado commited on
Commit
c4cede1
·
verified ·
1 Parent(s): 7bf5e9d

Create .eval_results/olmocrbench.yaml

Browse files

This PR ensures your model shows up at https://huggingface.co/datasets/allenai/olmOCR-bench
Inference done through vLLM with the official prompt given in the demo space.

Files changed (1) hide show
  1. .eval_results/olmocrbench.yaml +64 -0
.eval_results/olmocrbench.yaml ADDED
@@ -0,0 +1,64 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: allenai/olmOCR-bench
3
+ task_id: overall
4
+ value: 70.2
5
+ notes: "Excluding Headers & Footers category"
6
+ source:
7
+ url: https://huggingface.co/FireRedTeam/FireRed-OCR
8
+ user: staghado
9
+ - dataset:
10
+ id: allenai/olmOCR-bench
11
+ task_id: arxiv_math
12
+ value: 77.7
13
+ source:
14
+ url: https://huggingface.co/FireRedTeam/FireRed-OCR
15
+ user: staghado
16
+ - dataset:
17
+ id: allenai/olmOCR-bench
18
+ task_id: old_scans_math
19
+ value: 58.3
20
+ source:
21
+ url: https://huggingface.co/FireRedTeam/FireRed-OCR
22
+ user: staghado
23
+ - dataset:
24
+ id: allenai/olmOCR-bench
25
+ task_id: table_tests
26
+ value: 80.4
27
+ source:
28
+ url: https://huggingface.co/FireRedTeam/FireRed-OCR
29
+ user: staghado
30
+ - dataset:
31
+ id: allenai/olmOCR-bench
32
+ task_id: old_scans
33
+ value: 31.6
34
+ source:
35
+ url: https://huggingface.co/FireRedTeam/FireRed-OCR
36
+ user: staghado
37
+ - dataset:
38
+ id: allenai/olmOCR-bench
39
+ task_id: multi_column
40
+ value: 68.1
41
+ source:
42
+ url: https://huggingface.co/FireRedTeam/FireRed-OCR
43
+ user: staghado
44
+ - dataset:
45
+ id: allenai/olmOCR-bench
46
+ task_id: long_tiny_text
47
+ value: 78.1
48
+ source:
49
+ url: https://huggingface.co/FireRedTeam/FireRed-OCR
50
+ user: staghado
51
+ - dataset:
52
+ id: allenai/olmOCR-bench
53
+ task_id: headers_footers
54
+ value: 29.2
55
+ source:
56
+ url: https://huggingface.co/FireRedTeam/FireRed-OCR
57
+ user: staghado
58
+ - dataset:
59
+ id: allenai/olmOCR-bench
60
+ task_id: baseline
61
+ value: 97.3
62
+ source:
63
+ url: https://huggingface.co/FireRedTeam/FireRed-OCR
64
+ user: staghado