AutomatosX commited on
Commit
6536f3b
·
verified ·
1 Parent(s): e544b90

Publish owner-selected H5.1 as v1.5 with qualified CUDA profile and preserved tradeoffs

Browse files
LICENSE ADDED
@@ -0,0 +1,202 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+
2
+ Apache License
3
+ Version 2.0, January 2004
4
+ http://www.apache.org/licenses/
5
+
6
+ TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
7
+
8
+ 1. Definitions.
9
+
10
+ "License" shall mean the terms and conditions for use, reproduction,
11
+ and distribution as defined by Sections 1 through 9 of this document.
12
+
13
+ "Licensor" shall mean the copyright owner or entity authorized by
14
+ the copyright owner that is granting the License.
15
+
16
+ "Legal Entity" shall mean the union of the acting entity and all
17
+ other entities that control, are controlled by, or are under common
18
+ control with that entity. For the purposes of this definition,
19
+ "control" means (i) the power, direct or indirect, to cause the
20
+ direction or management of such entity, whether by contract or
21
+ otherwise, or (ii) ownership of fifty percent (50%) or more of the
22
+ outstanding shares, or (iii) beneficial ownership of such entity.
23
+
24
+ "You" (or "Your") shall mean an individual or Legal Entity
25
+ exercising permissions granted by this License.
26
+
27
+ "Source" form shall mean the preferred form for making modifications,
28
+ including but not limited to software source code, documentation
29
+ source, and configuration files.
30
+
31
+ "Object" form shall mean any form resulting from mechanical
32
+ transformation or translation of a Source form, including but
33
+ not limited to compiled object code, generated documentation,
34
+ and conversions to other media types.
35
+
36
+ "Work" shall mean the work of authorship, whether in Source or
37
+ Object form, made available under the License, as indicated by a
38
+ copyright notice that is included in or attached to the work
39
+ (an example is provided in the Appendix below).
40
+
41
+ "Derivative Works" shall mean any work, whether in Source or Object
42
+ form, that is based on (or derived from) the Work and for which the
43
+ editorial revisions, annotations, elaborations, or other modifications
44
+ represent, as a whole, an original work of authorship. For the purposes
45
+ of this License, Derivative Works shall not include works that remain
46
+ separable from, or merely link (or bind by name) to the interfaces of,
47
+ the Work and Derivative Works thereof.
48
+
49
+ "Contribution" shall mean any work of authorship, including
50
+ the original version of the Work and any modifications or additions
51
+ to that Work or Derivative Works thereof, that is intentionally
52
+ submitted to Licensor for inclusion in the Work by the copyright owner
53
+ or by an individual or Legal Entity authorized to submit on behalf of
54
+ the copyright owner. For the purposes of this definition, "submitted"
55
+ means any form of electronic, verbal, or written communication sent
56
+ to the Licensor or its representatives, including but not limited to
57
+ communication on electronic mailing lists, source code control systems,
58
+ and issue tracking systems that are managed by, or on behalf of, the
59
+ Licensor for the purpose of discussing and improving the Work, but
60
+ excluding communication that is conspicuously marked or otherwise
61
+ designated in writing by the copyright owner as "Not a Contribution."
62
+
63
+ "Contributor" shall mean Licensor and any individual or Legal Entity
64
+ on behalf of whom a Contribution has been received by Licensor and
65
+ subsequently incorporated within the Work.
66
+
67
+ 2. Grant of Copyright License. Subject to the terms and conditions of
68
+ this License, each Contributor hereby grants to You a perpetual,
69
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
70
+ copyright license to reproduce, prepare Derivative Works of,
71
+ publicly display, publicly perform, sublicense, and distribute the
72
+ Work and such Derivative Works in Source or Object form.
73
+
74
+ 3. Grant of Patent License. Subject to the terms and conditions of
75
+ this License, each Contributor hereby grants to You a perpetual,
76
+ worldwide, non-exclusive, no-charge, royalty-free, irrevocable
77
+ (except as stated in this section) patent license to make, have made,
78
+ use, offer to sell, sell, import, and otherwise transfer the Work,
79
+ where such license applies only to those patent claims licensable
80
+ by such Contributor that are necessarily infringed by their
81
+ Contribution(s) alone or by combination of their Contribution(s)
82
+ with the Work to which such Contribution(s) was submitted. If You
83
+ institute patent litigation against any entity (including a
84
+ cross-claim or counterclaim in a lawsuit) alleging that the Work
85
+ or a Contribution incorporated within the Work constitutes direct
86
+ or contributory patent infringement, then any patent licenses
87
+ granted to You under this License for that Work shall terminate
88
+ as of the date such litigation is filed.
89
+
90
+ 4. Redistribution. You may reproduce and distribute copies of the
91
+ Work or Derivative Works thereof in any medium, with or without
92
+ modifications, and in Source or Object form, provided that You
93
+ meet the following conditions:
94
+
95
+ (a) You must give any other recipients of the Work or
96
+ Derivative Works a copy of this License; and
97
+
98
+ (b) You must cause any modified files to carry prominent notices
99
+ stating that You changed the files; and
100
+
101
+ (c) You must retain, in the Source form of any Derivative Works
102
+ that You distribute, all copyright, patent, trademark, and
103
+ attribution notices from the Source form of the Work,
104
+ excluding those notices that do not pertain to any part of
105
+ the Derivative Works; and
106
+
107
+ (d) If the Work includes a "NOTICE" text file as part of its
108
+ distribution, then any Derivative Works that You distribute must
109
+ include a readable copy of the attribution notices contained
110
+ within such NOTICE file, excluding those notices that do not
111
+ pertain to any part of the Derivative Works, in at least one
112
+ of the following places: within a NOTICE text file distributed
113
+ as part of the Derivative Works; within the Source form or
114
+ documentation, if provided along with the Derivative Works; or,
115
+ within a display generated by the Derivative Works, if and
116
+ wherever such third-party notices normally appear. The contents
117
+ of the NOTICE file are for informational purposes only and
118
+ do not modify the License. You may add Your own attribution
119
+ notices within Derivative Works that You distribute, alongside
120
+ or as an addendum to the NOTICE text from the Work, provided
121
+ that such additional attribution notices cannot be construed
122
+ as modifying the License.
123
+
124
+ You may add Your own copyright statement to Your modifications and
125
+ may provide additional or different license terms and conditions
126
+ for use, reproduction, or distribution of Your modifications, or
127
+ for any such Derivative Works as a whole, provided Your use,
128
+ reproduction, and distribution of the Work otherwise complies with
129
+ the conditions stated in this License.
130
+
131
+ 5. Submission of Contributions. Unless You explicitly state otherwise,
132
+ any Contribution intentionally submitted for inclusion in the Work
133
+ by You to the Licensor shall be under the terms and conditions of
134
+ this License, without any additional terms or conditions.
135
+ Notwithstanding the above, nothing herein shall supersede or modify
136
+ the terms of any separate license agreement you may have executed
137
+ with Licensor regarding such Contributions.
138
+
139
+ 6. Trademarks. This License does not grant permission to use the trade
140
+ names, trademarks, service marks, or product names of the Licensor,
141
+ except as required for reasonable and customary use in describing the
142
+ origin of the Work and reproducing the content of the NOTICE file.
143
+
144
+ 7. Disclaimer of Warranty. Unless required by applicable law or
145
+ agreed to in writing, Licensor provides the Work (and each
146
+ Contributor provides its Contributions) on an "AS IS" BASIS,
147
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
148
+ implied, including, without limitation, any warranties or conditions
149
+ of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
150
+ PARTICULAR PURPOSE. You are solely responsible for determining the
151
+ appropriateness of using or redistributing the Work and assume any
152
+ risks associated with Your exercise of permissions under this License.
153
+
154
+ 8. Limitation of Liability. In no event and under no legal theory,
155
+ whether in tort (including negligence), contract, or otherwise,
156
+ unless required by applicable law (such as deliberate and grossly
157
+ negligent acts) or agreed to in writing, shall any Contributor be
158
+ liable to You for damages, including any direct, indirect, special,
159
+ incidental, or consequential damages of any character arising as a
160
+ result of this License or out of the use or inability to use the
161
+ Work (including but not limited to damages for loss of goodwill,
162
+ work stoppage, computer failure or malfunction, or any and all
163
+ other commercial damages or losses), even if such Contributor
164
+ has been advised of the possibility of such damages.
165
+
166
+ 9. Accepting Warranty or Additional Liability. While redistributing
167
+ the Work or Derivative Works thereof, You may choose to offer,
168
+ and charge a fee for, acceptance of support, warranty, indemnity,
169
+ or other liability obligations and/or rights consistent with this
170
+ License. However, in accepting such obligations, You may act only
171
+ on Your own behalf and on Your sole responsibility, not on behalf
172
+ of any other Contributor, and only if You agree to indemnify,
173
+ defend, and hold each Contributor harmless for any liability
174
+ incurred by, or claims asserted against, such Contributor by reason
175
+ of your accepting any such warranty or additional liability.
176
+
177
+ END OF TERMS AND CONDITIONS
178
+
179
+ APPENDIX: How to apply the Apache License to your work.
180
+
181
+ To apply the Apache License to your work, attach the following
182
+ boilerplate notice, with the fields enclosed by brackets "[]"
183
+ replaced with your own identifying information. (Don't include
184
+ the brackets!) The text should be enclosed in the appropriate
185
+ comment syntax for the file format. We also recommend that a
186
+ file or class name and description of purpose be included on the
187
+ same "printed page" as the copyright notice for easier
188
+ identification within third-party archives.
189
+
190
+ Copyright [yyyy] [name of copyright owner]
191
+
192
+ Licensed under the Apache License, Version 2.0 (the "License");
193
+ you may not use this file except in compliance with the License.
194
+ You may obtain a copy of the License at
195
+
196
+ http://www.apache.org/licenses/LICENSE-2.0
197
+
198
+ Unless required by applicable law or agreed to in writing, software
199
+ distributed under the License is distributed on an "AS IS" BASIS,
200
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
201
+ See the License for the specific language governing permissions and
202
+ limitations under the License.
NOTICE ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ AX-DocLayout-M v1.5 (H5.1), owner-selected release, 2026.
2
+ Derived from docling-project/docling-layout-heron revision
3
+ 8f39ad3c0b4c58e9c2d2c84a38465abf757272d8 under Apache-2.0.
4
+ Changes: H1/H5 finance tuning, paired H5.1 Title sampling and AX PDF SDK binding.
5
+ No training documents or rendered pages are included.
README.md ADDED
@@ -0,0 +1,98 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ pipeline_tag: object-detection
5
+ base_model: docling-project/docling-layout-heron
6
+ base_model_relation: finetune
7
+ tags:
8
+ - document-layout-analysis
9
+ - finance
10
+ - rtdetr-v2
11
+ - cuda
12
+ - tf32
13
+ ---
14
+
15
+ # AX-DocLayout-M v1.5 - H5.1 CUDA / cuDNN TF32
16
+
17
+ This is the owner-selected **H51-title final-1024 EMA** model. It continues
18
+ H5 finance fine-tuning with a paired Title-sampling study. It is a separate
19
+ Heron-derived model identity, not D5/D6/H7, not the public eleven-class v1.0
20
+ model, and not an ax-doclayout Python package release. The original v1.4 weights
21
+ and public v1.0 loader pin remain unchanged.
22
+
23
+ Decoded RGB page raster in; layout boxes out. Native classes0-16 map to AX PDF
24
+ SDK IDs1-17 via `sdk-taxonomy.json` (ax-document-unified-25/1). SDK18-25 are
25
+ unsupported. This model does not open PDFs, perform OCR or infer reading order.
26
+ Accuracy retention of extra SDK classes12-17 is unmeasured.
27
+
28
+ ## Exact artifact and qualified runtime
29
+
30
+ - FP32 safetensors SHA256:
31
+ `d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e`.
32
+ - H51-title final1024 checkpoint SHA256:
33
+ `44b75b2ca14d7d4756ca51d402d470d069f17ee99145717e1994549b32ef87d2`.
34
+ - Upstream: docling-project/docling-layout-heron at immutable revision
35
+ `8f39ad3c0b4c58e9c2d2c84a38465abf757272d8`, Apache-2.0.
36
+ - Native **640x640 direct resize**, original hash-pinned image processor.
37
+ Do not substitute D5's1024letterbox or H7's1696letterbox preprocessing.
38
+ - Tested CUDA: PyTorch2.12.1+cu129, CUDA12.9, Transformers4.53.3,
39
+ RTX PRO6000Blackwell. FP32 storage/activations, no autocast or quantization.
40
+ - **cuDNN TF32 allowed; CUDA matmul TF32 disabled.** The suffix means cuDNN
41
+ permission, not all-matmul TF32. No ONNX or TensorRT artifact is included.
42
+ - The exact selected checkpoint has existing three-panel CUDA evidence and
43
+ exact exported-tensor reload evidence. The packaged example is CPU-qualified;
44
+ it was not freshly rerun on CUDA for this publication. No GPU was restarted.
45
+
46
+ ## Measured results and accepted tradeoffs
47
+
48
+ All AP values are percentages on previously exposed development panels.
49
+
50
+ | Panel | H5 | Matched control | Selected H5.1 / v1.5 |
51
+ |---|---:|---:|---:|
52
+ | General AP (6489pages) |70.6572|71.1214|71.5327|
53
+ | Financial AP (1745pages) |61.5113|61.5445|61.7331|
54
+ | FinTab AP (256pages) |91.5856|91.7371|91.5774|
55
+ | General Title AP |35.9637|37.0977|38.7453|
56
+ | General Title precision at0.30/IoU0.50 |38.9333|39.5833|36.2069|
57
+ | General Title recall at0.30/IoU0.50 |48.8294|50.8361|56.1873|
58
+ | FinTab AP90 |89.0473|89.0155|88.4481|
59
+
60
+ Title AP treatment-control improves1.6476pp, with a paired family-bootstrap95%
61
+ interval[0.4851,2.8212]. Compared with H5 at the fixed threshold,22additional
62
+ true Titles accompany67additional false Titles. **The frozen numerical screen
63
+ failed**, including the2pp Title AP target, Title precision retention and table
64
+ AP90 retention. The owner accepted these tradeoffs and explicitly selected
65
+ publication; the original screen has not been reclassified as passed.
66
+
67
+ Financial is a subset of General, not independent HKEX evidence. Family
68
+ independence, independent final-test quality, second-seed reproducibility and
69
+ extra-class accuracy are not established. This is not a claim of overall
70
+ superiority to D5, D6 or H7; their differently defined panels cannot be ranked
71
+ by subtracting historical scores. See evaluation.json and the frozen screen.
72
+
73
+ ## Installation and inference
74
+
75
+ Use Python3.12/3.13. Install CUDA PyTorch separately for the recorded runtime:
76
+
77
+ ```bash
78
+ python -m pip install torch==2.12.1 --index-url https://download.pytorch.org/whl/cu129
79
+ python -m pip install -r requirements.txt
80
+ ```
81
+
82
+ Download this private repository with an authorized Hugging Face account. Pin
83
+ the immutable commit from the release receipt, or resolve tag `v1.5` to that
84
+ commit and use `hf download --revision <COMMIT>`. The example fails closed on
85
+ core hash or runtime mismatches and never falls back silently from CUDA.
86
+
87
+ ```bash
88
+ python predict_image.py --model-dir . --image page.png --output layout.json --device cuda
89
+ ```
90
+
91
+ Use `--device cpu` explicitly for CPU. Boxes use original raster pixel xyxy
92
+ coordinates and SDK class IDs1-17. The default score threshold is0.30; it is an
93
+ operating point, not COCO AP/AR100. Keep all17classes when interpreting output.
94
+ Do not load this artifact through the eleven-class v1.0 receipt-pinned loader.
95
+
96
+ The bundle contains inference files, aggregate numeric evidence, attribution
97
+ and hash receipts only. No training documents, pixels, per-page predictions,
98
+ optimizer states, credentials or private training implementation are included.
bundle-manifest.json ADDED
@@ -0,0 +1,85 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "files": {
3
+ "LICENSE": {
4
+ "bytes": 11358,
5
+ "sha256": "cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30"
6
+ },
7
+ "NOTICE": {
8
+ "bytes": 312,
9
+ "sha256": "11c1414028d206ad3cae70df2dd81520cacb2d660719f9fa4cc6394ac3240d2c"
10
+ },
11
+ "README.md": {
12
+ "bytes": 4612,
13
+ "sha256": "7d57f607834ab445897e23ad433142869925ef7b74cfafa44beff4322f480137"
14
+ },
15
+ "config.json": {
16
+ "bytes": 3263,
17
+ "sha256": "7691e69a4e4cb70416c2e12bbefea3a90671790226b2c0d22ede944c48e11f05"
18
+ },
19
+ "cpu-parity.json": {
20
+ "bytes": 511,
21
+ "sha256": "92161306a7b4e3280854b4ed9f8dbd72700d54d6b738ae6b22ab88f8ee5d3a4a"
22
+ },
23
+ "evaluation-and-pr.json": {
24
+ "bytes": 88929,
25
+ "sha256": "7cfb7cd68b6fe49f63dff9a11d02b402ca6c5f1c32cb6f0c77ff10d72da65a4b"
26
+ },
27
+ "evaluation.json": {
28
+ "bytes": 8017,
29
+ "sha256": "df77f3900bf8b291460faf5df114566d3f18c349c38fa2aa0240131c33f59459"
30
+ },
31
+ "export-receipt.json": {
32
+ "bytes": 2574,
33
+ "sha256": "0b2ea9846eaf8b9b425a6501f3aaddbcb75ea12d10c00c8eb258eb7302d6a147"
34
+ },
35
+ "frozen-numerical-screen.json": {
36
+ "bytes": 4273,
37
+ "sha256": "5eeeb75f4b8f3dd026b5110a850a04d71c8ee38a34f83b53e4c3e23b2f70adff"
38
+ },
39
+ "model-selection.json": {
40
+ "bytes": 1209,
41
+ "sha256": "9cd564d6216a49be90305e839cd1acfe4b8027708c791621fc27841dae670b32"
42
+ },
43
+ "model.safetensors": {
44
+ "bytes": 171658996,
45
+ "sha256": "d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e"
46
+ },
47
+ "original-cpu-parity.json": {
48
+ "bytes": 523,
49
+ "sha256": "28f54335f516b00487fd153140858b0987875094dd514167eedda9b2940c2701"
50
+ },
51
+ "predict_image.py": {
52
+ "bytes": 6689,
53
+ "sha256": "afe45b076c2b2688e1b58307a923c5c001333a8440dd303cf19a2e1cf21b929b"
54
+ },
55
+ "preprocessor_config.json": {
56
+ "bytes": 444,
57
+ "sha256": "cd38cd59999e7a95d68e487fbe5132df3d4e5c32a0836add57e6126ba0c4eaf1"
58
+ },
59
+ "qualification.json": {
60
+ "bytes": 866,
61
+ "sha256": "a7cc2d973f5219ce7d7e3b14eea03f4635736287e84f9d5fe8a6957fd602d981"
62
+ },
63
+ "requirements.txt": {
64
+ "bytes": 219,
65
+ "sha256": "e1d9aeadc9cc880b1ea903c344861f2e4cac2222000ff8831eba49f24d21aebd"
66
+ },
67
+ "retention-drift.json": {
68
+ "bytes": 3774,
69
+ "sha256": "9a8f9bea949f1fc53cf9f87152dc51e57a3ca62958aa1b8c466a07170ae84afd"
70
+ },
71
+ "runtime-profile.json": {
72
+ "bytes": 807,
73
+ "sha256": "ddd4df5814899ce1ea7920d5b1f3827eeae7f5d8b589e4256ca3aa1033a37c41"
74
+ },
75
+ "sdk-taxonomy.json": {
76
+ "bytes": 3206,
77
+ "sha256": "81e7908ee7c8bbb6e00905a98ed43c988128faa38c0b1d55d20948f78e40e351"
78
+ }
79
+ },
80
+ "model_id": "AutomatosX/AXDocLayout-M-v1.5-CUDA-TF32",
81
+ "model_version": "1.5",
82
+ "schema": "ax-doclayout.h51-v15-bundle/1",
83
+ "taxonomy": "ax-document-unified-25/1",
84
+ "weights_sha256": "d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e"
85
+ }
config.json ADDED
@@ -0,0 +1,155 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "activation_dropout": 0.0,
3
+ "activation_function": "silu",
4
+ "anchor_image_size": null,
5
+ "architectures": [
6
+ "RTDetrV2ForObjectDetection"
7
+ ],
8
+ "attention_dropout": 0.0,
9
+ "auxiliary_loss": true,
10
+ "backbone": null,
11
+ "backbone_config": {
12
+ "depths": [
13
+ 3,
14
+ 4,
15
+ 6,
16
+ 3
17
+ ],
18
+ "downsample_in_bottleneck": false,
19
+ "downsample_in_first_stage": false,
20
+ "embedding_size": 64,
21
+ "hidden_act": "relu",
22
+ "hidden_sizes": [
23
+ 256,
24
+ 512,
25
+ 1024,
26
+ 2048
27
+ ],
28
+ "layer_type": "bottleneck",
29
+ "model_type": "rt_detr_resnet",
30
+ "num_channels": 3,
31
+ "out_features": [
32
+ "stage2",
33
+ "stage3",
34
+ "stage4"
35
+ ],
36
+ "out_indices": [
37
+ 2,
38
+ 3,
39
+ 4
40
+ ],
41
+ "stage_names": [
42
+ "stem",
43
+ "stage1",
44
+ "stage2",
45
+ "stage3",
46
+ "stage4"
47
+ ]
48
+ },
49
+ "backbone_kwargs": null,
50
+ "batch_norm_eps": 1e-05,
51
+ "box_noise_scale": 1.0,
52
+ "d_model": 256,
53
+ "decoder_activation_function": "relu",
54
+ "decoder_attention_heads": 8,
55
+ "decoder_ffn_dim": 1024,
56
+ "decoder_in_channels": [
57
+ 256,
58
+ 256,
59
+ 256
60
+ ],
61
+ "decoder_layers": 6,
62
+ "decoder_method": "default",
63
+ "decoder_n_levels": 3,
64
+ "decoder_n_points": 4,
65
+ "decoder_offset_scale": 0.5,
66
+ "dropout": 0.0,
67
+ "encode_proj_layers": [
68
+ 2
69
+ ],
70
+ "encoder_activation_function": "gelu",
71
+ "encoder_attention_heads": 8,
72
+ "encoder_ffn_dim": 1024,
73
+ "encoder_hidden_dim": 256,
74
+ "encoder_in_channels": [
75
+ 512,
76
+ 1024,
77
+ 2048
78
+ ],
79
+ "encoder_layers": 1,
80
+ "eos_coefficient": 0.0001,
81
+ "eval_size": null,
82
+ "feat_strides": [
83
+ 8,
84
+ 16,
85
+ 32
86
+ ],
87
+ "focal_loss_alpha": 0.75,
88
+ "focal_loss_gamma": 2.0,
89
+ "freeze_backbone_batch_norms": true,
90
+ "hidden_expansion": 1.0,
91
+ "id2label": {
92
+ "0": "caption",
93
+ "1": "footnote",
94
+ "2": "formula",
95
+ "3": "list_item",
96
+ "4": "page_footer",
97
+ "5": "page_header",
98
+ "6": "picture",
99
+ "7": "section_header",
100
+ "8": "table",
101
+ "9": "text",
102
+ "10": "title",
103
+ "11": "document_index",
104
+ "12": "code",
105
+ "13": "checkbox_selected",
106
+ "14": "checkbox_unselected",
107
+ "15": "form",
108
+ "16": "key_value_region"
109
+ },
110
+ "initializer_bias_prior_prob": null,
111
+ "initializer_range": 0.01,
112
+ "is_encoder_decoder": true,
113
+ "label2id": {
114
+ "caption": 0,
115
+ "checkbox_selected": 13,
116
+ "checkbox_unselected": 14,
117
+ "code": 12,
118
+ "document_index": 11,
119
+ "footnote": 1,
120
+ "form": 15,
121
+ "formula": 2,
122
+ "key_value_region": 16,
123
+ "list_item": 3,
124
+ "page_footer": 4,
125
+ "page_header": 5,
126
+ "picture": 6,
127
+ "section_header": 7,
128
+ "table": 8,
129
+ "text": 9,
130
+ "title": 10
131
+ },
132
+ "label_noise_ratio": 0.5,
133
+ "layer_norm_eps": 1e-05,
134
+ "learn_initial_query": false,
135
+ "matcher_alpha": 0.25,
136
+ "matcher_bbox_cost": 5.0,
137
+ "matcher_class_cost": 2.0,
138
+ "matcher_gamma": 2.0,
139
+ "matcher_giou_cost": 2.0,
140
+ "model_type": "rt_detr_v2",
141
+ "normalize_before": false,
142
+ "num_denoising": 100,
143
+ "num_feature_levels": 3,
144
+ "num_queries": 300,
145
+ "positional_encoding_temperature": 10000,
146
+ "torch_dtype": "float32",
147
+ "transformers_version": "4.53.3",
148
+ "use_focal_loss": true,
149
+ "use_pretrained_backbone": false,
150
+ "use_timm_backbone": false,
151
+ "weight_loss_bbox": 5.0,
152
+ "weight_loss_giou": 2.0,
153
+ "weight_loss_vfl": 1.0,
154
+ "with_box_refine": true
155
+ }
cpu-parity.json ADDED
@@ -0,0 +1,13 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "schema": "ax-doclayout.h51-v15-cpu-parity/1",
3
+ "pages": 150,
4
+ "raw_detections": 45000,
5
+ "boxes_at_030": 2405,
6
+ "all_predictions_exact": true,
7
+ "weights_sha256": "d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e",
8
+ "example_sha256": "afe45b076c2b2688e1b58307a923c5c001333a8440dd303cf19a2e1cf21b929b",
9
+ "review_manifest_sha256": "8083a57308277239d5e5de7acd7a0fec4635bc23c1b3238bb2fd47d35b1b2e72",
10
+ "device": "cpu",
11
+ "new_example_cuda_rerun": false,
12
+ "seconds": 39.956092542008264
13
+ }
evaluation-and-pr.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"analysis_source_sha256":"e12994293accd801349a9ce4276c4a3c74f35a26c82b00777ead1166055c7379","arms":{"H5":{"counts":{"fn":153,"fp":229,"iou":0.5,"precision":38.93333333333333,"recall":48.82943143812709,"threshold":0.3,"tp":146},"model":{"completed_updates":1024,"sha256":"4f740539617804699a21c6d456da190598ab1022e4128ad1b5dd45ecc54b987a","stage":"H5"},"panels":{"fin_val":{"ap":91.58560936970301,"ap50":96.42307172412028,"ap70":95.68967016952253,"ap90":89.04728335091869,"ar100":97.18354430379745,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":256,"per_class_ap":{"9":91.58560936970301},"taxonomy":"ax-document-unified-25/1"},"financial_val":{"ap":61.51128145000217,"ap50":74.86946506958374,"ap70":68.45692502635225,"ap90":43.322561206462275,"ar100":83.24266432330124,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":1745,"per_class_ap":{"1":50.27375835762371,"10":86.8442236905189,"11":21.853779071996104,"2":21.565227712119672,"3":-1.0,"4":86.21879623969116,"5":63.222417086128445,"6":48.35856172317618,"7":81.51771563437424,"8":65.42208145342498,"9":89.8362535309683},"taxonomy":"ax-document-unified-25/1"},"gold_val":{"ap":70.65715440191167,"ap50":88.40568243846039,"ap70":78.13845865429131,"ap90":50.450114112981545,"ar100":82.83261306670309,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":6489,"per_class_ap":{"1":86.97437605372829,"10":84.58897292266664,"11":35.963737455625406,"2":70.84972376935531,"3":66.0621205795928,"4":86.0096104111741,"5":53.05098211411177,"6":56.16971374829491,"7":86.3866260466923,"8":67.48086426451377,"9":83.69197105527309},"taxonomy":"ax-document-unified-25/1"}},"pr":{"iou_thresholds":[0.5,0.55,0.6,0.65,0.7,0.75,0.8,0.85,0.8999999999999999,0.95],"precision":[[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9411764705882353,0.92,0.92,0.891566265060241,0.8823529411764706,0.8387096774193549,0.8316831683168316,0.8316831683168316,0.7565217391304347,0.728,0.7099236641221374,0.6808510638297872,0.6753246753246753,0.6753246753246753,0.6729559748427673,0.6625766871165644,0.6453488372093024,0.6195652173913043,0.612565445026178,0.5853658536585366,0.5535714285714286,0.5407725321888412,0.5394190871369294,0.5076923076923077,0.4440789473684211,0.42058823529411765,0.42058823529411765,0.39669421487603307,0.3868421052631579,0.36829268292682926,0.3617021276595745,0.35135135135135137,0.3419354838709677,0.31650485436893205,0.31203007518796994,0.30434782608695654,0.2888146911519199,0.2764612954186414,0.26766917293233083,0.24262734584450402,0.23282442748091603,0.2222222222222222,0.21331828442437922,0.20824295010845986,0.20020429009193055,0.1896551724137931,0.17387543252595156,0.1695616211745244,0.15436241610738255,0.1423728813559322,0.1342155009451796,0.12342857142857143,0.11225012813941568,0.10146252285191956,0.08724311748739821,0.06859205776173286,0.02591719959609559,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9375,0.9264705882352942,0.9041095890410958,0.8734177215189873,0.8674698795180723,0.8426966292134831,0.7920792079207921,0.7788461538461539,0.711864406779661,0.6641221374045801,0.6382978723404256,0.6339869281045751,0.6339869281045751,0.6289308176100629,0.6094674556213018,0.5769230769230769,0.5706806282722513,0.5414634146341464,0.5089285714285714,0.4978902953586498,0.46153846153846156,0.40460526315789475,0.3805309734513274,0.3805309734513274,0.3584905660377358,0.35233160621761656,0.33658536585365856,0.32867132867132864,0.32432432432432434,0.32166301969365424,0.30864197530864196,0.2925430210325048,0.28888888888888886,0.2671118530884808,0.2559241706161137,0.2511278195488722,0.22788203753351208,0.2223667100130039,0.2078853046594982,0.19977426636568849,0.19522776572668113,0.18794688457609807,0.1781609195402299,0.16349480968858132,0.15963606286186932,0.14541387024608501,0.1342372881355932,0.1266540642722117,0.11714285714285715,0.1075883575883576,0.10120481927710843,0.08349666797334379,0.0789762340036563,0.06098579782790309,0.024907438572871088,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9375,0.9264705882352942,0.9041095890410958,0.8734177215189873,0.8674698795180723,0.8426966292134831,0.7920792079207921,0.7788461538461539,0.711864406779661,0.6641221374045801,0.6382978723404256,0.6339869281045751,0.6339869281045751,0.6289308176100629,0.6094674556213018,0.5769230769230769,0.5706806282722513,0.5414634146341464,0.5089285714285714,0.4978902953586498,0.46153846153846156,0.40460526315789475,0.3805309734513274,0.3805309734513274,0.3584905660377358,0.35233160621761656,0.33658536585365856,0.32867132867132864,0.32432432432432434,0.32166301969365424,0.30864197530864196,0.2925430210325048,0.28888888888888886,0.2671118530884808,0.2559241706161137,0.24962406015037594,0.22654155495978553,0.21755725190839695,0.20278099652375434,0.19538968166849616,0.18692543411644535,0.18692543411644535,0.17647058823529413,0.16153846153846155,0.1588089330024814,0.1392857142857143,0.1335131490222522,0.1254681647940075,0.11657142857142858,0.10609943618657099,0.09597806215722121,0.08259015122140365,0.07231335788416471,0.03991252050300711,0.009903640256959315,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9375,0.9264705882352942,0.9041095890410958,0.8734177215189873,0.8674698795180723,0.8426966292134831,0.7920792079207921,0.7788461538461539,0.711864406779661,0.6641221374045801,0.6274509803921569,0.6274509803921569,0.6274509803921569,0.6226415094339622,0.5604395604395604,0.5497382198952879,0.5023255813953489,0.4847161572052402,0.4810126582278481,0.43656716417910446,0.3761755485893417,0.3687315634218289,0.36627906976744184,0.3477088948787062,0.34196891191709844,0.3253012048192771,0.3157894736842105,0.31333333333333335,0.3096774193548387,0.287378640776699,0.28383458646616544,0.27717391304347827,0.2480252764612954,0.24210526315789474,0.21983914209115282,0.21456436931079323,0.2007168458781362,0.1930022573363431,0.1807967313585291,0.1807967313585291,0.17077798861480076,0.1564102564102564,0.15384615384615385,0.135,0.1294672960215779,0.12172284644194757,0.11314285714285714,0.10302409021014865,0.09323583180987204,0.08026366808840636,0.07030465349849348,0.038819026790595956,0.024234264557388085,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9375,0.9264705882352942,0.9041095890410958,0.8734177215189873,0.8674698795180723,0.7722772277227723,0.7722772277227723,0.7105263157894737,0.68,0.6170212765957447,0.6143790849673203,0.6143790849673203,0.610062893081761,0.5755813953488372,0.5340314136125655,0.4883720930232558,0.47161572052401746,0.4269230769230769,0.3573667711598746,0.35103244837758113,0.3488372093023256,0.3238341968911917,0.3097560975609756,0.3049645390070922,0.2979683972911964,0.29540481400437635,0.26796116504854367,0.2650375939849624,0.23414634146341465,0.22442748091603054,0.2037533512064343,0.19895968790637192,0.1863799283154122,0.17945823927765236,0.16853932584269662,0.16853932584269662,0.1568627450980392,0.14528462192013594,0.14204081632653062,0.12642857142857142,0.12137559002022927,0.11531190926275993,0.10685714285714286,0.09823284823284824,0.09253012048192771,0.0764406115248922,0.07239488117001829,0.055973266499582286,0.02288791652642208,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9375,0.9264705882352942,0.9041095890410958,0.8734177215189873,0.8674698795180723,0.7722772277227723,0.7722772277227723,0.6949152542372882,0.672,0.6078431372549019,0.6078431372549019,0.6078431372549019,0.6037735849056604,0.5439560439560439,0.5230769230769231,0.47555555555555556,0.47161572052401746,0.4269230769230769,0.3573667711598746,0.35103244837758113,0.3488372093023256,0.31865284974093266,0.2937062937062937,0.2866666666666667,0.258252427184466,0.2556390977443609,0.25,0.22432859399684044,0.21804511278195488,0.1970509383378016,0.18820577164366373,0.1772885283893395,0.16919739696312364,0.1634320735444331,0.15517241379310345,0.14103653355989804,0.13895781637717122,0.12751677852348994,0.11800404585300067,0.11463730569948187,0.10477299185098952,0.09511434511434512,0.08963855421686746,0.07408859270874167,0.07020109689213894,0.05430242272347535,0.016577361018084394,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9375,0.9264705882352942,0.9041095890410958,0.8734177215189873,0.8674698795180723,0.7722772277227723,0.7722772277227723,0.6949152542372882,0.672,0.6026490066225165,0.6026490066225165,0.5974842767295597,0.5680473372781065,0.5235602094240838,0.4975609756097561,0.4666666666666667,0.45569620253164556,0.3651315789473684,0.34023668639053256,0.31536388140161725,0.2891566265060241,0.27765237020316025,0.27571115973741794,0.24665391969407266,0.2462686567164179,0.21951219512195122,0.21068702290076335,0.18900804289544235,0.1806775407779172,0.17033603707995365,0.16268980477223427,0.1567622950819672,0.14565826330532214,0.135089209855565,0.1267605633802817,0.11387163561076605,0.11074489123269611,0.09953434225844005,0.08918503331624808,0.08089579524680073,0.06979449398991858,0.06126548376297288,0.03389830508474576,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9827586206896551,0.9827586206896551,0.9827586206896551,0.9827586206896551,0.9827586206896551,0.9827586206896551,0.9827586206896551,0.9117647058823529,0.9,0.88,0.8554216867469879,0.8275862068965517,0.7211538461538461,0.624,0.5562913907284768,0.5562913907284768,0.5534591194968553,0.4945054945054945,0.4325581395348837,0.4192139737991266,0.3256578947368421,0.3047337278106509,0.2830188679245283,0.26024096385542167,0.2505643340857788,0.24945295404814005,0.22388059701492538,0.22388059701492538,0.2,0.1903323262839879,0.16775032509752927,0.15770609318996415,0.1523702031602709,0.14344262295081966,0.14170854271356784,0.1245674740484429,0.12158808933002481,0.10714285714285714,0.10316925151719487,0.09737827715355805,0.0814966683751922,0.0740402193784278,0.06142963514519732,0.05054151624548736,0.014316811788345613,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9761904761904762,0.9636363636363636,0.9636363636363636,0.9636363636363636,0.9636363636363636,0.9482758620689655,0.890625,0.8823529411764706,0.863013698630137,0.7951807228915663,0.6634615384615384,0.549618320610687,0.5099337748344371,0.5098039215686274,0.44505494505494503,0.37777777777777777,0.3670886075949367,0.2735562310030395,0.21678321678321677,0.21444201312910285,0.1926070038910506,0.19029850746268656,0.16587677725118483,0.1447721179624665,0.13261648745519714,0.1251372118551043,0.11987704918032786,0.11204481792717087,0.09172259507829977,0.08496291301416048,0.07325383304940375,0.05374592833876222,0.04061371841155235,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9333333333333333,0.8611111111111112,0.8301886792452831,0.8301886792452831,0.8301886792452831,0.8301886792452831,0.8181818181818182,0.8,0.75,0.6835443037974683,0.456,0.4066666666666667,0.3987341772151899,0.34554973821989526,0.2653846153846154,0.13773584905660377,0.11848341232227488,0.07282913165266107,0.05785714285714286,0.04048192771084337,0.02422723475355054,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]],"recall_thresholds":[0.0,0.01,0.02,0.03,0.04,0.05,0.06,0.07,0.08,0.09,0.1,0.11,0.12,0.13,0.14,0.15,0.16,0.17,0.18,0.19,0.2,0.21,0.22,0.23,0.24,0.25,0.26,0.27,0.28,0.29,0.3,0.31,0.32,0.33,0.34,0.35000000000000003,0.36,0.37,0.38,0.39,0.4,0.41000000000000003,0.42,0.43,0.44,0.45,0.46,0.47000000000000003,0.48,0.49,0.5,0.51,0.52,0.53,0.54,0.55,0.56,0.5700000000000001,0.58,0.59,0.6,0.61,0.62,0.63,0.64,0.65,0.66,0.67,0.68,0.6900000000000001,0.7000000000000001,0.71,0.72,0.73,0.74,0.75,0.76,0.77,0.78,0.79,0.8,0.81,0.8200000000000001,0.8300000000000001,0.84,0.85,0.86,0.87,0.88,0.89,0.9,0.91,0.92,0.93,0.9400000000000001,0.9500000000000001,0.96,0.97,0.98,0.99,1.0],"scores":[[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9585787653923035,0.9575620889663696,0.9568257331848145,0.9560073614120483,0.9538499712944031,0.9500331878662109,0.9435871839523315,0.9408732652664185,0.8572510480880737,0.8041110038757324,0.7729035019874573,0.7316728234291077,0.7094331979751587,0.6633992195129395,0.6480571031570435,0.6470828056335449,0.5953417420387268,0.5735146403312683,0.5508371591567993,0.5216833353042603,0.507706344127655,0.5020371675491333,0.49324971437454224,0.478418231010437,0.46982336044311523,0.4536204934120178,0.4421732723712921,0.4235703647136688,0.40744468569755554,0.4012247920036316,0.3949631452560425,0.37603139877319336,0.34619665145874023,0.32678958773612976,0.32390159368515015,0.3119688630104065,0.29528969526290894,0.2769066095352173,0.26878052949905396,0.2610367238521576,0.2510267198085785,0.23130708932876587,0.22690708935260773,0.22068668901920319,0.20682238042354584,0.20088085532188416,0.1941605806350708,0.17665690183639526,0.17209550738334656,0.16527892649173737,0.15989950299263,0.15596339106559753,0.15061122179031372,0.14523592591285706,0.13735134899616241,0.13344889879226685,0.12492327392101288,0.11711706221103668,0.11190908402204514,0.10550928860902786,0.09888853132724762,0.0923946276307106,0.08369728177785873,0.07114356011152267,0.04033275693655014,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7389984130859375,0.7190212607383728,0.6936459541320801,0.6480071544647217,0.6355875730514526,0.5832968354225159,0.5508371591567993,0.5216833353042603,0.507706344127655,0.5020371675491333,0.4889431595802307,0.474325954914093,0.45832324028015137,0.44290438294410706,0.4235703647136688,0.4056469202041626,0.39943927526474,0.37603139877319336,0.34619665145874023,0.3258066475391388,0.32389551401138306,0.3048463463783264,0.293806791305542,0.2763128876686096,0.26535528898239136,0.2610367238521576,0.2537226676940918,0.2414199709892273,0.22923777997493744,0.2253156453371048,0.2068166881799698,0.20055942237377167,0.1943197399377823,0.17690981924533844,0.17433476448059082,0.16527892649173737,0.15989950299263,0.15596339106559753,0.15061122179031372,0.14523592591285706,0.13735134899616241,0.13344889879226685,0.12492327392101288,0.11711706221103668,0.11190908402204514,0.10553359240293503,0.09951391816139221,0.09539015591144562,0.0843665823340416,0.08058075606822968,0.06806748360395432,0.04033275693655014,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7389984130859375,0.7190212607383728,0.6936459541320801,0.6480071544647217,0.6355875730514526,0.5832968354225159,0.5508371591567993,0.5216833353042603,0.507706344127655,0.5020371675491333,0.4889431595802307,0.474325954914093,0.45832324028015137,0.44290438294410706,0.4235703647136688,0.4056469202041626,0.39943927526474,0.37603139877319336,0.34619665145874023,0.3258066475391388,0.32389551401138306,0.3048463463783264,0.293806791305542,0.2763128876686096,0.26535528898239136,0.2610367238521576,0.2537226676940918,0.2414199709892273,0.22923777997493744,0.2253156453371048,0.2068166881799698,0.20055942237377167,0.1943197399377823,0.17665690183639526,0.17209550738334656,0.1622985601425171,0.15737952291965485,0.15082065761089325,0.15044862031936646,0.1444702297449112,0.13653616607189178,0.13339833915233612,0.12109428644180298,0.11672231554985046,0.11115076392889023,0.10550928860902786,0.09888853132724762,0.0923946276307106,0.08369728177785873,0.07611681520938873,0.05371889844536781,0.01640801876783371,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7389984130859375,0.7190212607383728,0.6936459541320801,0.6480071544647217,0.6355875730514526,0.5832968354225159,0.5508371591567993,0.5126975774765015,0.5039889216423035,0.5013951063156128,0.48697787523269653,0.45832324028015137,0.4421732723712921,0.41571757197380066,0.4027911126613617,0.3986104428768158,0.3664930760860443,0.33190256357192993,0.32397475838661194,0.32146114110946655,0.3037983775138855,0.2934706211090088,0.2728487253189087,0.2629707455635071,0.25593698024749756,0.2510267198085785,0.23130708932876587,0.22690708935260773,0.22068668901920319,0.20088085532188416,0.19547219574451447,0.17690981924533844,0.17433476448059082,0.16527892649173737,0.15989950299263,0.15082065761089325,0.15044862031936646,0.1444702297449112,0.13653616607189178,0.13339833915233612,0.12109428644180298,0.11672231554985046,0.11115076392889023,0.10550928860902786,0.09888853132724762,0.0923946276307106,0.08369728177785873,0.07611681520938873,0.05371889844536781,0.04033275693655014,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7389984130859375,0.7190212607383728,0.6480571031570435,0.6470828056335449,0.6009455919265747,0.5735146403312683,0.5216833353042603,0.507706344127655,0.5020371675491333,0.4889431595802307,0.46982336044311523,0.4421732723712921,0.41571757197380066,0.4027911126613617,0.37603139877319336,0.33190256357192993,0.32397475838661194,0.32146114110946655,0.29528969526290894,0.2769066095352173,0.26878052949905396,0.26139453053474426,0.2537226676940918,0.2310001105070114,0.22669893503189087,0.20406374335289001,0.19565008580684662,0.17690981924533844,0.17433476448059082,0.16527892649173737,0.15989950299263,0.15082065761089325,0.15044862031936646,0.14273330569267273,0.13586024940013885,0.132113978266716,0.12109428644180298,0.11672231554985046,0.11190908402204514,0.10553359240293503,0.09951391816139221,0.09539015591144562,0.0843665823340416,0.08058075606822968,0.06806748360395432,0.04033275693655014,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7389984130859375,0.7190212607383728,0.6480571031570435,0.6470828056335449,0.5837563276290894,0.5706039071083069,0.5126975774765015,0.5039889216423035,0.5013951063156128,0.48697787523269653,0.45832324028015137,0.4364587366580963,0.40744468569755554,0.4027911126613617,0.37603139877319336,0.33190256357192993,0.32397475838661194,0.32146114110946655,0.2934706211090088,0.26535528898239136,0.25593698024749756,0.23130708932876587,0.22690708935260773,0.22068668901920319,0.20088085532188416,0.1943197399377823,0.17647428810596466,0.17082706093788147,0.1621071696281433,0.15596339106559753,0.15061122179031372,0.14523592591285706,0.13653616607189178,0.13339833915233612,0.12492327392101288,0.11711706221103668,0.11418488621711731,0.1064460277557373,0.09951391816139221,0.09539015591144562,0.0843665823340416,0.08058075606822968,0.06806748360395432,0.0330684557557106,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7389984130859375,0.7190212607383728,0.6480571031570435,0.6470828056335449,0.5837563276290894,0.5706039071083069,0.5126975774765015,0.5039889216423035,0.49324971437454224,0.4712737202644348,0.44290438294410706,0.4235703647136688,0.403921902179718,0.3986104428768158,0.34619665145874023,0.32397475838661194,0.3037983775138855,0.2728487253189087,0.26139453053474426,0.2537226676940918,0.22923777997493744,0.22587302327156067,0.20406374335289001,0.19565008580684662,0.17647428810596466,0.17082706093788147,0.1621071696281433,0.15596339106559753,0.15061122179031372,0.14273330569267273,0.13586024940013885,0.12868961691856384,0.11845976859331131,0.11559164524078369,0.1064460277557373,0.09888853132724762,0.0923946276307106,0.08369728177785873,0.07611681520938873,0.05371889844536781,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.8686259984970093,0.8127071261405945,0.7729035019874573,0.7316728234291077,0.7064200639724731,0.6355875730514526,0.5706039071083069,0.5100491642951965,0.5039722919464111,0.4889431595802307,0.45832324028015137,0.41571757197380066,0.4027911126613617,0.34619665145874023,0.32397475838661194,0.3037983775138855,0.2728487253189087,0.26139453053474426,0.2537226676940918,0.22923777997493744,0.22587302327156067,0.20406374335289001,0.1943197399377823,0.17433476448059082,0.16527892649173737,0.15989950299263,0.15082065761089325,0.14931756258010864,0.13735134899616241,0.13339833915233612,0.12109428644180298,0.11672231554985046,0.11115076392889023,0.09888853132724762,0.0923946276307106,0.08148542791604996,0.07114356011152267,0.0330684557557106,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573141932487488,0.9564145803451538,0.9548102617263794,0.9514526724815369,0.9435871839523315,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7190212607383728,0.6355875730514526,0.5508371591567993,0.507706344127655,0.5013951063156128,0.45832324028015137,0.40744468569755554,0.3986104428768158,0.3280792534351349,0.26535528898239136,0.25593698024749756,0.23130708932876587,0.22587302327156067,0.20055942237377167,0.17647428810596466,0.16527892649173737,0.1573040634393692,0.15061122179031372,0.14273330569267273,0.12492327392101288,0.11672231554985046,0.10500568151473999,0.08603867888450623,0.07114356011152267,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9644217491149902,0.9612260460853577,0.9584938883781433,0.9568257331848145,0.9560073614120483,0.9538499712944031,0.9490416646003723,0.9408732652664185,0.8514154553413391,0.7389984130859375,0.5706039071083069,0.5100491642951965,0.4889431595802307,0.4421732723712921,0.37603139877319336,0.22923777997493744,0.20055942237377167,0.14273330569267273,0.12109428644180298,0.09539015591144562,0.06806748360395432,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]]},"title":{"ap":35.963737455625406,"ap50":45.82497853510442,"ap70":37.919540471954086,"ap90":27.58934006257302,"ar100":62.943143812709025}},"H51-control":{"counts":{"fn":147,"fp":232,"iou":0.5,"precision":39.583333333333336,"recall":50.836120401337794,"threshold":0.3,"tp":152},"model":{"completed_updates":1024,"sha256":"d086886d0666e878dea643721e98db0789317ef93a67e95f517a03922e8fe1c3","stage":"H51-control"},"panels":{"fin_val":{"ap":91.73710137237188,"ap50":96.4099632632333,"ap70":95.72830310105967,"ap90":89.01546582174996,"ar100":97.31012658227849,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":256,"per_class_ap":{"9":91.73710137237188},"taxonomy":"ax-document-unified-25/1"},"financial_val":{"ap":61.54451332090731,"ap50":74.82347437893793,"ap70":68.37143078364227,"ap90":43.45150000241278,"ar100":83.51945585499091,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":1745,"per_class_ap":{"1":50.790307872052466,"10":86.95649329534332,"11":21.537754862532495,"2":21.089752984835016,"3":-1.0,"4":86.26630590510274,"5":63.45967663532532,"6":48.37271223360353,"7":81.63817745625849,"8":65.42434020637644,"9":89.90961175764326},"taxonomy":"ax-document-unified-25/1"},"gold_val":{"ap":71.12138935941007,"ap50":88.67129396706581,"ap70":78.75562209735875,"ap90":50.94979086232245,"ar100":83.49783844438394,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":6489,"per_class_ap":{"1":87.04700605626007,"10":84.91962874561692,"11":37.09773755641038,"2":70.98562257535825,"3":66.03273966396873,"4":86.30603620785666,"5":54.172316702963194,"6":57.063027563254366,"7":86.45057247965717,"8":68.17739410145994,"9":84.08320130070514},"taxonomy":"ax-document-unified-25/1"}},"pr":{"iou_thresholds":[0.5,0.55,0.6,0.65,0.7,0.75,0.8,0.85,0.8999999999999999,0.95],"precision":[[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9552238805970149,0.9305555555555556,0.9012345679012346,0.9012345679012346,0.8666666666666667,0.8666666666666667,0.845360824742268,0.8155339805825242,0.7719298245614035,0.7459016393442623,0.7401574803149606,0.7384615384615385,0.6959459459459459,0.6959459459459459,0.6862745098039216,0.6829268292682927,0.6829268292682927,0.6666666666666666,0.6464088397790055,0.6417112299465241,0.615,0.6086956521739131,0.5909090909090909,0.5866666666666667,0.569620253164557,0.45874587458745875,0.43653250773993807,0.4289940828402367,0.4164305949008499,0.40540540540540543,0.3974358974358974,0.3954659949622166,0.375886524822695,0.34989200863930886,0.3098330241187384,0.3037974683544304,0.28859060402684567,0.2766295707472178,0.2657856093979442,0.2657856093979442,0.24563758389261744,0.24412532637075718,0.23833543505674654,0.2350061199510404,0.22860492379835873,0.21536796536796537,0.20997920997921,0.2042042042042042,0.1707920792079208,0.15373352855051245,0.14333781965006728,0.13506815365551425,0.13004750593824227,0.12177729018102029,0.11398176291793313,0.11057225994180407,0.09709962168978563,0.08715083798882682,0.0747722274583726,0.0639488409272582,0.05207886840977283,0.04792518994739918,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9402985074626866,0.9402985074626866,0.8918918918918919,0.8765432098765432,0.8314606741573034,0.8085106382978723,0.8041237113402062,0.7714285714285715,0.7368421052631579,0.6929133858267716,0.6923076923076923,0.6554054054054054,0.6554054054054054,0.6410256410256411,0.6402439024390244,0.6402439024390244,0.5966850828729282,0.5935828877005348,0.57,0.5652173913043478,0.5333333333333333,0.5189873417721519,0.41914191419141916,0.3993808049535604,0.3905325443786982,0.3788300835654596,0.37567567567567567,0.36855670103092786,0.36523929471032746,0.34988179669030733,0.3393665158371041,0.3248407643312102,0.2899628252788104,0.2760416666666667,0.2647058823529412,0.24963289280469897,0.24963289280469897,0.24818577648766327,0.2297650130548303,0.2244640605296343,0.22249690976514216,0.21453692848769051,0.20238095238095238,0.19750519750519752,0.1921921921921922,0.1608910891089109,0.14494875549048317,0.13526244952893673,0.12763320941759604,0.12292161520190023,0.1151947339550192,0.11216429699842022,0.10624692572552878,0.09538327526132404,0.08995137763371151,0.07847924659923265,0.07163053722902922,0.06155075939248601,0.05015002143163309,0.046171829339567504,0.01513431706394249,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9402985074626866,0.9402985074626866,0.8918918918918919,0.8765432098765432,0.8314606741573034,0.8085106382978723,0.7878787878787878,0.7363636363636363,0.6967213114754098,0.6850393700787402,0.6418918918918919,0.6418918918918919,0.64,0.6280487804878049,0.6280487804878049,0.5898876404494382,0.5828877005347594,0.5634517766497462,0.5560975609756098,0.5318181818181819,0.5106382978723404,0.41694915254237286,0.3931888544891641,0.38461538461538464,0.37393767705382436,0.371900826446281,0.3641160949868074,0.3634020618556701,0.3564356435643564,0.33715596330275227,0.32397408207343414,0.2862453531598513,0.2736842105263158,0.26677852348993286,0.25194401244167963,0.24522760646108663,0.24383164005805516,0.22715404699738903,0.22715404699738903,0.2200247218788628,0.2155688622754491,0.20748299319727892,0.19957081545064378,0.19404517453798767,0.16566005176876616,0.15776699029126215,0.140625,0.12639405204460966,0.12639405204460966,0.1148723640399556,0.11290322580645161,0.1056547619047619,0.10414657666345227,0.09132610508757298,0.08268156424581005,0.07100219918316054,0.06291390728476821,0.05167785234899329,0.04578219364893824,0.024325156522631633,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9402985074626866,0.9402985074626866,0.8918918918918919,0.8765432098765432,0.8314606741573034,0.8085106382978723,0.7878787878787878,0.7363636363636363,0.6967213114754098,0.6850393700787402,0.6351351351351351,0.6351351351351351,0.6219512195121951,0.6219512195121951,0.6219512195121951,0.5737704918032787,0.5482233502538071,0.5414634146341464,0.5181818181818182,0.4978902953586498,0.4067796610169492,0.38390092879256965,0.3757396449704142,0.3654390934844193,0.36363636363636365,0.3562005277044855,0.3556701030927835,0.349009900990099,0.3302752293577982,0.3174946004319654,0.28066914498141265,0.26842105263157895,0.26174496644295303,0.24727838258164853,0.2393538913362702,0.2301255230125523,0.22193211488250653,0.21689785624211855,0.21508034610630408,0.20750293083235638,0.1958874458874459,0.19022869022869024,0.17079889807162535,0.15372168284789645,0.138328530259366,0.1282051282051282,0.12329615861214374,0.11273135165451487,0.11021505376344086,0.10486322188449848,0.10184287099903007,0.08953341740226986,0.08184918529746116,0.07103470645475186,0.06216746009521142,0.052521008403361345,0.047010309278350516,0.03128385698808234,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9402985074626866,0.9402985074626866,0.8918918918918919,0.8765432098765432,0.8295454545454546,0.78125,0.7428571428571429,0.7105263157894737,0.6692913385826772,0.6170212765957447,0.6148648648648649,0.6036585365853658,0.6036585365853658,0.6036585365853658,0.5573770491803278,0.5172413793103449,0.5,0.47257383966244726,0.3864406779661017,0.3653250773993808,0.35798816568047337,0.34844192634560905,0.34324324324324323,0.3368146214099217,0.33249370277078083,0.30963302752293576,0.2929936305732484,0.2620817843866171,0.25,0.23370429252782193,0.22320117474302498,0.2220609579100145,0.206266318537859,0.201765447667087,0.20024721878862795,0.19347319347319347,0.1829004329004329,0.17775467775467776,0.17125984251968504,0.14603960396039603,0.13177159590043924,0.12314939434724091,0.1171003717472119,0.1171003717472119,0.10654827968923418,0.10483870967741936,0.09821428571428571,0.09691417550626807,0.08507089241034195,0.07709497206703911,0.06628966383914546,0.058774834437086095,0.04832214765100671,0.04285992596921878,0.022785589654110643,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9402985074626866,0.9402985074626866,0.8918918918918919,0.8765432098765432,0.8295454545454546,0.78125,0.7428571428571429,0.7105263157894737,0.6692913385826772,0.6170212765957447,0.6148648648648649,0.6036585365853658,0.6036585365853658,0.6036585365853658,0.5573770491803278,0.5172413793103449,0.5,0.47257383966244726,0.3864406779661017,0.3653250773993808,0.35798816568047337,0.34844192634560905,0.3324538258575198,0.30641330166270786,0.2926829268292683,0.2527881040892193,0.24642857142857144,0.23657718120805368,0.223950233281493,0.2173274596182085,0.20134228187919462,0.19973890339425587,0.19330855018587362,0.1864801864801865,0.1764069264069264,0.17151767151767153,0.16535433070866143,0.14108910891089108,0.1273792093704246,0.11911170928667564,0.11338289962825279,0.11338289962825279,0.10431856421761077,0.10215053763440861,0.0972644376899696,0.09456838021338507,0.0832282471626734,0.07616521409624857,0.06616931560168667,0.05796695603472417,0.049019607843137254,0.043917525773195874,0.022169762906702247,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9402985074626866,0.9402985074626866,0.8918918918918919,0.8765432098765432,0.8295454545454546,0.78125,0.7428571428571429,0.7105263157894737,0.6692913385826772,0.6170212765957447,0.6148648648648649,0.6,0.5975609756097561,0.5892857142857143,0.5396825396825397,0.5121951219512195,0.48,0.3908450704225352,0.37623762376237624,0.34911242603550297,0.33994334277620397,0.31139240506329113,0.2850678733031674,0.25851703406813625,0.23869801084990958,0.234375,0.21939586645468998,0.20998531571218795,0.20899854862119013,0.19321148825065274,0.18915510718789408,0.18323353293413175,0.17687074829931973,0.17060085836909872,0.1594488188976378,0.13613861386138615,0.12103746397694524,0.11242603550295859,0.10842627013630732,0.10405643738977072,0.09873834339001646,0.09270516717325228,0.09020368574199807,0.07944514501891552,0.07275483137552104,0.06325008108984755,0.05544665359843181,0.0469187675070028,0.04206185567010309,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9821428571428571,0.9821428571428571,0.9821428571428571,0.9821428571428571,0.9821428571428571,0.9821428571428571,0.9666666666666667,0.9253731343283582,0.8888888888888888,0.8641975308641975,0.8641975308641975,0.8181818181818182,0.6818181818181818,0.6446280991735537,0.6230769230769231,0.5753424657534246,0.5612903225806452,0.5521472392638037,0.5081967213114754,0.4729064039408867,0.4177215189873418,0.33993399339933994,0.3220858895705521,0.3059490084985836,0.2810126582278481,0.2579185520361991,0.23446893787575152,0.21699819168173598,0.21354166666666666,0.20031796502384738,0.19089574155653452,0.17718120805369128,0.1762402088772846,0.17100371747211895,0.1655011655011655,0.15692640692640691,0.15092402464065707,0.12942191544434858,0.11200585651537336,0.10497981157469717,0.09913258983890955,0.09085810431856421,0.0889967637540453,0.08333333333333333,0.08244937319189971,0.0725604670558799,0.061737007324729684,0.05655042412818096,0.04876099120703437,0.039862837548221175,0.03682057276446522,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.975609756097561,0.9636363636363636,0.9636363636363636,0.9636363636363636,0.9636363636363636,0.9333333333333333,0.8955223880597015,0.8955223880597015,0.8513513513513513,0.8148148148148148,0.6272727272727273,0.5714285714285714,0.5136986301369864,0.5032258064516129,0.48214285714285715,0.4444444444444444,0.37130801687763715,0.29900332225913623,0.26345609065155806,0.22802850356294538,0.21019108280254778,0.18214285714285713,0.16329704510108864,0.1567489114658926,0.1462140992167102,0.1336459554513482,0.1266233766233766,0.12012012012012012,0.10148514851485149,0.08948863636363637,0.07992565055762081,0.07240811848601207,0.06640432857845549,0.058007566204287514,0.04461200125667609,0.03836930455635491,0.03150450064294899,0.029222676797194622,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9642857142857143,0.8823529411764706,0.8333333333333334,0.8333333333333334,0.8333333333333334,0.8333333333333334,0.8333333333333334,0.8,0.7727272727272727,0.6923076923076923,0.5087719298245614,0.425531914893617,0.42,0.3707865168539326,0.350253807106599,0.23920265780730898,0.12254901960784313,0.10469798657718121,0.08108108108108109,0.06818181818181818,0.047723532638507954,0.04339440694310511,0.029531888155827836,0.020574367766823833,0.007099318752240947,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]],"recall_thresholds":[0.0,0.01,0.02,0.03,0.04,0.05,0.06,0.07,0.08,0.09,0.1,0.11,0.12,0.13,0.14,0.15,0.16,0.17,0.18,0.19,0.2,0.21,0.22,0.23,0.24,0.25,0.26,0.27,0.28,0.29,0.3,0.31,0.32,0.33,0.34,0.35000000000000003,0.36,0.37,0.38,0.39,0.4,0.41000000000000003,0.42,0.43,0.44,0.45,0.46,0.47000000000000003,0.48,0.49,0.5,0.51,0.52,0.53,0.54,0.55,0.56,0.5700000000000001,0.58,0.59,0.6,0.61,0.62,0.63,0.64,0.65,0.66,0.67,0.68,0.6900000000000001,0.7000000000000001,0.71,0.72,0.73,0.74,0.75,0.76,0.77,0.78,0.79,0.8,0.81,0.8200000000000001,0.8300000000000001,0.84,0.85,0.86,0.87,0.88,0.89,0.9,0.91,0.92,0.93,0.9400000000000001,0.9500000000000001,0.96,0.97,0.98,0.99,1.0],"scores":[[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9589502215385437,0.9579772353172302,0.9574539065361023,0.9564370512962341,0.9528476595878601,0.9513405561447144,0.9449191689491272,0.9412716031074524,0.8671646118164062,0.8186838626861572,0.7771591544151306,0.7497007250785828,0.7136091589927673,0.7056397795677185,0.6818967461585999,0.6522378921508789,0.6200374364852905,0.5956525206565857,0.5766485929489136,0.5692108273506165,0.539625346660614,0.5348696112632751,0.524004340171814,0.5048508644104004,0.49664923548698425,0.4751901626586914,0.46791937947273254,0.462502121925354,0.44887426495552063,0.4381474554538727,0.42415472865104675,0.41848909854888916,0.40364307165145874,0.350677490234375,0.3406250774860382,0.33488965034484863,0.3237136900424957,0.30961132049560547,0.2981020212173462,0.2913847267627716,0.2782512903213501,0.25974375009536743,0.2321736365556717,0.2247842401266098,0.21412034332752228,0.20708627998828888,0.19726358354091644,0.19437378644943237,0.18283788859844208,0.17937682569026947,0.17665082216262817,0.17276422679424286,0.16816474497318268,0.16026897728443146,0.15627551078796387,0.15263104438781738,0.13487662374973297,0.12580697238445282,0.11885173618793488,0.11403951793909073,0.1101522222161293,0.10546615719795227,0.10069839656352997,0.09812770783901215,0.09037834405899048,0.08403317630290985,0.0756792351603508,0.06853865087032318,0.060330018401145935,0.05722614750266075,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7571200132369995,0.7136091589927673,0.6877915859222412,0.6697161793708801,0.6510984897613525,0.6180610060691833,0.5766485929489136,0.5692108273506165,0.539625346660614,0.5348696112632751,0.5178893208503723,0.5004462003707886,0.49275708198547363,0.46791937947273254,0.462502121925354,0.44887426495552063,0.4381474554538727,0.41848909854888916,0.40364307165145874,0.350677490234375,0.3406250774860382,0.33450010418891907,0.3199605643749237,0.3099183440208435,0.30080175399780273,0.2913847267627716,0.27900320291519165,0.27025362849235535,0.25574302673339844,0.23165062069892883,0.21900638937950134,0.210280179977417,0.19950267672538757,0.195187509059906,0.19172407686710358,0.1798563301563263,0.1768106371164322,0.17373819649219513,0.16816474497318268,0.16026897728443146,0.15627551078796387,0.15263104438781738,0.13487662374973297,0.12580697238445282,0.11885173618793488,0.11403951793909073,0.1101522222161293,0.10546615719795227,0.10333684086799622,0.09880973398685455,0.09254797548055649,0.08846885710954666,0.08045994490385056,0.07556277513504028,0.06853865087032318,0.060330018401145935,0.05722614750266075,0.026615668088197708,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7571200132369995,0.7136091589927673,0.6877915859222412,0.6569941639900208,0.6329759955406189,0.5956525206565857,0.574152410030365,0.5408576726913452,0.5353946089744568,0.5319778323173523,0.5048508644104004,0.49664923548698425,0.4710395634174347,0.4628496766090393,0.4503069519996643,0.4392332434654236,0.42334437370300293,0.40728917717933655,0.35393026471138,0.3422738015651703,0.33488965034484863,0.3237136900424957,0.3147604763507843,0.30488234758377075,0.2980095148086548,0.28888583183288574,0.27182137966156006,0.25974375009536743,0.2321736365556717,0.22084392607212067,0.2140979766845703,0.20460821688175201,0.195187509059906,0.19172407686710358,0.17989522218704224,0.17912280559539795,0.17394860088825226,0.17063970863819122,0.16492217779159546,0.1592438668012619,0.1544380784034729,0.1390257477760315,0.13348928093910217,0.12305901199579239,0.11452692747116089,0.11342701315879822,0.10599956661462784,0.10449545830488205,0.09935172647237778,0.09788438677787781,0.08989707380533218,0.08403317630290985,0.0756792351603508,0.06973738223314285,0.06194167956709862,0.05723701789975166,0.03908626735210419,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7571200132369995,0.7136091589927673,0.6877915859222412,0.6569941639900208,0.6329759955406189,0.5956525206565857,0.574152410030365,0.5408576726913452,0.5348696112632751,0.5178893208503723,0.5004462003707886,0.49275708198547363,0.4657750725746155,0.4503069519996643,0.4392332434654236,0.42334437370300293,0.40728917717933655,0.35393026471138,0.3422738015651703,0.33488965034484863,0.3237136900424957,0.3147604763507843,0.30488234758377075,0.2980095148086548,0.28888583183288574,0.27182137966156006,0.25974375009536743,0.2321736365556717,0.22084392607212067,0.2140979766845703,0.20460821688175201,0.19437378644943237,0.18659290671348572,0.1798563301563263,0.1768106371164322,0.17373819649219513,0.16816474497318268,0.16026897728443146,0.15594027936458588,0.14424945414066315,0.13393591344356537,0.12465009093284607,0.11719609797000885,0.11345991492271423,0.10664643347263336,0.10463906824588776,0.10069839656352997,0.09812770783901215,0.09037834405899048,0.08487530052661896,0.07703690230846405,0.07037324458360672,0.06332047283649445,0.059061672538518906,0.046421777456998825,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7571200132369995,0.7136091589927673,0.6818967461585999,0.6510984897613525,0.6180610060691833,0.5766485929489136,0.5444192886352539,0.5348696112632751,0.5178893208503723,0.5004462003707886,0.49275708198547363,0.4657750725746155,0.4445972740650177,0.4271862208843231,0.40728917717933655,0.35393026471138,0.3422738015651703,0.33488965034484863,0.3237136900424957,0.3099183440208435,0.30080175399780273,0.290158748626709,0.27182137966156006,0.25574302673339844,0.23165062069892883,0.21900638937950134,0.20708627998828888,0.1955386847257614,0.19172407686710358,0.1798563301563263,0.1768106371164322,0.17373819649219513,0.16816474497318268,0.16026897728443146,0.15594027936458588,0.1509931981563568,0.13487662374973297,0.12580697238445282,0.11885173618793488,0.11452692747116089,0.11342701315879822,0.10599956661462784,0.10449545830488205,0.09935172647237778,0.09788438677787781,0.08989707380533218,0.08403317630290985,0.0756792351603508,0.06973738223314285,0.06194167956709862,0.05723701789975166,0.03908626735210419,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7571200132369995,0.7136091589927673,0.6818967461585999,0.6510984897613525,0.6180610060691833,0.5766485929489136,0.5444192886352539,0.5348696112632751,0.5178893208503723,0.5004462003707886,0.49275708198547363,0.4657750725746155,0.4445972740650177,0.4271862208843231,0.40728917717933655,0.35393026471138,0.3422738015651703,0.33488965034484863,0.3237136900424957,0.30488234758377075,0.27900320291519165,0.265285462141037,0.2321736365556717,0.22373263537883759,0.2140979766845703,0.20460821688175201,0.19437378644943237,0.18283788859844208,0.17912280559539795,0.17394860088825226,0.16816474497318268,0.16026897728443146,0.15594027936458588,0.1509931981563568,0.13487662374973297,0.12580697238445282,0.11885173618793488,0.11452692747116089,0.11342701315879822,0.10664643347263336,0.10463906824588776,0.10069839656352997,0.09812770783901215,0.09037834405899048,0.08487530052661896,0.07703690230846405,0.07037324458360672,0.06332047283649445,0.059061672538518906,0.03908626735210419,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7571200132369995,0.7136091589927673,0.6818967461585999,0.6510984897613525,0.6180610060691833,0.5766485929489136,0.5444192886352539,0.5348696112632751,0.5178893208503723,0.49930691719055176,0.48559483885765076,0.4597071707248688,0.4392332434654236,0.41848909854888916,0.3606284260749817,0.34981614351272583,0.33488965034484863,0.3237136900424957,0.2913847267627716,0.27025362849235535,0.2480878382921219,0.2247842401266098,0.21900638937950134,0.20708627998828888,0.1955386847257614,0.19172407686710358,0.1798563301563263,0.17665082216262817,0.17063970863819122,0.16492217779159546,0.1592438668012619,0.1509931981563568,0.13487662374973297,0.12465009093284607,0.11719609797000885,0.11345991492271423,0.1095149964094162,0.10546615719795227,0.10069839656352997,0.09812770783901215,0.09037834405899048,0.08487530052661896,0.07703690230846405,0.07037324458360672,0.06332047283649445,0.059061672538518906,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9430616497993469,0.8762680888175964,0.8186838626861572,0.7771591544151306,0.7497007250785828,0.7133811116218567,0.6329759955406189,0.5956525206565857,0.5692108273506165,0.5353946089744568,0.5178893208503723,0.49664923548698425,0.4657750725746155,0.4445972740650177,0.40364307165145874,0.350677490234375,0.3398614227771759,0.3237136900424957,0.2913847267627716,0.27025362849235535,0.2480878382921219,0.2247842401266098,0.21900638937950134,0.20708627998828888,0.19437378644943237,0.18283788859844208,0.17912280559539795,0.17394860088825226,0.16816474497318268,0.16026897728443146,0.1544380784034729,0.1390257477760315,0.12580697238445282,0.11885173618793488,0.11345991492271423,0.10664643347263336,0.10463906824588776,0.09935172647237778,0.09788438677787781,0.08989707380533218,0.08045994490385056,0.07556277513504028,0.06853865087032318,0.060330018401145935,0.05722614750266075,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.957758903503418,0.9568484425544739,0.9537208080291748,0.9522246718406677,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7373836040496826,0.6329759955406189,0.5766485929489136,0.5353946089744568,0.5178893208503723,0.48559483885765076,0.4597071707248688,0.40728917717933655,0.350677490234375,0.3237136900424957,0.27900320291519165,0.25574302673339844,0.22373263537883759,0.20460821688175201,0.19172407686710358,0.1798563301563263,0.16816474497318268,0.1596909761428833,0.15263104438781738,0.13487662374973297,0.12305901199579239,0.11342701315879822,0.10546615719795227,0.09880973398685455,0.09037834405899048,0.0756792351603508,0.06853865087032318,0.060330018401145935,0.05722614750266075,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.965752124786377,0.9620546102523804,0.9588751196861267,0.9574539065361023,0.9564370512962341,0.9528476595878601,0.9513405561447144,0.9412716031074524,0.8671646118164062,0.7717852592468262,0.6200374364852905,0.5444192886352539,0.5319778323173523,0.4710395634174347,0.4503069519996643,0.350677490234375,0.210280179977417,0.18283788859844208,0.15263104438781738,0.13393591344356537,0.10546615719795227,0.09788438677787781,0.0756792351603508,0.060330018401145935,0.029932433739304543,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]]},"title":{"ap":37.09773755641038,"ap50":47.67067642108576,"ap70":39.006786088722876,"ap90":28.09417805581423,"ar100":68.2943143812709}},"H51-title":{"counts":{"fn":131,"fp":296,"iou":0.5,"precision":36.206896551724135,"recall":56.187290969899664,"threshold":0.3,"tp":168},"model":{"completed_updates":1024,"sha256":"44b75b2ca14d7d4756ca51d402d470d069f17ee99145717e1994549b32ef87d2","stage":"H51-title"},"panels":{"fin_val":{"ap":91.57739593169711,"ap50":96.39212272259813,"ap70":95.6720891685565,"ap90":88.44809936812516,"ar100":97.12025316455696,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":256,"per_class_ap":{"9":91.57739593169711},"taxonomy":"ax-document-unified-25/1"},"financial_val":{"ap":61.73305632696384,"ap50":74.96501865247365,"ap70":68.85316694919942,"ap90":43.47744892431575,"ar100":83.61329149193345,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":1745,"per_class_ap":{"1":50.78315145536768,"10":87.04993624291704,"11":22.668975296494782,"2":21.06518949188169,"3":-1.0,"4":86.4342933581353,"5":63.68508463365829,"6":48.562555445664245,"7":81.62495775148074,"8":65.49366226902261,"9":89.96275732501599},"taxonomy":"ax-document-unified-25/1"},"gold_val":{"ap":71.53267127947552,"ap50":88.96970146715404,"ap70":79.30542557035115,"ap90":51.442965386769316,"ar100":84.26815515047466,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":6489,"per_class_ap":{"1":87.08961007399112,"10":85.14502829116108,"11":38.745347586625584,"2":71.23827368382588,"3":65.97418621206323,"4":86.56001042643845,"5":54.89541594216855,"6":57.75922516457215,"7":86.42092276593523,"8":68.62054515710344,"9":84.41081877034607},"taxonomy":"ax-document-unified-25/1"}},"pr":{"iou_thresholds":[0.5,0.55,0.6,0.65,0.7,0.75,0.8,0.85,0.8999999999999999,0.95],"precision":[[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.967741935483871,0.967741935483871,0.967741935483871,0.9402985074626866,0.9358974358974359,0.9358974358974359,0.9358974358974359,0.9259259259259259,0.8876404494382022,0.8350515463917526,0.8018867924528302,0.7767857142857143,0.7711864406779662,0.768595041322314,0.7559055118110236,0.7333333333333333,0.7222222222222222,0.7114093959731543,0.7105263157894737,0.6608187134502924,0.6555555555555556,0.6555555555555556,0.6417112299465241,0.6358974358974359,0.6116504854368932,0.583710407239819,0.5833333333333334,0.5793991416309013,0.5348837209302325,0.5280898876404494,0.4816053511705686,0.4625,0.438953488372093,0.43714285714285717,0.43213296398891965,0.412987012987013,0.40198511166253104,0.39855072463768115,0.36363636363636365,0.3426294820717131,0.3252336448598131,0.3089005235602094,0.30016583747927034,0.2785388127853881,0.2719298245614035,0.2650771388499299,0.26265389876880985,0.2496798975672215,0.2391304347826087,0.2376470588235294,0.2357630979498861,0.2357630979498861,0.22950819672131148,0.21215139442231076,0.19427036705461057,0.19193689745836984,0.17494089834515367,0.15141318977119786,0.14941022280471822,0.1476038338658147,0.1472624292007552,0.13412563667232597,0.1301518438177874,0.11970443349753694,0.11373092926490985,0.09507445589919816,0.0860655737704918,0.07736650485436893,0.06275845293116031,0.059944878272852546,0.04154209284028324,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9516129032258065,0.9516129032258065,0.9104477611940298,0.8888888888888888,0.8717948717948718,0.8625,0.8202247191011236,0.7731958762886598,0.7155963302752294,0.7043478260869566,0.6942148760330579,0.6850393700787402,0.6546762589928058,0.6527777777777778,0.6447368421052632,0.61875,0.6023391812865497,0.5965909090909091,0.5901639344262295,0.5773195876288659,0.5533980582524272,0.5263157894736842,0.5263157894736842,0.5125,0.4846153846153846,0.47601476014760147,0.4414715719063545,0.4231974921630094,0.4011627906976744,0.39385474860335196,0.38666666666666666,0.37468354430379747,0.3719806763285024,0.3719806763285024,0.36027713625866054,0.3258655804480652,0.32270916334661354,0.3044280442804428,0.2847457627118644,0.2835820895522388,0.26165413533834586,0.25578034682080925,0.25,0.24696356275303644,0.23604060913705585,0.22588235294117648,0.22588235294117648,0.22413793103448276,0.22048997772828507,0.20119521912350596,0.18664226898444647,0.183348095659876,0.16894609814963799,0.15627292736610418,0.14361702127659576,0.14285714285714285,0.14096916299559473,0.1391465677179963,0.12903225806451613,0.12527114967462039,0.11527093596059114,0.10957004160887657,0.09163802978235967,0.08299180327868852,0.07463592233009708,0.06056920457309657,0.05787781350482315,0.044463818657367045,0.025242148517757558,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9516129032258065,0.9516129032258065,0.9104477611940298,0.8888888888888888,0.8717948717948718,0.8625,0.8202247191011236,0.7731958762886598,0.6964285714285714,0.6864406779661016,0.6774193548387096,0.6590909090909091,0.6474820143884892,0.6458333333333334,0.6381578947368421,0.6073619631901841,0.5964912280701754,0.5888888888888889,0.5775401069518716,0.5721649484536082,0.5219298245614035,0.5219298245614035,0.5194805194805194,0.4807692307692308,0.4772727272727273,0.4574468085106383,0.4370860927152318,0.40298507462686567,0.39714285714285713,0.39058171745152354,0.384,0.3721518987341772,0.3695652173913043,0.3695652173913043,0.3398268398268398,0.32382892057026474,0.30916030534351147,0.29891304347826086,0.2823529411764706,0.27491961414790994,0.2577777777777778,0.2539454806312769,0.24861878453038674,0.23431498079385404,0.2246376811594203,0.2235294117647059,0.2218390804597701,0.2182628062360802,0.20996818663838812,0.20019920318725098,0.18352730528200537,0.18141980718667836,0.16548463356973994,0.14450474898236093,0.142668428005284,0.14193130265716136,0.14033983637507866,0.13711151736745886,0.1281618887015177,0.11708058793715155,0.11331719128329298,0.09846281678437889,0.0893189430591738,0.07982917214191852,0.06693877551020408,0.05948399426660296,0.04849884526558892,0.04012588512981904,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9516129032258065,0.9516129032258065,0.9104477611940298,0.8888888888888888,0.8717948717948718,0.8625,0.8202247191011236,0.7731958762886598,0.6964285714285714,0.6864406779661016,0.6774193548387096,0.6590909090909091,0.6474820143884892,0.6458333333333334,0.631578947368421,0.5906432748538012,0.5852272727272727,0.5737704918032787,0.5618556701030928,0.5067873303167421,0.5066666666666667,0.5021459227467812,0.4653846153846154,0.4606741573033708,0.43448275862068964,0.41346153846153844,0.3866279069767442,0.38571428571428573,0.37333333333333335,0.36623376623376624,0.35990338164251207,0.35990338164251207,0.3546099290780142,0.33116883116883117,0.31274900398406374,0.297196261682243,0.28272251308900526,0.2752902155887231,0.2557077625570776,0.25,0.24403927068723702,0.2388663967611336,0.2236024844720497,0.21764705882352942,0.21627906976744185,0.2152619589977221,0.2098360655737705,0.1952191235059761,0.18115279048490393,0.17803365810451727,0.1607565011820331,0.14043419267299864,0.13870541611624834,0.13804277381723914,0.13656387665198239,0.13345521023765997,0.12478920741989882,0.11403953370501774,0.11041162227602906,0.09597008724553385,0.08708596948269445,0.0778580814717477,0.0653061224489796,0.058050645007166744,0.046153846153846156,0.03449231195456434,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9516129032258065,0.9516129032258065,0.9104477611940298,0.8888888888888888,0.8717948717948718,0.8625,0.8202247191011236,0.7731958762886598,0.6869565217391305,0.6776859504132231,0.6692913385826772,0.6330935251798561,0.625,0.6118421052631579,0.5730994152046783,0.5657142857142857,0.5454545454545454,0.5412371134020618,0.4888888888888889,0.4868421052631579,0.44357976653696496,0.43820224719101125,0.41379310344827586,0.3942307692307692,0.3691860465116279,0.36857142857142855,0.3546666666666667,0.34430379746835443,0.3414043583535109,0.3414043583535109,0.3130434782608696,0.29282868525896416,0.2767527675276753,0.2593220338983051,0.2508038585209003,0.23909774436090225,0.23410404624277456,0.2292817679558011,0.21510883482714468,0.20652173913043478,0.20588235294117646,0.2045977011494253,0.20155902004454343,0.1890495867768595,0.1712707182320442,0.1692032229185318,0.15446500402252614,0.15069551777434312,0.13432835820895522,0.13276089828269486,0.1322099805573558,0.13089993706733793,0.12797074954296161,0.11973018549747048,0.10947795235681702,0.10605326876513317,0.0922309929372663,0.08373650911797544,0.07547169811320754,0.07008495145631068,0.056920457309657016,0.04561200923787529,0.03324560188391744,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9516129032258065,0.9516129032258065,0.9104477611940298,0.8888888888888888,0.8717948717948718,0.8625,0.8202247191011236,0.7731958762886598,0.6869565217391305,0.6776859504132231,0.6692913385826772,0.6330935251798561,0.625,0.6118421052631579,0.5730994152046783,0.5657142857142857,0.5454545454545454,0.5412371134020618,0.4888888888888889,0.4868421052631579,0.44357976653696496,0.4317343173431734,0.4013377926421405,0.38557993730407525,0.36627906976744184,0.3466666666666667,0.3367088607594937,0.33171912832929784,0.3262411347517731,0.28775510204081634,0.2801556420233463,0.266304347826087,0.25210084033613445,0.23404255319148937,0.2311111111111111,0.22812051649928264,0.22375690607734808,0.20939086294416243,0.20047449584816132,0.19885057471264367,0.19817767653758542,0.1828512396694215,0.16574585635359115,0.1638316920322292,0.14963797264682221,0.14605873261205565,0.13025780189959293,0.1287978863936592,0.12832145171743356,0.12712397734424166,0.12431444241316271,0.1163575042158516,0.10643689812468322,0.10314769975786925,0.08973826339842127,0.08150353554149609,0.07348560079443893,0.06826456310679611,0.055460958404281196,0.044457274826789836,0.02289404167889639,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9516129032258065,0.9516129032258065,0.9104477611940298,0.8888888888888888,0.8717948717948718,0.8625,0.8202247191011236,0.7731958762886598,0.6869565217391305,0.6776859504132231,0.6692913385826772,0.6330935251798561,0.625,0.58125,0.5672514619883041,0.55,0.5360824742268041,0.5121951219512195,0.48444444444444446,0.4723404255319149,0.42066420664206644,0.391304347826087,0.3761755485893417,0.3524355300859599,0.32151898734177214,0.3161764705882353,0.30484988452655887,0.27091633466135456,0.2633587786259542,0.24607329842931938,0.24,0.22340425531914893,0.21929824561403508,0.21458625525946703,0.21052631578947367,0.19751552795031055,0.19217081850533807,0.19080459770114944,0.1870824053452116,0.17031872509960158,0.1566696508504924,0.14700996677740863,0.14084507042253522,0.13426265590608952,0.12285336856010567,0.12248865845755022,0.12113564668769716,0.11430246189917936,0.11024498886414254,0.09901477832512315,0.09431345353675451,0.07903780068728522,0.07172131147540983,0.06576103735720902,0.05278592375366569,0.050694444444444445,0.03493312352478364,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9482758620689655,0.9354838709677419,0.8955223880597015,0.875,0.8589743589743589,0.8214285714285714,0.8089887640449438,0.7142857142857143,0.6299212598425197,0.5899280575539568,0.5833333333333334,0.54375,0.5263157894736842,0.5081967213114754,0.4948453608247423,0.44,0.3968871595330739,0.3723404255319149,0.3576158940397351,0.33134328358208953,0.304,0.28921568627450983,0.28368794326241137,0.2510204081632653,0.245136186770428,0.23369565217391305,0.2218487394957983,0.2066869300911854,0.20444444444444446,0.20229555236728838,0.19433198380566802,0.1826086956521739,0.17793594306049823,0.17701149425287357,0.17371937639198218,0.15836653386454183,0.1459265890778872,0.13704318936877077,0.13145539906103287,0.11601085481682497,0.1141552511415525,0.11309904153354633,0.11131725417439703,0.1035653650254669,0.10086767895878525,0.09104046242774566,0.07532365633581797,0.06825341267063353,0.06504599211563732,0.054693877551020405,0.048733874820831344,0.03883677298311445,0.008199281586756209,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.975609756097561,0.975609756097561,0.9615384615384616,0.9615384615384616,0.9615384615384616,0.9444444444444444,0.9032258064516129,0.8656716417910447,0.8472222222222222,0.8333333333333334,0.825,0.711340206185567,0.5748031496062992,0.539568345323741,0.527027027027027,0.47953216374269003,0.45901639344262296,0.39545454545454545,0.3829787234042553,0.32978723404255317,0.2865671641791045,0.264,0.25,0.21115537848605578,0.20610687022900764,0.188135593220339,0.16666666666666666,0.14980793854033292,0.14492753623188406,0.14367816091954022,0.14350797266514806,0.12848605577689243,0.11691762621789194,0.10641627543035993,0.1012472487160675,0.09197651663405088,0.09085173501577287,0.0831918505942275,0.07389162561576355,0.0635646032405484,0.05805731298846297,0.05263157894736842,0.0491504854368932,0.04013621989783508,0.03151969981238274,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9393939393939394,0.868421052631579,0.8461538461538461,0.8461538461538461,0.8461538461538461,0.8333333333333334,0.7903225806451613,0.7611940298507462,0.7236842105263158,0.7125,0.48031496062992124,0.45323741007194246,0.4370860927152318,0.3942857142857143,0.32727272727272727,0.22388059701492538,0.14130434782608695,0.11187845303867404,0.08677685950413223,0.07705934455270151,0.0695517774343122,0.06131767775603392,0.05627198124267292,0.03883876029815614,0.03483606557377049,0.031856796116504854,0.025,0.004953809077520418,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]],"recall_thresholds":[0.0,0.01,0.02,0.03,0.04,0.05,0.06,0.07,0.08,0.09,0.1,0.11,0.12,0.13,0.14,0.15,0.16,0.17,0.18,0.19,0.2,0.21,0.22,0.23,0.24,0.25,0.26,0.27,0.28,0.29,0.3,0.31,0.32,0.33,0.34,0.35000000000000003,0.36,0.37,0.38,0.39,0.4,0.41000000000000003,0.42,0.43,0.44,0.45,0.46,0.47000000000000003,0.48,0.49,0.5,0.51,0.52,0.53,0.54,0.55,0.56,0.5700000000000001,0.58,0.59,0.6,0.61,0.62,0.63,0.64,0.65,0.66,0.67,0.68,0.6900000000000001,0.7000000000000001,0.71,0.72,0.73,0.74,0.75,0.76,0.77,0.78,0.79,0.8,0.81,0.8200000000000001,0.8300000000000001,0.84,0.85,0.86,0.87,0.88,0.89,0.9,0.91,0.92,0.93,0.9400000000000001,0.9500000000000001,0.96,0.97,0.98,0.99,1.0],"scores":[[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9629714488983154,0.9615183472633362,0.9605504274368286,0.9588898420333862,0.9571018218994141,0.9555457234382629,0.9531269073486328,0.9481960535049438,0.9433715343475342,0.9076800346374512,0.87974613904953,0.8446134328842163,0.8336793184280396,0.8082473278045654,0.7811501026153564,0.7390376329421997,0.7180711030960083,0.6880785822868347,0.6772570610046387,0.6660756468772888,0.6564875245094299,0.640059769153595,0.6213714480400085,0.6026830077171326,0.5962578654289246,0.5664708018302917,0.5504096150398254,0.5445513725280762,0.5356774926185608,0.5271704196929932,0.5125007629394531,0.4921359121799469,0.481460839509964,0.47479113936424255,0.43466997146606445,0.4281533360481262,0.41068172454833984,0.39142918586730957,0.37547633051872253,0.36762404441833496,0.359282910823822,0.3424796164035797,0.328922837972641,0.32525625824928284,0.3003810942173004,0.28375929594039917,0.2715235650539398,0.25922268629074097,0.25030452013015747,0.23297248780727386,0.22520454227924347,0.21885305643081665,0.21617181599140167,0.20599210262298584,0.1984744668006897,0.19511975347995758,0.19228166341781616,0.19017817080020905,0.18525399267673492,0.17422926425933838,0.16283322870731354,0.16059510409832,0.15097030997276306,0.1369762271642685,0.13480252027511597,0.13268029689788818,0.13131868839263916,0.12294713407754898,0.11934226751327515,0.11162718385457993,0.10728315263986588,0.09616993367671967,0.08916086703538895,0.08277712017297745,0.07225973159074783,0.06968650966882706,0.055977463722229004,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7811501026153564,0.7390376329421997,0.694173276424408,0.6790473461151123,0.6660756468772888,0.6564875245094299,0.6329349279403687,0.6149629950523376,0.5988551378250122,0.5786262154579163,0.5619102716445923,0.5497795343399048,0.5403891205787659,0.5274484157562256,0.5125007629394531,0.48913753032684326,0.4780247211456299,0.46633657813072205,0.4330444633960724,0.42489781975746155,0.41068172454833984,0.39142918586730957,0.37489739060401917,0.3630130887031555,0.34822750091552734,0.33368465304374695,0.3280494511127472,0.32532382011413574,0.315093070268631,0.28804418444633484,0.28350386023521423,0.26811912655830383,0.25391218066215515,0.24939848482608795,0.23169970512390137,0.2235763967037201,0.2174646407365799,0.21398881077766418,0.20492784678936005,0.19571982324123383,0.19490286707878113,0.19172120094299316,0.1877792775630951,0.17446237802505493,0.16470730304718018,0.16193658113479614,0.15275368094444275,0.1442631334066391,0.13610313832759857,0.13434408605098724,0.13151021301746368,0.1296055018901825,0.12294713407754898,0.11934226751327515,0.11162718385457993,0.10728315263986588,0.09616993367671967,0.08916086703538895,0.08277712017297745,0.07225973159074783,0.06968650966882706,0.05930357798933983,0.04148801788687706,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7811501026153564,0.7390376329421997,0.6880785822868347,0.6736862063407898,0.6633931398391724,0.6428402066230774,0.6278647184371948,0.6132718324661255,0.5963529944419861,0.5743433833122253,0.5528514981269836,0.5445513725280762,0.5356774926185608,0.5271704196929932,0.49229180812835693,0.4853269159793854,0.4760103225708008,0.43552282452583313,0.4300670623779297,0.4189802408218384,0.40791991353034973,0.3792928457260132,0.36810338497161865,0.359282910823822,0.3471105098724365,0.33272337913513184,0.3276786804199219,0.32525625824928284,0.3005905747413635,0.2879815399646759,0.27462443709373474,0.2644333839416504,0.25238364934921265,0.24327366054058075,0.2279558628797531,0.2220805287361145,0.21730713546276093,0.20599210262298584,0.1984744668006897,0.19511975347995758,0.19228166341781616,0.18838012218475342,0.182417631149292,0.17422926425933838,0.16283322870731354,0.16059510409832,0.15097030997276306,0.1376299411058426,0.13543038070201874,0.13392850756645203,0.13145868480205536,0.12878748774528503,0.12242215871810913,0.11382649093866348,0.110428586602211,0.10141030699014664,0.09445390105247498,0.08708543330430984,0.07713226974010468,0.07143411040306091,0.06280248612165451,0.055977463722229004,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7811501026153564,0.7390376329421997,0.6880785822868347,0.6736862063407898,0.6633931398391724,0.6428402066230774,0.6278647184371948,0.6132718324661255,0.5962578654289246,0.5664708018302917,0.5504096150398254,0.5403891205787659,0.5274484157562256,0.49229180812835693,0.4853269159793854,0.47479113936424255,0.43466997146606445,0.4281533360481262,0.4164971709251404,0.39566493034362793,0.37547633051872253,0.36762404441833496,0.3482542037963867,0.3424796164035797,0.328922837972641,0.325533002614975,0.31834208965301514,0.3003810942173004,0.28375929594039917,0.2715235650539398,0.25922268629074097,0.25030452013015747,0.23297248780727386,0.22520454227924347,0.21885305643081665,0.21398881077766418,0.20184257626533508,0.19554291665554047,0.19373691082000732,0.19017817080020905,0.18525399267673492,0.17446237802505493,0.16470730304718018,0.16193658113479614,0.15097030997276306,0.1376299411058426,0.13543038070201874,0.13392850756645203,0.13145868480205536,0.12878748774528503,0.12242215871810913,0.11382649093866348,0.110428586602211,0.10141030699014664,0.09445390105247498,0.08708543330430984,0.07713226974010468,0.07143411040306091,0.06191325560212135,0.051841989159584045,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7811501026153564,0.7390376329421997,0.6858900785446167,0.6663841009140015,0.659410297870636,0.6329349279403687,0.6132718324661255,0.5962578654289246,0.5664708018302917,0.5504096150398254,0.5356774926185608,0.5271704196929932,0.4921359121799469,0.4780247211456299,0.43552282452583313,0.4281533360481262,0.4164971709251404,0.39566493034362793,0.37547633051872253,0.36762404441833496,0.34822750091552734,0.33368465304374695,0.3280494511127472,0.32532382011413574,0.3005905747413635,0.28350386023521423,0.26811912655830383,0.25391218066215515,0.24327366054058075,0.23169970512390137,0.2235763967037201,0.2174646407365799,0.20599210262298584,0.1984744668006897,0.19511975347995758,0.19228166341781616,0.18838012218475342,0.17932172119617462,0.16553345322608948,0.16266736388206482,0.15275368094444275,0.1490997076034546,0.1376299411058426,0.13543038070201874,0.13392850756645203,0.13145868480205536,0.12878748774528503,0.12242215871810913,0.11382649093866348,0.110428586602211,0.10141030699014664,0.09445390105247498,0.08751267939805984,0.08277712017297745,0.07225973159074783,0.06280248612165451,0.051841989159584045,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7811501026153564,0.7390376329421997,0.6858900785446167,0.6663841009140015,0.659410297870636,0.6329349279403687,0.6132718324661255,0.5962578654289246,0.5664708018302917,0.5504096150398254,0.5356774926185608,0.5271704196929932,0.4921359121799469,0.4780247211456299,0.43552282452583313,0.42489781975746155,0.41068172454833984,0.39142918586730957,0.37489739060401917,0.34822750091552734,0.33368465304374695,0.3276786804199219,0.31834208965301514,0.28804418444633484,0.27871719002723694,0.2644333839416504,0.25238364934921265,0.23297248780727386,0.2279558628797531,0.2220805287361145,0.21730713546276093,0.20492784678936005,0.19571982324123383,0.19373691082000732,0.19017817080020905,0.17932172119617462,0.16553345322608948,0.16266736388206482,0.15275368094444275,0.1490997076034546,0.1376299411058426,0.13543038070201874,0.13392850756645203,0.13145868480205536,0.12878748774528503,0.12242215871810913,0.11382649093866348,0.110428586602211,0.10141030699014664,0.09445390105247498,0.08751267939805984,0.08277712017297745,0.07225973159074783,0.06280248612165451,0.04148801788687706,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7811501026153564,0.7390376329421997,0.6858900785446167,0.6663841009140015,0.659410297870636,0.6329349279403687,0.6132718324661255,0.5786262154579163,0.5619102716445923,0.5432311296463013,0.5320197343826294,0.5125149488449097,0.48913753032684326,0.4718821346759796,0.42489781975746155,0.41068172454833984,0.39142918586730957,0.36810338497161865,0.33368465304374695,0.3276786804199219,0.315093070268631,0.28375929594039917,0.27462443709373474,0.25922268629074097,0.25030452013015747,0.2326257973909378,0.22520454227924347,0.21885305643081665,0.21398881077766418,0.20184257626533508,0.19554291665554047,0.19228166341781616,0.1877792775630951,0.17422926425933838,0.16283322870731354,0.15503786504268646,0.15020263195037842,0.1442631334066391,0.13543038070201874,0.13392850756645203,0.13145868480205536,0.12556064128875732,0.12133629620075226,0.11162718385457993,0.10728315263986588,0.09616993367671967,0.08916086703538895,0.08370442688465118,0.07249525189399719,0.07006561011075974,0.055977463722229004,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9456404447555542,0.9076800346374512,0.8658453226089478,0.8336793184280396,0.8009905815124512,0.7778369784355164,0.7180711030960083,0.6633931398391724,0.6329349279403687,0.6132718324661255,0.5786262154579163,0.5528514981269836,0.5403891205787659,0.5271704196929932,0.4853269159793854,0.43552282452583313,0.4189802408218384,0.40791991353034973,0.3792928457260132,0.3471105098724365,0.3280494511127472,0.31834208965301514,0.28804418444633484,0.27871719002723694,0.2644333839416504,0.25238364934921265,0.23297248780727386,0.2279558628797531,0.2220805287361145,0.21398881077766418,0.20184257626533508,0.19554291665554047,0.19228166341781616,0.1877792775630951,0.17422926425933838,0.16283322870731354,0.15503786504268646,0.15020263195037842,0.1376299411058426,0.13480252027511597,0.13268029689788818,0.1296055018901825,0.12294713407754898,0.11934226751327515,0.11010704934597015,0.09797786176204681,0.0904771164059639,0.08708543330430984,0.07713226974010468,0.07143411040306091,0.06191325560212135,0.015630995854735374,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9591854214668274,0.9585354924201965,0.9556007981300354,0.9538430571556091,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7390376329421997,0.659410297870636,0.6278647184371948,0.6026830077171326,0.5619102716445923,0.5403891205787659,0.49229180812835693,0.4718821346759796,0.4189802408218384,0.3792928457260132,0.3471105098724365,0.3276786804199219,0.28375929594039917,0.27462443709373474,0.25391218066215515,0.22520454227924347,0.20599210262298584,0.1984744668006897,0.19373691082000732,0.19017817080020905,0.17422926425933838,0.16193658113479614,0.15097030997276306,0.1442631334066391,0.13434408605098724,0.13145868480205536,0.12294713407754898,0.11162718385457993,0.10141030699014664,0.09445390105247498,0.08751267939805984,0.08277712017297745,0.07225973159074783,0.06191325560212135,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9653592705726624,0.9615682363510132,0.9595380425453186,0.9585354924201965,0.9556007981300354,0.9538430571556091,0.9456404447555542,0.9076800346374512,0.8443565368652344,0.8157678842544556,0.659410297870636,0.6278647184371948,0.5963529944419861,0.5504096150398254,0.49229180812835693,0.3792928457260132,0.2644333839416504,0.21730713546276093,0.17932172119617462,0.16193658113479614,0.1490997076034546,0.13480252027511597,0.12556064128875732,0.09797786176204681,0.08916086703538895,0.08277712017297745,0.07006561011075974,0.019777249544858932,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]]},"title":{"ap":38.745347586625584,"ap50":50.12263329992115,"ap70":40.83531017420843,"ap90":29.40280420667828,"ar100":74.24749163879598}}},"independent_final_test":false,"production_promotion_allowed":false,"schema":"ax-doclayout.h51-descriptive-title-metrics/1","step":1024}
evaluation.json ADDED
@@ -0,0 +1,255 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "arms": {
3
+ "H5": {
4
+ "counts": {
5
+ "fn": 153,
6
+ "fp": 229,
7
+ "iou": 0.5,
8
+ "precision": 38.93333333333333,
9
+ "recall": 48.82943143812709,
10
+ "threshold": 0.3,
11
+ "tp": 146
12
+ },
13
+ "panels": {
14
+ "fin_val": {
15
+ "ap": 91.58560936970301,
16
+ "ap50": 96.42307172412028,
17
+ "ap70": 95.68967016952253,
18
+ "ap90": 89.04728335091869,
19
+ "ar100": 97.18354430379745,
20
+ "ignore_regions_policy": "historical_d5_unfiltered",
21
+ "independent_final_test": false,
22
+ "pages": 256,
23
+ "per_class_ap": {
24
+ "9": 91.58560936970301
25
+ },
26
+ "taxonomy": "ax-document-unified-25/1"
27
+ },
28
+ "financial_val": {
29
+ "ap": 61.51128145000217,
30
+ "ap50": 74.86946506958374,
31
+ "ap70": 68.45692502635225,
32
+ "ap90": 43.322561206462275,
33
+ "ar100": 83.24266432330124,
34
+ "ignore_regions_policy": "historical_d5_unfiltered",
35
+ "independent_final_test": false,
36
+ "pages": 1745,
37
+ "per_class_ap": {
38
+ "1": 50.27375835762371,
39
+ "10": 86.8442236905189,
40
+ "11": 21.853779071996104,
41
+ "2": 21.565227712119672,
42
+ "3": -1.0,
43
+ "4": 86.21879623969116,
44
+ "5": 63.222417086128445,
45
+ "6": 48.35856172317618,
46
+ "7": 81.51771563437424,
47
+ "8": 65.42208145342498,
48
+ "9": 89.8362535309683
49
+ },
50
+ "taxonomy": "ax-document-unified-25/1"
51
+ },
52
+ "gold_val": {
53
+ "ap": 70.65715440191167,
54
+ "ap50": 88.40568243846039,
55
+ "ap70": 78.13845865429131,
56
+ "ap90": 50.450114112981545,
57
+ "ar100": 82.83261306670309,
58
+ "ignore_regions_policy": "historical_d5_unfiltered",
59
+ "independent_final_test": false,
60
+ "pages": 6489,
61
+ "per_class_ap": {
62
+ "1": 86.97437605372829,
63
+ "10": 84.58897292266664,
64
+ "11": 35.963737455625406,
65
+ "2": 70.84972376935531,
66
+ "3": 66.0621205795928,
67
+ "4": 86.0096104111741,
68
+ "5": 53.05098211411177,
69
+ "6": 56.16971374829491,
70
+ "7": 86.3866260466923,
71
+ "8": 67.48086426451377,
72
+ "9": 83.69197105527309
73
+ },
74
+ "taxonomy": "ax-document-unified-25/1"
75
+ }
76
+ },
77
+ "title": {
78
+ "ap": 35.963737455625406,
79
+ "ap50": 45.82497853510442,
80
+ "ap70": 37.919540471954086,
81
+ "ap90": 27.58934006257302,
82
+ "ar100": 62.943143812709025
83
+ }
84
+ },
85
+ "H51-control": {
86
+ "counts": {
87
+ "fn": 147,
88
+ "fp": 232,
89
+ "iou": 0.5,
90
+ "precision": 39.583333333333336,
91
+ "recall": 50.836120401337794,
92
+ "threshold": 0.3,
93
+ "tp": 152
94
+ },
95
+ "panels": {
96
+ "fin_val": {
97
+ "ap": 91.73710137237188,
98
+ "ap50": 96.4099632632333,
99
+ "ap70": 95.72830310105967,
100
+ "ap90": 89.01546582174996,
101
+ "ar100": 97.31012658227849,
102
+ "ignore_regions_policy": "historical_d5_unfiltered",
103
+ "independent_final_test": false,
104
+ "pages": 256,
105
+ "per_class_ap": {
106
+ "9": 91.73710137237188
107
+ },
108
+ "taxonomy": "ax-document-unified-25/1"
109
+ },
110
+ "financial_val": {
111
+ "ap": 61.54451332090731,
112
+ "ap50": 74.82347437893793,
113
+ "ap70": 68.37143078364227,
114
+ "ap90": 43.45150000241278,
115
+ "ar100": 83.51945585499091,
116
+ "ignore_regions_policy": "historical_d5_unfiltered",
117
+ "independent_final_test": false,
118
+ "pages": 1745,
119
+ "per_class_ap": {
120
+ "1": 50.790307872052466,
121
+ "10": 86.95649329534332,
122
+ "11": 21.537754862532495,
123
+ "2": 21.089752984835016,
124
+ "3": -1.0,
125
+ "4": 86.26630590510274,
126
+ "5": 63.45967663532532,
127
+ "6": 48.37271223360353,
128
+ "7": 81.63817745625849,
129
+ "8": 65.42434020637644,
130
+ "9": 89.90961175764326
131
+ },
132
+ "taxonomy": "ax-document-unified-25/1"
133
+ },
134
+ "gold_val": {
135
+ "ap": 71.12138935941007,
136
+ "ap50": 88.67129396706581,
137
+ "ap70": 78.75562209735875,
138
+ "ap90": 50.94979086232245,
139
+ "ar100": 83.49783844438394,
140
+ "ignore_regions_policy": "historical_d5_unfiltered",
141
+ "independent_final_test": false,
142
+ "pages": 6489,
143
+ "per_class_ap": {
144
+ "1": 87.04700605626007,
145
+ "10": 84.91962874561692,
146
+ "11": 37.09773755641038,
147
+ "2": 70.98562257535825,
148
+ "3": 66.03273966396873,
149
+ "4": 86.30603620785666,
150
+ "5": 54.172316702963194,
151
+ "6": 57.063027563254366,
152
+ "7": 86.45057247965717,
153
+ "8": 68.17739410145994,
154
+ "9": 84.08320130070514
155
+ },
156
+ "taxonomy": "ax-document-unified-25/1"
157
+ }
158
+ },
159
+ "title": {
160
+ "ap": 37.09773755641038,
161
+ "ap50": 47.67067642108576,
162
+ "ap70": 39.006786088722876,
163
+ "ap90": 28.09417805581423,
164
+ "ar100": 68.2943143812709
165
+ }
166
+ },
167
+ "H51-title": {
168
+ "counts": {
169
+ "fn": 131,
170
+ "fp": 296,
171
+ "iou": 0.5,
172
+ "precision": 36.206896551724135,
173
+ "recall": 56.187290969899664,
174
+ "threshold": 0.3,
175
+ "tp": 168
176
+ },
177
+ "panels": {
178
+ "fin_val": {
179
+ "ap": 91.57739593169711,
180
+ "ap50": 96.39212272259813,
181
+ "ap70": 95.6720891685565,
182
+ "ap90": 88.44809936812516,
183
+ "ar100": 97.12025316455696,
184
+ "ignore_regions_policy": "historical_d5_unfiltered",
185
+ "independent_final_test": false,
186
+ "pages": 256,
187
+ "per_class_ap": {
188
+ "9": 91.57739593169711
189
+ },
190
+ "taxonomy": "ax-document-unified-25/1"
191
+ },
192
+ "financial_val": {
193
+ "ap": 61.73305632696384,
194
+ "ap50": 74.96501865247365,
195
+ "ap70": 68.85316694919942,
196
+ "ap90": 43.47744892431575,
197
+ "ar100": 83.61329149193345,
198
+ "ignore_regions_policy": "historical_d5_unfiltered",
199
+ "independent_final_test": false,
200
+ "pages": 1745,
201
+ "per_class_ap": {
202
+ "1": 50.78315145536768,
203
+ "10": 87.04993624291704,
204
+ "11": 22.668975296494782,
205
+ "2": 21.06518949188169,
206
+ "3": -1.0,
207
+ "4": 86.4342933581353,
208
+ "5": 63.68508463365829,
209
+ "6": 48.562555445664245,
210
+ "7": 81.62495775148074,
211
+ "8": 65.49366226902261,
212
+ "9": 89.96275732501599
213
+ },
214
+ "taxonomy": "ax-document-unified-25/1"
215
+ },
216
+ "gold_val": {
217
+ "ap": 71.53267127947552,
218
+ "ap50": 88.96970146715404,
219
+ "ap70": 79.30542557035115,
220
+ "ap90": 51.442965386769316,
221
+ "ar100": 84.26815515047466,
222
+ "ignore_regions_policy": "historical_d5_unfiltered",
223
+ "independent_final_test": false,
224
+ "pages": 6489,
225
+ "per_class_ap": {
226
+ "1": 87.08961007399112,
227
+ "10": 85.14502829116108,
228
+ "11": 38.745347586625584,
229
+ "2": 71.23827368382588,
230
+ "3": 65.97418621206323,
231
+ "4": 86.56001042643845,
232
+ "5": 54.89541594216855,
233
+ "6": 57.75922516457215,
234
+ "7": 86.42092276593523,
235
+ "8": 68.62054515710344,
236
+ "9": 84.41081877034607
237
+ },
238
+ "taxonomy": "ax-document-unified-25/1"
239
+ }
240
+ },
241
+ "title": {
242
+ "ap": 38.745347586625584,
243
+ "ap50": 50.12263329992115,
244
+ "ap70": 40.83531017420843,
245
+ "ap90": 29.40280420667828,
246
+ "ar100": 74.24749163879598
247
+ }
248
+ }
249
+ },
250
+ "extra_class_accuracy_measured": false,
251
+ "frozen_numerical_screen_passed": false,
252
+ "independent_final_test": false,
253
+ "schema": "ax-doclayout.h51-v15-evaluation/1",
254
+ "second_seed_reproducibility_established": false
255
+ }
export-receipt.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"all_tensors_exact_after_reload":true,"checkpoint_sha256":"44b75b2ca14d7d4756ca51d402d470d069f17ee99145717e1994549b32ef87d2","completed_updates":1024,"execution_provenance":{"changes":"immutable encoded source RAM cache and ordered four-thread decoding; input tensors and targets verified exact; model/loss/EMA/optimizer unchanged","core_source_identity":{"heron_finance.py":"0f14c5133b8a98e37f98ff01209372d363ac1b76e749ba9df9a468bda00f4b0d","heron_finance_data.py":"03490e911c888429049a386d0e16ca6827e79a8cbd6cab5556c526f89b44bf60","heron_finance_loss.py":"51169af0e72ede427682d36e0a911b61af90e00c0c809fdab23e315c0a66973a","heron_finance_run.py":"13bccf10b14b2ed5a4bb936a992c92ae0107c9e402b93220de0349ed0af2ca42","heron_finance_title.py":"002d70aab9367480f53e1ea0d4188476124cea5134db877da9d996a01efa0193","heron_finance_title_review.py":"febdfc33f8824c00a70d2d1d9adc35c10ec87c510a37d34d2b5c00bac79cf84c"},"decode_helper_sha256":"c6b2641cf1f35fef31e94ad709193970655c30deddea66a6326fa178a5542038","decode_proof_sha256":"5db24673bdc42dea70c7e3852971d41f16e31be6856242f2c92b8a295e34b939","wrapper_sha256":"6bcc65021922a3e7ced400a96b9eaac2f315892e3bc501f7c9b0b9bb81ae50ce"},"files":{"config.json":{"bytes":3263,"sha256":"7691e69a4e4cb70416c2e12bbefea3a90671790226b2c0d22ede944c48e11f05"},"model.safetensors":{"bytes":171658996,"sha256":"d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e"},"preprocessor_config.json":{"bytes":444,"sha256":"cd38cd59999e7a95d68e487fbe5132df3d4e5c32a0836add57e6126ba0c4eaf1"},"sdk-taxonomy.json":{"bytes":3206,"sha256":"81e7908ee7c8bbb6e00905a98ed43c988128faa38c0b1d55d20948f78e40e351"}},"manifest_sha256":"07f489a82441de50d699ee62923003d161733593ca2f40a7ea9049dbdf2bdcb8","public_contract_or_hub_pin_changed":false,"published":false,"schema":"ax-doclayout.owner-selected-ema-export/1","source_identity":{"heron_finance.py":"0f14c5133b8a98e37f98ff01209372d363ac1b76e749ba9df9a468bda00f4b0d","heron_finance_data.py":"03490e911c888429049a386d0e16ca6827e79a8cbd6cab5556c526f89b44bf60","heron_finance_loss.py":"51169af0e72ede427682d36e0a911b61af90e00c0c809fdab23e315c0a66973a","heron_finance_run.py":"13bccf10b14b2ed5a4bb936a992c92ae0107c9e402b93220de0349ed0af2ca42","heron_finance_title.py":"002d70aab9367480f53e1ea0d4188476124cea5134db877da9d996a01efa0193","heron_finance_title_review.py":"febdfc33f8824c00a70d2d1d9adc35c10ec87c510a37d34d2b5c00bac79cf84c"},"stage":"H51-title","state_dict_entries":818,"synthetic_forward_exact_after_reload":true,"title_plan_sha256":"408478883c2ec34f1fd65c61ae6f23d728c658c0981a538bca77d7fd63256a07"}
frozen-numerical-screen.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"analysis_source_sha256":"9e890beec165b2ab843a6f456efed830ac68217bc77d27282405994a97e74aec","changes_pp":{"H5/fin_val/ap":-0.008213438005896023,"H5/fin_val/ap90":-0.5991839827935337,"H5/financial_val/ap":0.22177487696166764,"H5/gold_val/ap":0.8755168775638538,"H5/gold_val/class_1":0.11523402026283236,"H5/gold_val/class_10":0.5560553684944409,"H5/gold_val/class_2":0.3885499144705733,"H5/gold_val/class_3":-0.08793436752957007,"H5/gold_val/class_4":0.5504000152643584,"H5/gold_val/class_5":1.8444338280567791,"H5/gold_val/class_6":1.5895114162772401,"H5/gold_val/class_7":0.03429671924293132,"H5/gold_val/class_8":1.1396808925896664,"H5/gold_val/class_9":0.7188477150729824,"H5/title_precision":-2.726436781609195,"H51-control/fin_val/ap":-0.15970544067477022,"H51-control/fin_val/ap90":-0.5673664536247998,"H51-control/financial_val/ap":0.18854300605652696,"H51-control/gold_val/ap":0.4112819200654485,"H51-control/gold_val/class_1":0.04260401773105116,"H51-control/gold_val/class_10":0.22539954554416397,"H51-control/gold_val/class_2":0.2526511084676315,"H51-control/gold_val/class_3":-0.05855345190549599,"H51-control/gold_val/class_4":0.2539742185817886,"H51-control/gold_val/class_5":0.7230992392053537,"H51-control/gold_val/class_6":0.6961976013177846,"H51-control/gold_val/class_7":-0.029649713721937587,"H51-control/gold_val/class_8":0.4431510556434972,"H51-control/gold_val/class_9":0.3276174696409271,"H51-control/title_precision":-3.3764367816092005},"checks":{"H5/fin_val/ap":true,"H5/fin_val/ap90":false,"H5/financial_val/ap":true,"H5/gold_val/ap":true,"H5/gold_val/class_1":true,"H5/gold_val/class_10":true,"H5/gold_val/class_2":true,"H5/gold_val/class_3":true,"H5/gold_val/class_4":true,"H5/gold_val/class_5":true,"H5/gold_val/class_6":true,"H5/gold_val/class_7":true,"H5/gold_val/class_8":true,"H5/gold_val/class_9":true,"H5/title_precision":false,"H51-control/fin_val/ap":true,"H51-control/fin_val/ap90":false,"H51-control/financial_val/ap":true,"H51-control/gold_val/ap":true,"H51-control/gold_val/class_1":true,"H51-control/gold_val/class_10":true,"H51-control/gold_val/class_2":true,"H51-control/gold_val/class_3":true,"H51-control/gold_val/class_4":true,"H51-control/gold_val/class_5":true,"H51-control/gold_val/class_6":true,"H51-control/gold_val/class_7":true,"H51-control/gold_val/class_8":true,"H51-control/gold_val/class_9":true,"H51-control/title_precision":false,"title_ap_ci_positive":true,"title_ap_gain":false},"evaluation_sha256":{"H5/fin_val":"05d0097b186bd93f1d9a4527346188562203852d14c396fef6499ad183ec32f6","H5/financial_val":"1e9126de8b7ae96708b2e2bfaf399fb4f2c4bb948e2e2593480e67334c8d5673","H5/gold_val":"609ed589daa14f08517964701d67137bc2514ead69658109209fcd85ee6bdca3","H51-control/fin_val":"b5a523c1d30bc17353da67c1b68521320edc438ef31472faef1246c2dfeb168e","H51-control/financial_val":"7a6cb57a1a62b3e610bb476ab596adc3fcb5e1e128b5ff1015075121fc7c8826","H51-control/gold_val":"b5d3197836faddb583db6c06fdd23bd3f4406d592dbd059b3cf210085b3af258","H51-title/fin_val":"a3618b3b8e4b7536f499394e6ad08d46f9e44f68528e9d5ed20cfc42c136f088","H51-title/financial_val":"27bbfcdc7e6a0d5704d64631de0022ea941273d9e487a5a88b10fd0e39e26d91","H51-title/gold_val":"ec2ca77515304adf99580a7a65850afda8040bd179f2d3123967d88b4bd69c43"},"extra_class_quality_measured":false,"independent_final_test":false,"next_step_if_passed":"paired second seed and owner retention review","passed":false,"production_promotion_allowed":false,"schema":"ax-doclayout.h51-final-screen/1","title_counts":{"H5":{"fn":153,"fp":229,"iou":0.5,"precision":38.93333333333333,"recall":48.82943143812709,"threshold":0.3,"tp":146},"H51-control":{"fn":147,"fp":232,"iou":0.5,"precision":39.583333333333336,"recall":50.836120401337794,"threshold":0.3,"tp":152},"H51-title":{"fn":131,"fp":296,"iou":0.5,"precision":36.206896551724135,"recall":56.187290969899664,"threshold":0.3,"tp":168}},"title_interval":{"ci95_pp":[0.4850736373909948,2.8211530543936187],"control_title_ap":37.09773755641038,"delta_pp":1.6476100302152048,"families":160,"grouping_independence_verified":false,"independent_final_test":false,"resamples":1000,"seed":17,"status":"estimated","treatment_title_ap":38.745347586625584},"title_plan_sha256":"408478883c2ec34f1fd65c61ae6f23d728c658c0981a538bca77d7fd63256a07"}
model-selection.json ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "completed_updates": 1024,
3
+ "decision": "take it; owner considers improvement good",
4
+ "frozen_numerical_screen_passed": false,
5
+ "model_identity": "AutomatosX/AXDocLayout-M-v1.5-CUDA-TF32",
6
+ "model_version": "1.5",
7
+ "numeric_gate_reclassified_as_passed": false,
8
+ "public_loader_pin_changed": false,
9
+ "publication_authority": "owner explicitly requested this exact Hub repository",
10
+ "published": true,
11
+ "published_v14_changed": false,
12
+ "release_selected": true,
13
+ "schema": "ax-doclayout.owner-model-selection/1",
14
+ "sdk_class_ids": [
15
+ 1,
16
+ 2,
17
+ 3,
18
+ 4,
19
+ 5,
20
+ 6,
21
+ 7,
22
+ 8,
23
+ 9,
24
+ 10,
25
+ 11,
26
+ 12,
27
+ 13,
28
+ 14,
29
+ 15,
30
+ 16,
31
+ 17
32
+ ],
33
+ "selected": true,
34
+ "selected_training_stage": "H51-title",
35
+ "selection_authority": "owner directive after reported Title AP, precision, recall and table AP90 tradeoffs",
36
+ "source_checkpoint_sha256": "44b75b2ca14d7d4756ca51d402d470d069f17ee99145717e1994549b32ef87d2",
37
+ "source_git_revision": "adce6c2ddfc1977956fc180463ab221f780c8271",
38
+ "unsupported_sdk_class_ids": [
39
+ 18,
40
+ 19,
41
+ 20,
42
+ 21,
43
+ 22,
44
+ 23,
45
+ 24,
46
+ 25
47
+ ],
48
+ "weights_sha256": "d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e"
49
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e
3
+ size 171658996
original-cpu-parity.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"all_predictions_exact":true,"boxes_at_030":2405,"device":"cpu","elapsed_seconds":41.683596957998816,"example_sha256":"e7d60ca02f40ea2eb973c46ae6aa452f0d820bf8cdd54a153465f9437f26260d","new_example_cuda_rerun":false,"pages":150,"raw_detections":45000,"review_manifest_sha256":"8083a57308277239d5e5de7acd7a0fec4635bc23c1b3238bb2fd47d35b1b2e72","schema":"ax-doclayout.selected-bundle-cpu-parity/1","torch":"2.12.1","transformers":"4.53.3","weights_sha256":"d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e"}
predict_image.py ADDED
@@ -0,0 +1,131 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ """Pinned owner-selected H5.1 raster inference example; native model outputs map to AX PDF SDK IDs."""
2
+ from __future__ import annotations
3
+
4
+ import argparse
5
+ import hashlib
6
+ import importlib.metadata
7
+ import json
8
+ import math
9
+ from pathlib import Path
10
+
11
+ import torch
12
+ from PIL import Image
13
+ from transformers import RTDetrImageProcessor, RTDetrV2ForObjectDetection
14
+
15
+ REPO_ID = 'AutomatosX/AXDocLayout-M-v1.5-CUDA-TF32'
16
+ CORE_HASHES = {'config.json': '7691e69a4e4cb70416c2e12bbefea3a90671790226b2c0d22ede944c48e11f05', 'model.safetensors': 'd0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e', 'preprocessor_config.json': 'cd38cd59999e7a95d68e487fbe5132df3d4e5c32a0836add57e6126ba0c4eaf1', 'sdk-taxonomy.json': '81e7908ee7c8bbb6e00905a98ed43c988128faa38c0b1d55d20948f78e40e351'}
17
+
18
+
19
+ def digest(path: Path) -> str:
20
+ with path.open('rb') as stream:
21
+ return hashlib.file_digest(stream, 'sha256').hexdigest()
22
+
23
+
24
+ def validate_threshold(value: float) -> float:
25
+ if isinstance(value, bool) or not isinstance(value, (float, int)):
26
+ raise TypeError('score_threshold_invalid')
27
+ if not math.isfinite(value) or not 0 <= value <= 1:
28
+ raise ValueError('score_threshold_invalid')
29
+ return float(value)
30
+
31
+
32
+ def load_bundle(*, model_dir: Path, device: str = 'cuda') -> tuple:
33
+ """Load exact local files with an explicit device; never fall back from CUDA."""
34
+ if device not in ('cuda', 'cpu'):
35
+ raise ValueError('device_invalid')
36
+ if importlib.metadata.version('transformers') != '4.53.3':
37
+ raise RuntimeError('transformers_version_mismatch')
38
+ if torch.__version__.split('+')[0] != '2.12.1':
39
+ raise RuntimeError('torch_version_mismatch')
40
+ for name, expected in CORE_HASHES.items():
41
+ path = model_dir / name
42
+ if not path.is_file() or digest(path) != expected:
43
+ raise RuntimeError('model_bundle_hash_mismatch')
44
+ if device == 'cuda':
45
+ if not torch.cuda.is_available():
46
+ raise RuntimeError('cuda_required_no_cpu_fallback')
47
+ if torch.cuda.get_device_capability()[0] < 8:
48
+ raise RuntimeError('ampere_or_newer_required_for_tf32_profile')
49
+ # Preserve the actual three-panel CUDA evaluation configuration.
50
+ torch.backends.cuda.matmul.allow_tf32 = False
51
+ torch.backends.cudnn.allow_tf32 = True
52
+ model, loading = RTDetrV2ForObjectDetection.from_pretrained(
53
+ model_dir, local_files_only=True, output_loading_info=True,
54
+ )
55
+ if any(loading[key] for key in ('missing_keys', 'unexpected_keys', 'mismatched_keys', 'error_msgs')):
56
+ raise RuntimeError('model_state_mismatch')
57
+ binding = json.loads((model_dir / 'sdk-taxonomy.json').read_text())
58
+ if binding['taxonomy'] != 'ax-document-unified-25/1' or binding['model_sdk_class_ids'] != list(range(1, 18)):
59
+ raise RuntimeError('sdk_binding_mismatch')
60
+ definitions = {row['id']: row for row in binding['classes']}
61
+ for native, sdk in binding['native_index_to_sdk_id'].items():
62
+ if model.config.id2label[int(native)] != definitions[sdk]['name']:
63
+ raise RuntimeError('sdk_name_mismatch')
64
+ processor = RTDetrImageProcessor.from_pretrained(model_dir, local_files_only=True)
65
+ return model.float().to(device).eval(), processor, binding
66
+
67
+
68
+ def predict_rgb(*, rgb: Image.Image, model: object, processor: object,
69
+ binding: dict, threshold: float = .30) -> list[dict]:
70
+ """Return original-raster xyxy boxes with SDK IDs1-17 and finite scores."""
71
+ threshold = validate_threshold(threshold)
72
+ if not isinstance(rgb, Image.Image) or rgb.mode != 'RGB' or min(rgb.size) < 1:
73
+ raise ValueError('decoded_rgb_image_required')
74
+ device = next(model.parameters()).device
75
+ inputs = processor(images=rgb, return_tensors='pt')['pixel_values']
76
+ if tuple(inputs.shape) != (1, 3, 640, 640):
77
+ raise RuntimeError('preprocessor_shape_mismatch')
78
+ with torch.inference_mode():
79
+ outputs = model(pixel_values=inputs.to(device))
80
+ predictions = processor.post_process_object_detection(
81
+ outputs, threshold=0.,
82
+ target_sizes=torch.tensor([[rgb.height, rgb.width]], device=device),
83
+ )[0]
84
+ definitions = {row['id']: row['name'] for row in binding['classes']}
85
+ result = []
86
+ for native, score, box in zip(predictions['labels'].tolist(), predictions['scores'].tolist(),
87
+ predictions['boxes'].tolist(), strict=True):
88
+ if not all(math.isfinite(v) for v in [score, *box]) or not 0 <= score <= 1:
89
+ raise RuntimeError('nonfinite_or_invalid_prediction')
90
+ if score < threshold:
91
+ continue
92
+ sdk = binding['native_index_to_sdk_id'][str(native)]
93
+ clipped = [min(max(box[0], 0.), rgb.width), min(max(box[1], 0.), rgb.height),
94
+ min(max(box[2], 0.), rgb.width), min(max(box[3], 0.), rgb.height)]
95
+ if clipped[2] <= clipped[0] or clipped[3] <= clipped[1]:
96
+ continue
97
+ result.append({'class_id': sdk, 'class_name': definitions[sdk],
98
+ 'score': score, 'bbox_xyxy': clipped})
99
+ return result
100
+
101
+
102
+ def main() -> None:
103
+ parser = argparse.ArgumentParser(description=__doc__)
104
+ parser.add_argument('--model-dir', type=Path, required=True)
105
+ parser.add_argument('--image', type=Path, required=True)
106
+ parser.add_argument('--output', type=Path, required=True)
107
+ parser.add_argument('--device', choices=('cuda', 'cpu'), default='cuda')
108
+ parser.add_argument('--threshold', type=float, default=.30)
109
+ args = parser.parse_args()
110
+ validate_threshold(args.threshold)
111
+ if args.output.exists():
112
+ raise RuntimeError('output_already_exists')
113
+ try:
114
+ with Image.open(args.image) as image:
115
+ if image.format not in ('PNG', 'JPEG', 'TIFF', 'WEBP', 'BMP'):
116
+ raise ValueError('raster_format_required')
117
+ rgb = image.convert('RGB')
118
+ except (OSError, ValueError):
119
+ raise RuntimeError('raster_image_read_failed') from None
120
+ model, processor, binding = load_bundle(model_dir=args.model_dir, device=args.device)
121
+ detections = predict_rgb(rgb=rgb, model=model, processor=processor,
122
+ binding=binding, threshold=args.threshold)
123
+ result = {'model_id': REPO_ID, 'model_sha256': CORE_HASHES['model.safetensors'],
124
+ 'taxonomy': binding['taxonomy'], 'width': rgb.width, 'height': rgb.height,
125
+ 'coordinate_space': 'original-raster-pixel-xyxy', 'device': args.device,
126
+ 'score_threshold': args.threshold, 'detections': detections}
127
+ args.output.write_text(json.dumps(result, sort_keys=True, allow_nan=False) + '\n')
128
+
129
+
130
+ if __name__ == '__main__':
131
+ main()
preprocessor_config.json ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "do_convert_annotations": true,
3
+ "do_normalize": false,
4
+ "do_pad": false,
5
+ "do_rescale": true,
6
+ "do_resize": true,
7
+ "format": "coco_detection",
8
+ "image_mean": [
9
+ 0.485,
10
+ 0.456,
11
+ 0.406
12
+ ],
13
+ "image_processor_type": "RTDetrImageProcessor",
14
+ "image_std": [
15
+ 0.229,
16
+ 0.224,
17
+ 0.225
18
+ ],
19
+ "pad_size": null,
20
+ "resample": 2,
21
+ "rescale_factor": 0.00392156862745098,
22
+ "size": {
23
+ "height": 640,
24
+ "width": 640
25
+ }
26
+ }
qualification.json ADDED
@@ -0,0 +1,21 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "boundary_tests_passed": 14,
3
+ "cpu_example": {
4
+ "all_predictions_exact": true,
5
+ "boxes_at_030": 2405,
6
+ "device": "cpu",
7
+ "example_sha256": "afe45b076c2b2688e1b58307a923c5c001333a8440dd303cf19a2e1cf21b929b",
8
+ "new_example_cuda_rerun": false,
9
+ "pages": 150,
10
+ "raw_detections": 45000,
11
+ "review_manifest_sha256": "8083a57308277239d5e5de7acd7a0fec4635bc23c1b3238bb2fd47d35b1b2e72",
12
+ "schema": "ax-doclayout.h51-v15-cpu-parity/1",
13
+ "seconds": 39.956092542008264,
14
+ "weights_sha256": "d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e"
15
+ },
16
+ "existing_cuda_evidence": "exact H51-title final1024 three-panel evaluation and exact exported tensor reload",
17
+ "new_example_cuda_rerun": false,
18
+ "owner_selected_despite_frozen_screen_failure": true,
19
+ "ruff_passed": true,
20
+ "schema": "ax-doclayout.h51-v15-qualification/1"
21
+ }
requirements.txt ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ # Match the recorded CUDA runtime. Install CUDA PyTorch wheels separately as shown in README.
2
+ torch==2.12.1
3
+ transformers==4.53.3
4
+ Pillow==12.3.0
5
+ numpy==2.5.2
6
+ safetensors==0.8.0
7
+ huggingface-hub==0.36.2
8
+ tokenizers==0.21.4
retention-drift.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"accuracy_claim":false,"analysis_source_sha256":"a0b3cdf2c18b79ef8b861bb8954ad6ab58f7009d47e958e0f835ee35aad02015","counts":{"H5":{"1":16,"10":1005,"11":4,"12":1,"13":0,"14":0,"15":1,"16":0,"17":26,"2":20,"3":0,"4":415,"5":178,"6":134,"7":22,"8":523,"9":113},"H51-control":{"1":16,"10":994,"11":4,"12":1,"13":0,"14":0,"15":0,"16":0,"17":24,"2":20,"3":0,"4":411,"5":177,"6":131,"7":23,"8":520,"9":115},"H51-title":{"1":14,"10":977,"11":7,"12":1,"13":0,"14":0,"15":0,"16":0,"17":16,"2":20,"3":0,"4":406,"5":175,"6":134,"7":23,"8":519,"9":113}},"extra_class_quality_measured":false,"page_count_changes_from_h5":{"H51-control":[{"delta":{"4":-1},"id":"006"},{"delta":{"10":-3,"9":1},"id":"010"},{"delta":{"10":1},"id":"029"},{"delta":{"10":-1,"9":1},"id":"033"},{"delta":{"10":1},"id":"034"},{"delta":{"8":2},"id":"038"},{"delta":{"8":-1,"9":1},"id":"040"},{"delta":{"10":-1,"6":-1},"id":"041"},{"delta":{"4":1},"id":"043"},{"delta":{"5":-1},"id":"047"},{"delta":{"10":-1,"8":-1},"id":"049"},{"delta":{"10":1,"8":1},"id":"050"},{"delta":{"10":1,"4":-1,"8":-1},"id":"055"},{"delta":{"10":-2,"17":-1,"4":-1},"id":"060"},{"delta":{"8":1},"id":"061"},{"delta":{"10":1},"id":"063"},{"delta":{"10":-1},"id":"068"},{"delta":{"10":-1,"4":-1},"id":"069"},{"delta":{"10":-2,"15":-1},"id":"070"},{"delta":{"8":-1},"id":"077"},{"delta":{"6":-1},"id":"079"},{"delta":{"7":1},"id":"084"},{"delta":{"4":-1,"9":-1},"id":"085"},{"delta":{"10":-1},"id":"087"},{"delta":{"10":-1},"id":"088"},{"delta":{"10":-1},"id":"089"},{"delta":{"8":-1},"id":"091"},{"delta":{"5":-1,"6":-1,"8":-1},"id":"094"},{"delta":{"5":1},"id":"098"},{"delta":{"4":1},"id":"101"},{"delta":{"10":-1,"8":1},"id":"102"},{"delta":{"4":-1},"id":"103"},{"delta":{"10":1},"id":"106"},{"delta":{"10":-1},"id":"107"},{"delta":{"8":-1},"id":"118"},{"delta":{"10":1},"id":"125"},{"delta":{"10":-1,"17":-1},"id":"130"},{"delta":{"4":1},"id":"134"},{"delta":{"4":-1},"id":"137"},{"delta":{"8":-1},"id":"144"}],"H51-title":[{"delta":{"4":-1},"id":"006"},{"delta":{"10":1},"id":"007"},{"delta":{"10":-3,"17":-1},"id":"010"},{"delta":{"1":-1},"id":"018"},{"delta":{"11":1},"id":"020"},{"delta":{"4":-1},"id":"024"},{"delta":{"10":1},"id":"029"},{"delta":{"10":-1,"11":1},"id":"031"},{"delta":{"10":-1,"9":1},"id":"033"},{"delta":{"9":1},"id":"034"},{"delta":{"8":1},"id":"038"},{"delta":{"8":-1},"id":"040"},{"delta":{"10":-1,"17":-1},"id":"041"},{"delta":{"6":1},"id":"042"},{"delta":{"4":-1,"5":-1},"id":"043"},{"delta":{"5":-1},"id":"047"},{"delta":{"10":-2,"8":-1},"id":"049"},{"delta":{"8":1},"id":"050"},{"delta":{"10":1,"4":-1,"8":-1},"id":"055"},{"delta":{"10":-3,"17":-1},"id":"060"},{"delta":{"10":-1,"8":1},"id":"061"},{"delta":{"6":1},"id":"067"},{"delta":{"10":-1,"4":-1,"8":-1},"id":"069"},{"delta":{"10":-15,"15":-1,"17":-3,"8":1},"id":"070"},{"delta":{"10":2},"id":"071"},{"delta":{"8":-1},"id":"077"},{"delta":{"6":-1},"id":"079"},{"delta":{"7":1},"id":"084"},{"delta":{"4":-2,"8":2,"9":-2},"id":"085"},{"delta":{"5":-1},"id":"086"},{"delta":{"10":-1},"id":"087"},{"delta":{"10":-1},"id":"089"},{"delta":{"8":-1},"id":"091"},{"delta":{"5":-1,"6":-1,"8":-1},"id":"094"},{"delta":{"1":-1},"id":"096"},{"delta":{"5":1},"id":"098"},{"delta":{"10":-1,"5":-1},"id":"102"},{"delta":{"4":-1,"8":-1},"id":"103"},{"delta":{"10":1},"id":"106"},{"delta":{"8":1},"id":"112"},{"delta":{"8":-1},"id":"118"},{"delta":{"17":-1},"id":"123"},{"delta":{"10":-2},"id":"125"},{"delta":{"10":-1,"17":-1,"9":-1},"id":"130"},{"delta":{"11":1},"id":"132"},{"delta":{"17":-1},"id":"136"},{"delta":{"8":-1},"id":"137"},{"delta":{"4":-1,"9":1},"id":"138"},{"delta":{"5":1,"8":-1},"id":"144"},{"delta":{"17":-1},"id":"149"}]},"pages":150,"production_promotion_allowed":false,"schema":"ax-doclayout.h51-retention-count-drift/1","score_threshold":0.3}
runtime-profile.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"activation_dtype":"float32","all_matmul_tf32_qualified":false,"autocast":false,"cuda_matmul_allow_tf32":false,"cudnn_allow_tf32":true,"device":"cuda","id":"cuda-fp32-cudnn-tf32/1","input":"RGB640directresize","new_packaged_example_cuda_rerun":false,"onnx_artifact_included":false,"preprocessor_sha256":"cd38cd59999e7a95d68e487fbe5132df3d4e5c32a0836add57e6126ba0c4eaf1","qualification_source":"exact H51-title final1024 three-panel CUDA evaluation; reloaded export tensor parity","schema":"ax-doclayout.runtime-profile/1","storage_dtype":"float32","tensorrt_qualified":false,"tested_cuda":"12.9","tested_cudnn":92000,"tested_gpu":"NVIDIA RTX PRO 6000 Blackwell Server Edition","tested_torch":"2.12.1+cu129","tested_transformers":"4.53.3","tf32_scope":"cuDNN operations only; GEMM matmul TF32 is disabled"}
sdk-taxonomy.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"additional_class_retention_verified":false,"catalog_implies_detection_support":false,"catalog_sha256":"f0c332ec6ff5871f911b20b4405573b4db088497480f337f65b6b8950e15cc50","classes":[{"description":"Reserved slot; never a public detection class.","id":0,"name":"reserved","task":"reserved"},{"description":"Caption describing a figure, table or illustration.","id":1,"name":"caption","task":"layout"},{"description":"Supplementary note linked to main text.","id":2,"name":"footnote","task":"layout"},{"description":"Standalone mathematical expression or equation.","id":3,"name":"formula","task":"layout"},{"description":"Individual bulleted or numbered list item.","id":4,"name":"list_item","task":"layout"},{"description":"Footer content such as page numbers or recurring text.","id":5,"name":"page_footer","task":"layout"},{"description":"Recurring content at the top of a page.","id":6,"name":"page_header","task":"layout"},{"description":"Figure, photograph, diagram or illustration.","id":7,"name":"picture","task":"layout"},{"description":"Heading introducing a section or subsection.","id":8,"name":"section_header","task":"layout"},{"description":"Information arranged in rows and columns.","id":9,"name":"table","task":"layout"},{"description":"General body text or paragraph.","id":10,"name":"text","task":"layout"},{"description":"Main document title.","id":11,"name":"title","task":"layout"},{"description":"Document index or table of contents region.","id":12,"name":"document_index","task":"layout"},{"description":"Source code or programming listing.","id":13,"name":"code","task":"layout"},{"description":"Checked or selected checkbox.","id":14,"name":"checkbox_selected","task":"layout"},{"description":"Empty or unselected checkbox.","id":15,"name":"checkbox_unselected","task":"layout"},{"description":"Form region containing fields or controls.","id":16,"name":"form","task":"layout"},{"description":"Related label and value information.","id":17,"name":"key_value_region","task":"layout"},{"description":"Comment or review annotation.","id":18,"name":"comment","task":"markup"},{"description":"Highlighted content.","id":19,"name":"highlighted","task":"markup"},{"description":"Handwritten annotation or content.","id":20,"name":"handwritten","task":"markup"},{"description":"Content marked with a strikeout line.","id":21,"name":"strikethrough","task":"markup"},{"description":"Caption specifically describing a table.","id":22,"name":"table_caption","task":"layout"},{"description":"Supplementary note associated with a table.","id":23,"name":"table_footnote","task":"layout"},{"description":"Caption or explanatory label associated with a formula.","id":24,"name":"formula_caption","task":"layout"},{"description":"Other region; no automatic mapping from source abandon labels.","id":25,"name":"other","task":"layout"}],"fine_tuning_positive_class_ids":[1,2,3,4,5,6,7,8,9,10,11],"model_sdk_class_ids":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17],"native_index_to_sdk_id":{"0":1,"1":2,"10":11,"11":12,"12":13,"13":14,"14":15,"15":16,"16":17,"2":3,"3":4,"4":5,"5":6,"6":7,"7":8,"8":9,"9":10},"taxonomy":"ax-document-unified-25/1","unsupported_sdk_class_ids":[18,19,20,21,22,23,24,25]}