Object Detection
Transformers
Safetensors
rt_detr_v2
document-layout-analysis
finance
rtdetr-v2
cuda
tf32
Instructions to use AutomatosX/AXDocLayout-M-v1.5-CUDA-TF32 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use AutomatosX/AXDocLayout-M-v1.5-CUDA-TF32 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("object-detection", model="AutomatosX/AXDocLayout-M-v1.5-CUDA-TF32")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForObjectDetection tokenizer = AutoTokenizer.from_pretrained("AutomatosX/AXDocLayout-M-v1.5-CUDA-TF32") model = AutoModelForObjectDetection.from_pretrained("AutomatosX/AXDocLayout-M-v1.5-CUDA-TF32", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Publish owner-selected H5.1 as v1.5 with qualified CUDA profile and preserved tradeoffs
Browse files- LICENSE +202 -0
- NOTICE +5 -0
- README.md +98 -0
- bundle-manifest.json +85 -0
- config.json +155 -0
- cpu-parity.json +13 -0
- evaluation-and-pr.json +1 -0
- evaluation.json +255 -0
- export-receipt.json +1 -0
- frozen-numerical-screen.json +1 -0
- model-selection.json +49 -0
- model.safetensors +3 -0
- original-cpu-parity.json +1 -0
- predict_image.py +131 -0
- preprocessor_config.json +26 -0
- qualification.json +21 -0
- requirements.txt +8 -0
- retention-drift.json +1 -0
- runtime-profile.json +1 -0
- sdk-taxonomy.json +1 -0
LICENSE
ADDED
|
@@ -0,0 +1,202 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
Apache License
|
| 3 |
+
Version 2.0, January 2004
|
| 4 |
+
http://www.apache.org/licenses/
|
| 5 |
+
|
| 6 |
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
| 7 |
+
|
| 8 |
+
1. Definitions.
|
| 9 |
+
|
| 10 |
+
"License" shall mean the terms and conditions for use, reproduction,
|
| 11 |
+
and distribution as defined by Sections 1 through 9 of this document.
|
| 12 |
+
|
| 13 |
+
"Licensor" shall mean the copyright owner or entity authorized by
|
| 14 |
+
the copyright owner that is granting the License.
|
| 15 |
+
|
| 16 |
+
"Legal Entity" shall mean the union of the acting entity and all
|
| 17 |
+
other entities that control, are controlled by, or are under common
|
| 18 |
+
control with that entity. For the purposes of this definition,
|
| 19 |
+
"control" means (i) the power, direct or indirect, to cause the
|
| 20 |
+
direction or management of such entity, whether by contract or
|
| 21 |
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
| 22 |
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
| 23 |
+
|
| 24 |
+
"You" (or "Your") shall mean an individual or Legal Entity
|
| 25 |
+
exercising permissions granted by this License.
|
| 26 |
+
|
| 27 |
+
"Source" form shall mean the preferred form for making modifications,
|
| 28 |
+
including but not limited to software source code, documentation
|
| 29 |
+
source, and configuration files.
|
| 30 |
+
|
| 31 |
+
"Object" form shall mean any form resulting from mechanical
|
| 32 |
+
transformation or translation of a Source form, including but
|
| 33 |
+
not limited to compiled object code, generated documentation,
|
| 34 |
+
and conversions to other media types.
|
| 35 |
+
|
| 36 |
+
"Work" shall mean the work of authorship, whether in Source or
|
| 37 |
+
Object form, made available under the License, as indicated by a
|
| 38 |
+
copyright notice that is included in or attached to the work
|
| 39 |
+
(an example is provided in the Appendix below).
|
| 40 |
+
|
| 41 |
+
"Derivative Works" shall mean any work, whether in Source or Object
|
| 42 |
+
form, that is based on (or derived from) the Work and for which the
|
| 43 |
+
editorial revisions, annotations, elaborations, or other modifications
|
| 44 |
+
represent, as a whole, an original work of authorship. For the purposes
|
| 45 |
+
of this License, Derivative Works shall not include works that remain
|
| 46 |
+
separable from, or merely link (or bind by name) to the interfaces of,
|
| 47 |
+
the Work and Derivative Works thereof.
|
| 48 |
+
|
| 49 |
+
"Contribution" shall mean any work of authorship, including
|
| 50 |
+
the original version of the Work and any modifications or additions
|
| 51 |
+
to that Work or Derivative Works thereof, that is intentionally
|
| 52 |
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
| 53 |
+
or by an individual or Legal Entity authorized to submit on behalf of
|
| 54 |
+
the copyright owner. For the purposes of this definition, "submitted"
|
| 55 |
+
means any form of electronic, verbal, or written communication sent
|
| 56 |
+
to the Licensor or its representatives, including but not limited to
|
| 57 |
+
communication on electronic mailing lists, source code control systems,
|
| 58 |
+
and issue tracking systems that are managed by, or on behalf of, the
|
| 59 |
+
Licensor for the purpose of discussing and improving the Work, but
|
| 60 |
+
excluding communication that is conspicuously marked or otherwise
|
| 61 |
+
designated in writing by the copyright owner as "Not a Contribution."
|
| 62 |
+
|
| 63 |
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
| 64 |
+
on behalf of whom a Contribution has been received by Licensor and
|
| 65 |
+
subsequently incorporated within the Work.
|
| 66 |
+
|
| 67 |
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
| 68 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 69 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 70 |
+
copyright license to reproduce, prepare Derivative Works of,
|
| 71 |
+
publicly display, publicly perform, sublicense, and distribute the
|
| 72 |
+
Work and such Derivative Works in Source or Object form.
|
| 73 |
+
|
| 74 |
+
3. Grant of Patent License. Subject to the terms and conditions of
|
| 75 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 76 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 77 |
+
(except as stated in this section) patent license to make, have made,
|
| 78 |
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
| 79 |
+
where such license applies only to those patent claims licensable
|
| 80 |
+
by such Contributor that are necessarily infringed by their
|
| 81 |
+
Contribution(s) alone or by combination of their Contribution(s)
|
| 82 |
+
with the Work to which such Contribution(s) was submitted. If You
|
| 83 |
+
institute patent litigation against any entity (including a
|
| 84 |
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
| 85 |
+
or a Contribution incorporated within the Work constitutes direct
|
| 86 |
+
or contributory patent infringement, then any patent licenses
|
| 87 |
+
granted to You under this License for that Work shall terminate
|
| 88 |
+
as of the date such litigation is filed.
|
| 89 |
+
|
| 90 |
+
4. Redistribution. You may reproduce and distribute copies of the
|
| 91 |
+
Work or Derivative Works thereof in any medium, with or without
|
| 92 |
+
modifications, and in Source or Object form, provided that You
|
| 93 |
+
meet the following conditions:
|
| 94 |
+
|
| 95 |
+
(a) You must give any other recipients of the Work or
|
| 96 |
+
Derivative Works a copy of this License; and
|
| 97 |
+
|
| 98 |
+
(b) You must cause any modified files to carry prominent notices
|
| 99 |
+
stating that You changed the files; and
|
| 100 |
+
|
| 101 |
+
(c) You must retain, in the Source form of any Derivative Works
|
| 102 |
+
that You distribute, all copyright, patent, trademark, and
|
| 103 |
+
attribution notices from the Source form of the Work,
|
| 104 |
+
excluding those notices that do not pertain to any part of
|
| 105 |
+
the Derivative Works; and
|
| 106 |
+
|
| 107 |
+
(d) If the Work includes a "NOTICE" text file as part of its
|
| 108 |
+
distribution, then any Derivative Works that You distribute must
|
| 109 |
+
include a readable copy of the attribution notices contained
|
| 110 |
+
within such NOTICE file, excluding those notices that do not
|
| 111 |
+
pertain to any part of the Derivative Works, in at least one
|
| 112 |
+
of the following places: within a NOTICE text file distributed
|
| 113 |
+
as part of the Derivative Works; within the Source form or
|
| 114 |
+
documentation, if provided along with the Derivative Works; or,
|
| 115 |
+
within a display generated by the Derivative Works, if and
|
| 116 |
+
wherever such third-party notices normally appear. The contents
|
| 117 |
+
of the NOTICE file are for informational purposes only and
|
| 118 |
+
do not modify the License. You may add Your own attribution
|
| 119 |
+
notices within Derivative Works that You distribute, alongside
|
| 120 |
+
or as an addendum to the NOTICE text from the Work, provided
|
| 121 |
+
that such additional attribution notices cannot be construed
|
| 122 |
+
as modifying the License.
|
| 123 |
+
|
| 124 |
+
You may add Your own copyright statement to Your modifications and
|
| 125 |
+
may provide additional or different license terms and conditions
|
| 126 |
+
for use, reproduction, or distribution of Your modifications, or
|
| 127 |
+
for any such Derivative Works as a whole, provided Your use,
|
| 128 |
+
reproduction, and distribution of the Work otherwise complies with
|
| 129 |
+
the conditions stated in this License.
|
| 130 |
+
|
| 131 |
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
| 132 |
+
any Contribution intentionally submitted for inclusion in the Work
|
| 133 |
+
by You to the Licensor shall be under the terms and conditions of
|
| 134 |
+
this License, without any additional terms or conditions.
|
| 135 |
+
Notwithstanding the above, nothing herein shall supersede or modify
|
| 136 |
+
the terms of any separate license agreement you may have executed
|
| 137 |
+
with Licensor regarding such Contributions.
|
| 138 |
+
|
| 139 |
+
6. Trademarks. This License does not grant permission to use the trade
|
| 140 |
+
names, trademarks, service marks, or product names of the Licensor,
|
| 141 |
+
except as required for reasonable and customary use in describing the
|
| 142 |
+
origin of the Work and reproducing the content of the NOTICE file.
|
| 143 |
+
|
| 144 |
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
| 145 |
+
agreed to in writing, Licensor provides the Work (and each
|
| 146 |
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
| 147 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
| 148 |
+
implied, including, without limitation, any warranties or conditions
|
| 149 |
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
| 150 |
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
| 151 |
+
appropriateness of using or redistributing the Work and assume any
|
| 152 |
+
risks associated with Your exercise of permissions under this License.
|
| 153 |
+
|
| 154 |
+
8. Limitation of Liability. In no event and under no legal theory,
|
| 155 |
+
whether in tort (including negligence), contract, or otherwise,
|
| 156 |
+
unless required by applicable law (such as deliberate and grossly
|
| 157 |
+
negligent acts) or agreed to in writing, shall any Contributor be
|
| 158 |
+
liable to You for damages, including any direct, indirect, special,
|
| 159 |
+
incidental, or consequential damages of any character arising as a
|
| 160 |
+
result of this License or out of the use or inability to use the
|
| 161 |
+
Work (including but not limited to damages for loss of goodwill,
|
| 162 |
+
work stoppage, computer failure or malfunction, or any and all
|
| 163 |
+
other commercial damages or losses), even if such Contributor
|
| 164 |
+
has been advised of the possibility of such damages.
|
| 165 |
+
|
| 166 |
+
9. Accepting Warranty or Additional Liability. While redistributing
|
| 167 |
+
the Work or Derivative Works thereof, You may choose to offer,
|
| 168 |
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
| 169 |
+
or other liability obligations and/or rights consistent with this
|
| 170 |
+
License. However, in accepting such obligations, You may act only
|
| 171 |
+
on Your own behalf and on Your sole responsibility, not on behalf
|
| 172 |
+
of any other Contributor, and only if You agree to indemnify,
|
| 173 |
+
defend, and hold each Contributor harmless for any liability
|
| 174 |
+
incurred by, or claims asserted against, such Contributor by reason
|
| 175 |
+
of your accepting any such warranty or additional liability.
|
| 176 |
+
|
| 177 |
+
END OF TERMS AND CONDITIONS
|
| 178 |
+
|
| 179 |
+
APPENDIX: How to apply the Apache License to your work.
|
| 180 |
+
|
| 181 |
+
To apply the Apache License to your work, attach the following
|
| 182 |
+
boilerplate notice, with the fields enclosed by brackets "[]"
|
| 183 |
+
replaced with your own identifying information. (Don't include
|
| 184 |
+
the brackets!) The text should be enclosed in the appropriate
|
| 185 |
+
comment syntax for the file format. We also recommend that a
|
| 186 |
+
file or class name and description of purpose be included on the
|
| 187 |
+
same "printed page" as the copyright notice for easier
|
| 188 |
+
identification within third-party archives.
|
| 189 |
+
|
| 190 |
+
Copyright [yyyy] [name of copyright owner]
|
| 191 |
+
|
| 192 |
+
Licensed under the Apache License, Version 2.0 (the "License");
|
| 193 |
+
you may not use this file except in compliance with the License.
|
| 194 |
+
You may obtain a copy of the License at
|
| 195 |
+
|
| 196 |
+
http://www.apache.org/licenses/LICENSE-2.0
|
| 197 |
+
|
| 198 |
+
Unless required by applicable law or agreed to in writing, software
|
| 199 |
+
distributed under the License is distributed on an "AS IS" BASIS,
|
| 200 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
| 201 |
+
See the License for the specific language governing permissions and
|
| 202 |
+
limitations under the License.
|
NOTICE
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
AX-DocLayout-M v1.5 (H5.1), owner-selected release, 2026.
|
| 2 |
+
Derived from docling-project/docling-layout-heron revision
|
| 3 |
+
8f39ad3c0b4c58e9c2d2c84a38465abf757272d8 under Apache-2.0.
|
| 4 |
+
Changes: H1/H5 finance tuning, paired H5.1 Title sampling and AX PDF SDK binding.
|
| 5 |
+
No training documents or rendered pages are included.
|
README.md
ADDED
|
@@ -0,0 +1,98 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: transformers
|
| 3 |
+
license: apache-2.0
|
| 4 |
+
pipeline_tag: object-detection
|
| 5 |
+
base_model: docling-project/docling-layout-heron
|
| 6 |
+
base_model_relation: finetune
|
| 7 |
+
tags:
|
| 8 |
+
- document-layout-analysis
|
| 9 |
+
- finance
|
| 10 |
+
- rtdetr-v2
|
| 11 |
+
- cuda
|
| 12 |
+
- tf32
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
# AX-DocLayout-M v1.5 - H5.1 CUDA / cuDNN TF32
|
| 16 |
+
|
| 17 |
+
This is the owner-selected **H51-title final-1024 EMA** model. It continues
|
| 18 |
+
H5 finance fine-tuning with a paired Title-sampling study. It is a separate
|
| 19 |
+
Heron-derived model identity, not D5/D6/H7, not the public eleven-class v1.0
|
| 20 |
+
model, and not an ax-doclayout Python package release. The original v1.4 weights
|
| 21 |
+
and public v1.0 loader pin remain unchanged.
|
| 22 |
+
|
| 23 |
+
Decoded RGB page raster in; layout boxes out. Native classes0-16 map to AX PDF
|
| 24 |
+
SDK IDs1-17 via `sdk-taxonomy.json` (ax-document-unified-25/1). SDK18-25 are
|
| 25 |
+
unsupported. This model does not open PDFs, perform OCR or infer reading order.
|
| 26 |
+
Accuracy retention of extra SDK classes12-17 is unmeasured.
|
| 27 |
+
|
| 28 |
+
## Exact artifact and qualified runtime
|
| 29 |
+
|
| 30 |
+
- FP32 safetensors SHA256:
|
| 31 |
+
`d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e`.
|
| 32 |
+
- H51-title final1024 checkpoint SHA256:
|
| 33 |
+
`44b75b2ca14d7d4756ca51d402d470d069f17ee99145717e1994549b32ef87d2`.
|
| 34 |
+
- Upstream: docling-project/docling-layout-heron at immutable revision
|
| 35 |
+
`8f39ad3c0b4c58e9c2d2c84a38465abf757272d8`, Apache-2.0.
|
| 36 |
+
- Native **640x640 direct resize**, original hash-pinned image processor.
|
| 37 |
+
Do not substitute D5's1024letterbox or H7's1696letterbox preprocessing.
|
| 38 |
+
- Tested CUDA: PyTorch2.12.1+cu129, CUDA12.9, Transformers4.53.3,
|
| 39 |
+
RTX PRO6000Blackwell. FP32 storage/activations, no autocast or quantization.
|
| 40 |
+
- **cuDNN TF32 allowed; CUDA matmul TF32 disabled.** The suffix means cuDNN
|
| 41 |
+
permission, not all-matmul TF32. No ONNX or TensorRT artifact is included.
|
| 42 |
+
- The exact selected checkpoint has existing three-panel CUDA evidence and
|
| 43 |
+
exact exported-tensor reload evidence. The packaged example is CPU-qualified;
|
| 44 |
+
it was not freshly rerun on CUDA for this publication. No GPU was restarted.
|
| 45 |
+
|
| 46 |
+
## Measured results and accepted tradeoffs
|
| 47 |
+
|
| 48 |
+
All AP values are percentages on previously exposed development panels.
|
| 49 |
+
|
| 50 |
+
| Panel | H5 | Matched control | Selected H5.1 / v1.5 |
|
| 51 |
+
|---|---:|---:|---:|
|
| 52 |
+
| General AP (6489pages) |70.6572|71.1214|71.5327|
|
| 53 |
+
| Financial AP (1745pages) |61.5113|61.5445|61.7331|
|
| 54 |
+
| FinTab AP (256pages) |91.5856|91.7371|91.5774|
|
| 55 |
+
| General Title AP |35.9637|37.0977|38.7453|
|
| 56 |
+
| General Title precision at0.30/IoU0.50 |38.9333|39.5833|36.2069|
|
| 57 |
+
| General Title recall at0.30/IoU0.50 |48.8294|50.8361|56.1873|
|
| 58 |
+
| FinTab AP90 |89.0473|89.0155|88.4481|
|
| 59 |
+
|
| 60 |
+
Title AP treatment-control improves1.6476pp, with a paired family-bootstrap95%
|
| 61 |
+
interval[0.4851,2.8212]. Compared with H5 at the fixed threshold,22additional
|
| 62 |
+
true Titles accompany67additional false Titles. **The frozen numerical screen
|
| 63 |
+
failed**, including the2pp Title AP target, Title precision retention and table
|
| 64 |
+
AP90 retention. The owner accepted these tradeoffs and explicitly selected
|
| 65 |
+
publication; the original screen has not been reclassified as passed.
|
| 66 |
+
|
| 67 |
+
Financial is a subset of General, not independent HKEX evidence. Family
|
| 68 |
+
independence, independent final-test quality, second-seed reproducibility and
|
| 69 |
+
extra-class accuracy are not established. This is not a claim of overall
|
| 70 |
+
superiority to D5, D6 or H7; their differently defined panels cannot be ranked
|
| 71 |
+
by subtracting historical scores. See evaluation.json and the frozen screen.
|
| 72 |
+
|
| 73 |
+
## Installation and inference
|
| 74 |
+
|
| 75 |
+
Use Python3.12/3.13. Install CUDA PyTorch separately for the recorded runtime:
|
| 76 |
+
|
| 77 |
+
```bash
|
| 78 |
+
python -m pip install torch==2.12.1 --index-url https://download.pytorch.org/whl/cu129
|
| 79 |
+
python -m pip install -r requirements.txt
|
| 80 |
+
```
|
| 81 |
+
|
| 82 |
+
Download this private repository with an authorized Hugging Face account. Pin
|
| 83 |
+
the immutable commit from the release receipt, or resolve tag `v1.5` to that
|
| 84 |
+
commit and use `hf download --revision <COMMIT>`. The example fails closed on
|
| 85 |
+
core hash or runtime mismatches and never falls back silently from CUDA.
|
| 86 |
+
|
| 87 |
+
```bash
|
| 88 |
+
python predict_image.py --model-dir . --image page.png --output layout.json --device cuda
|
| 89 |
+
```
|
| 90 |
+
|
| 91 |
+
Use `--device cpu` explicitly for CPU. Boxes use original raster pixel xyxy
|
| 92 |
+
coordinates and SDK class IDs1-17. The default score threshold is0.30; it is an
|
| 93 |
+
operating point, not COCO AP/AR100. Keep all17classes when interpreting output.
|
| 94 |
+
Do not load this artifact through the eleven-class v1.0 receipt-pinned loader.
|
| 95 |
+
|
| 96 |
+
The bundle contains inference files, aggregate numeric evidence, attribution
|
| 97 |
+
and hash receipts only. No training documents, pixels, per-page predictions,
|
| 98 |
+
optimizer states, credentials or private training implementation are included.
|
bundle-manifest.json
ADDED
|
@@ -0,0 +1,85 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"files": {
|
| 3 |
+
"LICENSE": {
|
| 4 |
+
"bytes": 11358,
|
| 5 |
+
"sha256": "cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30"
|
| 6 |
+
},
|
| 7 |
+
"NOTICE": {
|
| 8 |
+
"bytes": 312,
|
| 9 |
+
"sha256": "11c1414028d206ad3cae70df2dd81520cacb2d660719f9fa4cc6394ac3240d2c"
|
| 10 |
+
},
|
| 11 |
+
"README.md": {
|
| 12 |
+
"bytes": 4612,
|
| 13 |
+
"sha256": "7d57f607834ab445897e23ad433142869925ef7b74cfafa44beff4322f480137"
|
| 14 |
+
},
|
| 15 |
+
"config.json": {
|
| 16 |
+
"bytes": 3263,
|
| 17 |
+
"sha256": "7691e69a4e4cb70416c2e12bbefea3a90671790226b2c0d22ede944c48e11f05"
|
| 18 |
+
},
|
| 19 |
+
"cpu-parity.json": {
|
| 20 |
+
"bytes": 511,
|
| 21 |
+
"sha256": "92161306a7b4e3280854b4ed9f8dbd72700d54d6b738ae6b22ab88f8ee5d3a4a"
|
| 22 |
+
},
|
| 23 |
+
"evaluation-and-pr.json": {
|
| 24 |
+
"bytes": 88929,
|
| 25 |
+
"sha256": "7cfb7cd68b6fe49f63dff9a11d02b402ca6c5f1c32cb6f0c77ff10d72da65a4b"
|
| 26 |
+
},
|
| 27 |
+
"evaluation.json": {
|
| 28 |
+
"bytes": 8017,
|
| 29 |
+
"sha256": "df77f3900bf8b291460faf5df114566d3f18c349c38fa2aa0240131c33f59459"
|
| 30 |
+
},
|
| 31 |
+
"export-receipt.json": {
|
| 32 |
+
"bytes": 2574,
|
| 33 |
+
"sha256": "0b2ea9846eaf8b9b425a6501f3aaddbcb75ea12d10c00c8eb258eb7302d6a147"
|
| 34 |
+
},
|
| 35 |
+
"frozen-numerical-screen.json": {
|
| 36 |
+
"bytes": 4273,
|
| 37 |
+
"sha256": "5eeeb75f4b8f3dd026b5110a850a04d71c8ee38a34f83b53e4c3e23b2f70adff"
|
| 38 |
+
},
|
| 39 |
+
"model-selection.json": {
|
| 40 |
+
"bytes": 1209,
|
| 41 |
+
"sha256": "9cd564d6216a49be90305e839cd1acfe4b8027708c791621fc27841dae670b32"
|
| 42 |
+
},
|
| 43 |
+
"model.safetensors": {
|
| 44 |
+
"bytes": 171658996,
|
| 45 |
+
"sha256": "d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e"
|
| 46 |
+
},
|
| 47 |
+
"original-cpu-parity.json": {
|
| 48 |
+
"bytes": 523,
|
| 49 |
+
"sha256": "28f54335f516b00487fd153140858b0987875094dd514167eedda9b2940c2701"
|
| 50 |
+
},
|
| 51 |
+
"predict_image.py": {
|
| 52 |
+
"bytes": 6689,
|
| 53 |
+
"sha256": "afe45b076c2b2688e1b58307a923c5c001333a8440dd303cf19a2e1cf21b929b"
|
| 54 |
+
},
|
| 55 |
+
"preprocessor_config.json": {
|
| 56 |
+
"bytes": 444,
|
| 57 |
+
"sha256": "cd38cd59999e7a95d68e487fbe5132df3d4e5c32a0836add57e6126ba0c4eaf1"
|
| 58 |
+
},
|
| 59 |
+
"qualification.json": {
|
| 60 |
+
"bytes": 866,
|
| 61 |
+
"sha256": "a7cc2d973f5219ce7d7e3b14eea03f4635736287e84f9d5fe8a6957fd602d981"
|
| 62 |
+
},
|
| 63 |
+
"requirements.txt": {
|
| 64 |
+
"bytes": 219,
|
| 65 |
+
"sha256": "e1d9aeadc9cc880b1ea903c344861f2e4cac2222000ff8831eba49f24d21aebd"
|
| 66 |
+
},
|
| 67 |
+
"retention-drift.json": {
|
| 68 |
+
"bytes": 3774,
|
| 69 |
+
"sha256": "9a8f9bea949f1fc53cf9f87152dc51e57a3ca62958aa1b8c466a07170ae84afd"
|
| 70 |
+
},
|
| 71 |
+
"runtime-profile.json": {
|
| 72 |
+
"bytes": 807,
|
| 73 |
+
"sha256": "ddd4df5814899ce1ea7920d5b1f3827eeae7f5d8b589e4256ca3aa1033a37c41"
|
| 74 |
+
},
|
| 75 |
+
"sdk-taxonomy.json": {
|
| 76 |
+
"bytes": 3206,
|
| 77 |
+
"sha256": "81e7908ee7c8bbb6e00905a98ed43c988128faa38c0b1d55d20948f78e40e351"
|
| 78 |
+
}
|
| 79 |
+
},
|
| 80 |
+
"model_id": "AutomatosX/AXDocLayout-M-v1.5-CUDA-TF32",
|
| 81 |
+
"model_version": "1.5",
|
| 82 |
+
"schema": "ax-doclayout.h51-v15-bundle/1",
|
| 83 |
+
"taxonomy": "ax-document-unified-25/1",
|
| 84 |
+
"weights_sha256": "d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e"
|
| 85 |
+
}
|
config.json
ADDED
|
@@ -0,0 +1,155 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"activation_dropout": 0.0,
|
| 3 |
+
"activation_function": "silu",
|
| 4 |
+
"anchor_image_size": null,
|
| 5 |
+
"architectures": [
|
| 6 |
+
"RTDetrV2ForObjectDetection"
|
| 7 |
+
],
|
| 8 |
+
"attention_dropout": 0.0,
|
| 9 |
+
"auxiliary_loss": true,
|
| 10 |
+
"backbone": null,
|
| 11 |
+
"backbone_config": {
|
| 12 |
+
"depths": [
|
| 13 |
+
3,
|
| 14 |
+
4,
|
| 15 |
+
6,
|
| 16 |
+
3
|
| 17 |
+
],
|
| 18 |
+
"downsample_in_bottleneck": false,
|
| 19 |
+
"downsample_in_first_stage": false,
|
| 20 |
+
"embedding_size": 64,
|
| 21 |
+
"hidden_act": "relu",
|
| 22 |
+
"hidden_sizes": [
|
| 23 |
+
256,
|
| 24 |
+
512,
|
| 25 |
+
1024,
|
| 26 |
+
2048
|
| 27 |
+
],
|
| 28 |
+
"layer_type": "bottleneck",
|
| 29 |
+
"model_type": "rt_detr_resnet",
|
| 30 |
+
"num_channels": 3,
|
| 31 |
+
"out_features": [
|
| 32 |
+
"stage2",
|
| 33 |
+
"stage3",
|
| 34 |
+
"stage4"
|
| 35 |
+
],
|
| 36 |
+
"out_indices": [
|
| 37 |
+
2,
|
| 38 |
+
3,
|
| 39 |
+
4
|
| 40 |
+
],
|
| 41 |
+
"stage_names": [
|
| 42 |
+
"stem",
|
| 43 |
+
"stage1",
|
| 44 |
+
"stage2",
|
| 45 |
+
"stage3",
|
| 46 |
+
"stage4"
|
| 47 |
+
]
|
| 48 |
+
},
|
| 49 |
+
"backbone_kwargs": null,
|
| 50 |
+
"batch_norm_eps": 1e-05,
|
| 51 |
+
"box_noise_scale": 1.0,
|
| 52 |
+
"d_model": 256,
|
| 53 |
+
"decoder_activation_function": "relu",
|
| 54 |
+
"decoder_attention_heads": 8,
|
| 55 |
+
"decoder_ffn_dim": 1024,
|
| 56 |
+
"decoder_in_channels": [
|
| 57 |
+
256,
|
| 58 |
+
256,
|
| 59 |
+
256
|
| 60 |
+
],
|
| 61 |
+
"decoder_layers": 6,
|
| 62 |
+
"decoder_method": "default",
|
| 63 |
+
"decoder_n_levels": 3,
|
| 64 |
+
"decoder_n_points": 4,
|
| 65 |
+
"decoder_offset_scale": 0.5,
|
| 66 |
+
"dropout": 0.0,
|
| 67 |
+
"encode_proj_layers": [
|
| 68 |
+
2
|
| 69 |
+
],
|
| 70 |
+
"encoder_activation_function": "gelu",
|
| 71 |
+
"encoder_attention_heads": 8,
|
| 72 |
+
"encoder_ffn_dim": 1024,
|
| 73 |
+
"encoder_hidden_dim": 256,
|
| 74 |
+
"encoder_in_channels": [
|
| 75 |
+
512,
|
| 76 |
+
1024,
|
| 77 |
+
2048
|
| 78 |
+
],
|
| 79 |
+
"encoder_layers": 1,
|
| 80 |
+
"eos_coefficient": 0.0001,
|
| 81 |
+
"eval_size": null,
|
| 82 |
+
"feat_strides": [
|
| 83 |
+
8,
|
| 84 |
+
16,
|
| 85 |
+
32
|
| 86 |
+
],
|
| 87 |
+
"focal_loss_alpha": 0.75,
|
| 88 |
+
"focal_loss_gamma": 2.0,
|
| 89 |
+
"freeze_backbone_batch_norms": true,
|
| 90 |
+
"hidden_expansion": 1.0,
|
| 91 |
+
"id2label": {
|
| 92 |
+
"0": "caption",
|
| 93 |
+
"1": "footnote",
|
| 94 |
+
"2": "formula",
|
| 95 |
+
"3": "list_item",
|
| 96 |
+
"4": "page_footer",
|
| 97 |
+
"5": "page_header",
|
| 98 |
+
"6": "picture",
|
| 99 |
+
"7": "section_header",
|
| 100 |
+
"8": "table",
|
| 101 |
+
"9": "text",
|
| 102 |
+
"10": "title",
|
| 103 |
+
"11": "document_index",
|
| 104 |
+
"12": "code",
|
| 105 |
+
"13": "checkbox_selected",
|
| 106 |
+
"14": "checkbox_unselected",
|
| 107 |
+
"15": "form",
|
| 108 |
+
"16": "key_value_region"
|
| 109 |
+
},
|
| 110 |
+
"initializer_bias_prior_prob": null,
|
| 111 |
+
"initializer_range": 0.01,
|
| 112 |
+
"is_encoder_decoder": true,
|
| 113 |
+
"label2id": {
|
| 114 |
+
"caption": 0,
|
| 115 |
+
"checkbox_selected": 13,
|
| 116 |
+
"checkbox_unselected": 14,
|
| 117 |
+
"code": 12,
|
| 118 |
+
"document_index": 11,
|
| 119 |
+
"footnote": 1,
|
| 120 |
+
"form": 15,
|
| 121 |
+
"formula": 2,
|
| 122 |
+
"key_value_region": 16,
|
| 123 |
+
"list_item": 3,
|
| 124 |
+
"page_footer": 4,
|
| 125 |
+
"page_header": 5,
|
| 126 |
+
"picture": 6,
|
| 127 |
+
"section_header": 7,
|
| 128 |
+
"table": 8,
|
| 129 |
+
"text": 9,
|
| 130 |
+
"title": 10
|
| 131 |
+
},
|
| 132 |
+
"label_noise_ratio": 0.5,
|
| 133 |
+
"layer_norm_eps": 1e-05,
|
| 134 |
+
"learn_initial_query": false,
|
| 135 |
+
"matcher_alpha": 0.25,
|
| 136 |
+
"matcher_bbox_cost": 5.0,
|
| 137 |
+
"matcher_class_cost": 2.0,
|
| 138 |
+
"matcher_gamma": 2.0,
|
| 139 |
+
"matcher_giou_cost": 2.0,
|
| 140 |
+
"model_type": "rt_detr_v2",
|
| 141 |
+
"normalize_before": false,
|
| 142 |
+
"num_denoising": 100,
|
| 143 |
+
"num_feature_levels": 3,
|
| 144 |
+
"num_queries": 300,
|
| 145 |
+
"positional_encoding_temperature": 10000,
|
| 146 |
+
"torch_dtype": "float32",
|
| 147 |
+
"transformers_version": "4.53.3",
|
| 148 |
+
"use_focal_loss": true,
|
| 149 |
+
"use_pretrained_backbone": false,
|
| 150 |
+
"use_timm_backbone": false,
|
| 151 |
+
"weight_loss_bbox": 5.0,
|
| 152 |
+
"weight_loss_giou": 2.0,
|
| 153 |
+
"weight_loss_vfl": 1.0,
|
| 154 |
+
"with_box_refine": true
|
| 155 |
+
}
|
cpu-parity.json
ADDED
|
@@ -0,0 +1,13 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"schema": "ax-doclayout.h51-v15-cpu-parity/1",
|
| 3 |
+
"pages": 150,
|
| 4 |
+
"raw_detections": 45000,
|
| 5 |
+
"boxes_at_030": 2405,
|
| 6 |
+
"all_predictions_exact": true,
|
| 7 |
+
"weights_sha256": "d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e",
|
| 8 |
+
"example_sha256": "afe45b076c2b2688e1b58307a923c5c001333a8440dd303cf19a2e1cf21b929b",
|
| 9 |
+
"review_manifest_sha256": "8083a57308277239d5e5de7acd7a0fec4635bc23c1b3238bb2fd47d35b1b2e72",
|
| 10 |
+
"device": "cpu",
|
| 11 |
+
"new_example_cuda_rerun": false,
|
| 12 |
+
"seconds": 39.956092542008264
|
| 13 |
+
}
|
evaluation-and-pr.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"analysis_source_sha256":"e12994293accd801349a9ce4276c4a3c74f35a26c82b00777ead1166055c7379","arms":{"H5":{"counts":{"fn":153,"fp":229,"iou":0.5,"precision":38.93333333333333,"recall":48.82943143812709,"threshold":0.3,"tp":146},"model":{"completed_updates":1024,"sha256":"4f740539617804699a21c6d456da190598ab1022e4128ad1b5dd45ecc54b987a","stage":"H5"},"panels":{"fin_val":{"ap":91.58560936970301,"ap50":96.42307172412028,"ap70":95.68967016952253,"ap90":89.04728335091869,"ar100":97.18354430379745,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":256,"per_class_ap":{"9":91.58560936970301},"taxonomy":"ax-document-unified-25/1"},"financial_val":{"ap":61.51128145000217,"ap50":74.86946506958374,"ap70":68.45692502635225,"ap90":43.322561206462275,"ar100":83.24266432330124,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":1745,"per_class_ap":{"1":50.27375835762371,"10":86.8442236905189,"11":21.853779071996104,"2":21.565227712119672,"3":-1.0,"4":86.21879623969116,"5":63.222417086128445,"6":48.35856172317618,"7":81.51771563437424,"8":65.42208145342498,"9":89.8362535309683},"taxonomy":"ax-document-unified-25/1"},"gold_val":{"ap":70.65715440191167,"ap50":88.40568243846039,"ap70":78.13845865429131,"ap90":50.450114112981545,"ar100":82.83261306670309,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":6489,"per_class_ap":{"1":86.97437605372829,"10":84.58897292266664,"11":35.963737455625406,"2":70.84972376935531,"3":66.0621205795928,"4":86.0096104111741,"5":53.05098211411177,"6":56.16971374829491,"7":86.3866260466923,"8":67.48086426451377,"9":83.69197105527309},"taxonomy":"ax-document-unified-25/1"}},"pr":{"iou_thresholds":[0.5,0.55,0.6,0.65,0.7,0.75,0.8,0.85,0.8999999999999999,0.95],"precision":[[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9411764705882353,0.92,0.92,0.891566265060241,0.8823529411764706,0.8387096774193549,0.8316831683168316,0.8316831683168316,0.7565217391304347,0.728,0.7099236641221374,0.6808510638297872,0.6753246753246753,0.6753246753246753,0.6729559748427673,0.6625766871165644,0.6453488372093024,0.6195652173913043,0.612565445026178,0.5853658536585366,0.5535714285714286,0.5407725321888412,0.5394190871369294,0.5076923076923077,0.4440789473684211,0.42058823529411765,0.42058823529411765,0.39669421487603307,0.3868421052631579,0.36829268292682926,0.3617021276595745,0.35135135135135137,0.3419354838709677,0.31650485436893205,0.31203007518796994,0.30434782608695654,0.2888146911519199,0.2764612954186414,0.26766917293233083,0.24262734584450402,0.23282442748091603,0.2222222222222222,0.21331828442437922,0.20824295010845986,0.20020429009193055,0.1896551724137931,0.17387543252595156,0.1695616211745244,0.15436241610738255,0.1423728813559322,0.1342155009451796,0.12342857142857143,0.11225012813941568,0.10146252285191956,0.08724311748739821,0.06859205776173286,0.02591719959609559,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9375,0.9264705882352942,0.9041095890410958,0.8734177215189873,0.8674698795180723,0.8426966292134831,0.7920792079207921,0.7788461538461539,0.711864406779661,0.6641221374045801,0.6382978723404256,0.6339869281045751,0.6339869281045751,0.6289308176100629,0.6094674556213018,0.5769230769230769,0.5706806282722513,0.5414634146341464,0.5089285714285714,0.4978902953586498,0.46153846153846156,0.40460526315789475,0.3805309734513274,0.3805309734513274,0.3584905660377358,0.35233160621761656,0.33658536585365856,0.32867132867132864,0.32432432432432434,0.32166301969365424,0.30864197530864196,0.2925430210325048,0.28888888888888886,0.2671118530884808,0.2559241706161137,0.2511278195488722,0.22788203753351208,0.2223667100130039,0.2078853046594982,0.19977426636568849,0.19522776572668113,0.18794688457609807,0.1781609195402299,0.16349480968858132,0.15963606286186932,0.14541387024608501,0.1342372881355932,0.1266540642722117,0.11714285714285715,0.1075883575883576,0.10120481927710843,0.08349666797334379,0.0789762340036563,0.06098579782790309,0.024907438572871088,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9375,0.9264705882352942,0.9041095890410958,0.8734177215189873,0.8674698795180723,0.8426966292134831,0.7920792079207921,0.7788461538461539,0.711864406779661,0.6641221374045801,0.6382978723404256,0.6339869281045751,0.6339869281045751,0.6289308176100629,0.6094674556213018,0.5769230769230769,0.5706806282722513,0.5414634146341464,0.5089285714285714,0.4978902953586498,0.46153846153846156,0.40460526315789475,0.3805309734513274,0.3805309734513274,0.3584905660377358,0.35233160621761656,0.33658536585365856,0.32867132867132864,0.32432432432432434,0.32166301969365424,0.30864197530864196,0.2925430210325048,0.28888888888888886,0.2671118530884808,0.2559241706161137,0.24962406015037594,0.22654155495978553,0.21755725190839695,0.20278099652375434,0.19538968166849616,0.18692543411644535,0.18692543411644535,0.17647058823529413,0.16153846153846155,0.1588089330024814,0.1392857142857143,0.1335131490222522,0.1254681647940075,0.11657142857142858,0.10609943618657099,0.09597806215722121,0.08259015122140365,0.07231335788416471,0.03991252050300711,0.009903640256959315,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9375,0.9264705882352942,0.9041095890410958,0.8734177215189873,0.8674698795180723,0.8426966292134831,0.7920792079207921,0.7788461538461539,0.711864406779661,0.6641221374045801,0.6274509803921569,0.6274509803921569,0.6274509803921569,0.6226415094339622,0.5604395604395604,0.5497382198952879,0.5023255813953489,0.4847161572052402,0.4810126582278481,0.43656716417910446,0.3761755485893417,0.3687315634218289,0.36627906976744184,0.3477088948787062,0.34196891191709844,0.3253012048192771,0.3157894736842105,0.31333333333333335,0.3096774193548387,0.287378640776699,0.28383458646616544,0.27717391304347827,0.2480252764612954,0.24210526315789474,0.21983914209115282,0.21456436931079323,0.2007168458781362,0.1930022573363431,0.1807967313585291,0.1807967313585291,0.17077798861480076,0.1564102564102564,0.15384615384615385,0.135,0.1294672960215779,0.12172284644194757,0.11314285714285714,0.10302409021014865,0.09323583180987204,0.08026366808840636,0.07030465349849348,0.038819026790595956,0.024234264557388085,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9375,0.9264705882352942,0.9041095890410958,0.8734177215189873,0.8674698795180723,0.7722772277227723,0.7722772277227723,0.7105263157894737,0.68,0.6170212765957447,0.6143790849673203,0.6143790849673203,0.610062893081761,0.5755813953488372,0.5340314136125655,0.4883720930232558,0.47161572052401746,0.4269230769230769,0.3573667711598746,0.35103244837758113,0.3488372093023256,0.3238341968911917,0.3097560975609756,0.3049645390070922,0.2979683972911964,0.29540481400437635,0.26796116504854367,0.2650375939849624,0.23414634146341465,0.22442748091603054,0.2037533512064343,0.19895968790637192,0.1863799283154122,0.17945823927765236,0.16853932584269662,0.16853932584269662,0.1568627450980392,0.14528462192013594,0.14204081632653062,0.12642857142857142,0.12137559002022927,0.11531190926275993,0.10685714285714286,0.09823284823284824,0.09253012048192771,0.0764406115248922,0.07239488117001829,0.055973266499582286,0.02288791652642208,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9375,0.9264705882352942,0.9041095890410958,0.8734177215189873,0.8674698795180723,0.7722772277227723,0.7722772277227723,0.6949152542372882,0.672,0.6078431372549019,0.6078431372549019,0.6078431372549019,0.6037735849056604,0.5439560439560439,0.5230769230769231,0.47555555555555556,0.47161572052401746,0.4269230769230769,0.3573667711598746,0.35103244837758113,0.3488372093023256,0.31865284974093266,0.2937062937062937,0.2866666666666667,0.258252427184466,0.2556390977443609,0.25,0.22432859399684044,0.21804511278195488,0.1970509383378016,0.18820577164366373,0.1772885283893395,0.16919739696312364,0.1634320735444331,0.15517241379310345,0.14103653355989804,0.13895781637717122,0.12751677852348994,0.11800404585300067,0.11463730569948187,0.10477299185098952,0.09511434511434512,0.08963855421686746,0.07408859270874167,0.07020109689213894,0.05430242272347535,0.016577361018084394,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9375,0.9264705882352942,0.9041095890410958,0.8734177215189873,0.8674698795180723,0.7722772277227723,0.7722772277227723,0.6949152542372882,0.672,0.6026490066225165,0.6026490066225165,0.5974842767295597,0.5680473372781065,0.5235602094240838,0.4975609756097561,0.4666666666666667,0.45569620253164556,0.3651315789473684,0.34023668639053256,0.31536388140161725,0.2891566265060241,0.27765237020316025,0.27571115973741794,0.24665391969407266,0.2462686567164179,0.21951219512195122,0.21068702290076335,0.18900804289544235,0.1806775407779172,0.17033603707995365,0.16268980477223427,0.1567622950819672,0.14565826330532214,0.135089209855565,0.1267605633802817,0.11387163561076605,0.11074489123269611,0.09953434225844005,0.08918503331624808,0.08089579524680073,0.06979449398991858,0.06126548376297288,0.03389830508474576,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9827586206896551,0.9827586206896551,0.9827586206896551,0.9827586206896551,0.9827586206896551,0.9827586206896551,0.9827586206896551,0.9117647058823529,0.9,0.88,0.8554216867469879,0.8275862068965517,0.7211538461538461,0.624,0.5562913907284768,0.5562913907284768,0.5534591194968553,0.4945054945054945,0.4325581395348837,0.4192139737991266,0.3256578947368421,0.3047337278106509,0.2830188679245283,0.26024096385542167,0.2505643340857788,0.24945295404814005,0.22388059701492538,0.22388059701492538,0.2,0.1903323262839879,0.16775032509752927,0.15770609318996415,0.1523702031602709,0.14344262295081966,0.14170854271356784,0.1245674740484429,0.12158808933002481,0.10714285714285714,0.10316925151719487,0.09737827715355805,0.0814966683751922,0.0740402193784278,0.06142963514519732,0.05054151624548736,0.014316811788345613,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9761904761904762,0.9636363636363636,0.9636363636363636,0.9636363636363636,0.9636363636363636,0.9482758620689655,0.890625,0.8823529411764706,0.863013698630137,0.7951807228915663,0.6634615384615384,0.549618320610687,0.5099337748344371,0.5098039215686274,0.44505494505494503,0.37777777777777777,0.3670886075949367,0.2735562310030395,0.21678321678321677,0.21444201312910285,0.1926070038910506,0.19029850746268656,0.16587677725118483,0.1447721179624665,0.13261648745519714,0.1251372118551043,0.11987704918032786,0.11204481792717087,0.09172259507829977,0.08496291301416048,0.07325383304940375,0.05374592833876222,0.04061371841155235,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9333333333333333,0.8611111111111112,0.8301886792452831,0.8301886792452831,0.8301886792452831,0.8301886792452831,0.8181818181818182,0.8,0.75,0.6835443037974683,0.456,0.4066666666666667,0.3987341772151899,0.34554973821989526,0.2653846153846154,0.13773584905660377,0.11848341232227488,0.07282913165266107,0.05785714285714286,0.04048192771084337,0.02422723475355054,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]],"recall_thresholds":[0.0,0.01,0.02,0.03,0.04,0.05,0.06,0.07,0.08,0.09,0.1,0.11,0.12,0.13,0.14,0.15,0.16,0.17,0.18,0.19,0.2,0.21,0.22,0.23,0.24,0.25,0.26,0.27,0.28,0.29,0.3,0.31,0.32,0.33,0.34,0.35000000000000003,0.36,0.37,0.38,0.39,0.4,0.41000000000000003,0.42,0.43,0.44,0.45,0.46,0.47000000000000003,0.48,0.49,0.5,0.51,0.52,0.53,0.54,0.55,0.56,0.5700000000000001,0.58,0.59,0.6,0.61,0.62,0.63,0.64,0.65,0.66,0.67,0.68,0.6900000000000001,0.7000000000000001,0.71,0.72,0.73,0.74,0.75,0.76,0.77,0.78,0.79,0.8,0.81,0.8200000000000001,0.8300000000000001,0.84,0.85,0.86,0.87,0.88,0.89,0.9,0.91,0.92,0.93,0.9400000000000001,0.9500000000000001,0.96,0.97,0.98,0.99,1.0],"scores":[[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9585787653923035,0.9575620889663696,0.9568257331848145,0.9560073614120483,0.9538499712944031,0.9500331878662109,0.9435871839523315,0.9408732652664185,0.8572510480880737,0.8041110038757324,0.7729035019874573,0.7316728234291077,0.7094331979751587,0.6633992195129395,0.6480571031570435,0.6470828056335449,0.5953417420387268,0.5735146403312683,0.5508371591567993,0.5216833353042603,0.507706344127655,0.5020371675491333,0.49324971437454224,0.478418231010437,0.46982336044311523,0.4536204934120178,0.4421732723712921,0.4235703647136688,0.40744468569755554,0.4012247920036316,0.3949631452560425,0.37603139877319336,0.34619665145874023,0.32678958773612976,0.32390159368515015,0.3119688630104065,0.29528969526290894,0.2769066095352173,0.26878052949905396,0.2610367238521576,0.2510267198085785,0.23130708932876587,0.22690708935260773,0.22068668901920319,0.20682238042354584,0.20088085532188416,0.1941605806350708,0.17665690183639526,0.17209550738334656,0.16527892649173737,0.15989950299263,0.15596339106559753,0.15061122179031372,0.14523592591285706,0.13735134899616241,0.13344889879226685,0.12492327392101288,0.11711706221103668,0.11190908402204514,0.10550928860902786,0.09888853132724762,0.0923946276307106,0.08369728177785873,0.07114356011152267,0.04033275693655014,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7389984130859375,0.7190212607383728,0.6936459541320801,0.6480071544647217,0.6355875730514526,0.5832968354225159,0.5508371591567993,0.5216833353042603,0.507706344127655,0.5020371675491333,0.4889431595802307,0.474325954914093,0.45832324028015137,0.44290438294410706,0.4235703647136688,0.4056469202041626,0.39943927526474,0.37603139877319336,0.34619665145874023,0.3258066475391388,0.32389551401138306,0.3048463463783264,0.293806791305542,0.2763128876686096,0.26535528898239136,0.2610367238521576,0.2537226676940918,0.2414199709892273,0.22923777997493744,0.2253156453371048,0.2068166881799698,0.20055942237377167,0.1943197399377823,0.17690981924533844,0.17433476448059082,0.16527892649173737,0.15989950299263,0.15596339106559753,0.15061122179031372,0.14523592591285706,0.13735134899616241,0.13344889879226685,0.12492327392101288,0.11711706221103668,0.11190908402204514,0.10553359240293503,0.09951391816139221,0.09539015591144562,0.0843665823340416,0.08058075606822968,0.06806748360395432,0.04033275693655014,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7389984130859375,0.7190212607383728,0.6936459541320801,0.6480071544647217,0.6355875730514526,0.5832968354225159,0.5508371591567993,0.5216833353042603,0.507706344127655,0.5020371675491333,0.4889431595802307,0.474325954914093,0.45832324028015137,0.44290438294410706,0.4235703647136688,0.4056469202041626,0.39943927526474,0.37603139877319336,0.34619665145874023,0.3258066475391388,0.32389551401138306,0.3048463463783264,0.293806791305542,0.2763128876686096,0.26535528898239136,0.2610367238521576,0.2537226676940918,0.2414199709892273,0.22923777997493744,0.2253156453371048,0.2068166881799698,0.20055942237377167,0.1943197399377823,0.17665690183639526,0.17209550738334656,0.1622985601425171,0.15737952291965485,0.15082065761089325,0.15044862031936646,0.1444702297449112,0.13653616607189178,0.13339833915233612,0.12109428644180298,0.11672231554985046,0.11115076392889023,0.10550928860902786,0.09888853132724762,0.0923946276307106,0.08369728177785873,0.07611681520938873,0.05371889844536781,0.01640801876783371,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7389984130859375,0.7190212607383728,0.6936459541320801,0.6480071544647217,0.6355875730514526,0.5832968354225159,0.5508371591567993,0.5126975774765015,0.5039889216423035,0.5013951063156128,0.48697787523269653,0.45832324028015137,0.4421732723712921,0.41571757197380066,0.4027911126613617,0.3986104428768158,0.3664930760860443,0.33190256357192993,0.32397475838661194,0.32146114110946655,0.3037983775138855,0.2934706211090088,0.2728487253189087,0.2629707455635071,0.25593698024749756,0.2510267198085785,0.23130708932876587,0.22690708935260773,0.22068668901920319,0.20088085532188416,0.19547219574451447,0.17690981924533844,0.17433476448059082,0.16527892649173737,0.15989950299263,0.15082065761089325,0.15044862031936646,0.1444702297449112,0.13653616607189178,0.13339833915233612,0.12109428644180298,0.11672231554985046,0.11115076392889023,0.10550928860902786,0.09888853132724762,0.0923946276307106,0.08369728177785873,0.07611681520938873,0.05371889844536781,0.04033275693655014,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7389984130859375,0.7190212607383728,0.6480571031570435,0.6470828056335449,0.6009455919265747,0.5735146403312683,0.5216833353042603,0.507706344127655,0.5020371675491333,0.4889431595802307,0.46982336044311523,0.4421732723712921,0.41571757197380066,0.4027911126613617,0.37603139877319336,0.33190256357192993,0.32397475838661194,0.32146114110946655,0.29528969526290894,0.2769066095352173,0.26878052949905396,0.26139453053474426,0.2537226676940918,0.2310001105070114,0.22669893503189087,0.20406374335289001,0.19565008580684662,0.17690981924533844,0.17433476448059082,0.16527892649173737,0.15989950299263,0.15082065761089325,0.15044862031936646,0.14273330569267273,0.13586024940013885,0.132113978266716,0.12109428644180298,0.11672231554985046,0.11190908402204514,0.10553359240293503,0.09951391816139221,0.09539015591144562,0.0843665823340416,0.08058075606822968,0.06806748360395432,0.04033275693655014,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7389984130859375,0.7190212607383728,0.6480571031570435,0.6470828056335449,0.5837563276290894,0.5706039071083069,0.5126975774765015,0.5039889216423035,0.5013951063156128,0.48697787523269653,0.45832324028015137,0.4364587366580963,0.40744468569755554,0.4027911126613617,0.37603139877319336,0.33190256357192993,0.32397475838661194,0.32146114110946655,0.2934706211090088,0.26535528898239136,0.25593698024749756,0.23130708932876587,0.22690708935260773,0.22068668901920319,0.20088085532188416,0.1943197399377823,0.17647428810596466,0.17082706093788147,0.1621071696281433,0.15596339106559753,0.15061122179031372,0.14523592591285706,0.13653616607189178,0.13339833915233612,0.12492327392101288,0.11711706221103668,0.11418488621711731,0.1064460277557373,0.09951391816139221,0.09539015591144562,0.0843665823340416,0.08058075606822968,0.06806748360395432,0.0330684557557106,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7389984130859375,0.7190212607383728,0.6480571031570435,0.6470828056335449,0.5837563276290894,0.5706039071083069,0.5126975774765015,0.5039889216423035,0.49324971437454224,0.4712737202644348,0.44290438294410706,0.4235703647136688,0.403921902179718,0.3986104428768158,0.34619665145874023,0.32397475838661194,0.3037983775138855,0.2728487253189087,0.26139453053474426,0.2537226676940918,0.22923777997493744,0.22587302327156067,0.20406374335289001,0.19565008580684662,0.17647428810596466,0.17082706093788147,0.1621071696281433,0.15596339106559753,0.15061122179031372,0.14273330569267273,0.13586024940013885,0.12868961691856384,0.11845976859331131,0.11559164524078369,0.1064460277557373,0.09888853132724762,0.0923946276307106,0.08369728177785873,0.07611681520938873,0.05371889844536781,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573765397071838,0.9567309021949768,0.9560015797615051,0.9519712924957275,0.9490416646003723,0.9432522058486938,0.8686259984970093,0.8127071261405945,0.7729035019874573,0.7316728234291077,0.7064200639724731,0.6355875730514526,0.5706039071083069,0.5100491642951965,0.5039722919464111,0.4889431595802307,0.45832324028015137,0.41571757197380066,0.4027911126613617,0.34619665145874023,0.32397475838661194,0.3037983775138855,0.2728487253189087,0.26139453053474426,0.2537226676940918,0.22923777997493744,0.22587302327156067,0.20406374335289001,0.1943197399377823,0.17433476448059082,0.16527892649173737,0.15989950299263,0.15082065761089325,0.14931756258010864,0.13735134899616241,0.13339833915233612,0.12109428644180298,0.11672231554985046,0.11115076392889023,0.09888853132724762,0.0923946276307106,0.08148542791604996,0.07114356011152267,0.0330684557557106,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9650460481643677,0.9642735123634338,0.962285041809082,0.9594181180000305,0.9584938883781433,0.9573141932487488,0.9564145803451538,0.9548102617263794,0.9514526724815369,0.9435871839523315,0.9016796350479126,0.8514154553413391,0.7859259247779846,0.7190212607383728,0.6355875730514526,0.5508371591567993,0.507706344127655,0.5013951063156128,0.45832324028015137,0.40744468569755554,0.3986104428768158,0.3280792534351349,0.26535528898239136,0.25593698024749756,0.23130708932876587,0.22587302327156067,0.20055942237377167,0.17647428810596466,0.16527892649173737,0.1573040634393692,0.15061122179031372,0.14273330569267273,0.12492327392101288,0.11672231554985046,0.10500568151473999,0.08603867888450623,0.07114356011152267,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9806437492370605,0.9794712662696838,0.9789651036262512,0.9782550930976868,0.9764606952667236,0.9753260612487793,0.9739125967025757,0.9723818302154541,0.9716049432754517,0.9644217491149902,0.9612260460853577,0.9584938883781433,0.9568257331848145,0.9560073614120483,0.9538499712944031,0.9490416646003723,0.9408732652664185,0.8514154553413391,0.7389984130859375,0.5706039071083069,0.5100491642951965,0.4889431595802307,0.4421732723712921,0.37603139877319336,0.22923777997493744,0.20055942237377167,0.14273330569267273,0.12109428644180298,0.09539015591144562,0.06806748360395432,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]]},"title":{"ap":35.963737455625406,"ap50":45.82497853510442,"ap70":37.919540471954086,"ap90":27.58934006257302,"ar100":62.943143812709025}},"H51-control":{"counts":{"fn":147,"fp":232,"iou":0.5,"precision":39.583333333333336,"recall":50.836120401337794,"threshold":0.3,"tp":152},"model":{"completed_updates":1024,"sha256":"d086886d0666e878dea643721e98db0789317ef93a67e95f517a03922e8fe1c3","stage":"H51-control"},"panels":{"fin_val":{"ap":91.73710137237188,"ap50":96.4099632632333,"ap70":95.72830310105967,"ap90":89.01546582174996,"ar100":97.31012658227849,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":256,"per_class_ap":{"9":91.73710137237188},"taxonomy":"ax-document-unified-25/1"},"financial_val":{"ap":61.54451332090731,"ap50":74.82347437893793,"ap70":68.37143078364227,"ap90":43.45150000241278,"ar100":83.51945585499091,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":1745,"per_class_ap":{"1":50.790307872052466,"10":86.95649329534332,"11":21.537754862532495,"2":21.089752984835016,"3":-1.0,"4":86.26630590510274,"5":63.45967663532532,"6":48.37271223360353,"7":81.63817745625849,"8":65.42434020637644,"9":89.90961175764326},"taxonomy":"ax-document-unified-25/1"},"gold_val":{"ap":71.12138935941007,"ap50":88.67129396706581,"ap70":78.75562209735875,"ap90":50.94979086232245,"ar100":83.49783844438394,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":6489,"per_class_ap":{"1":87.04700605626007,"10":84.91962874561692,"11":37.09773755641038,"2":70.98562257535825,"3":66.03273966396873,"4":86.30603620785666,"5":54.172316702963194,"6":57.063027563254366,"7":86.45057247965717,"8":68.17739410145994,"9":84.08320130070514},"taxonomy":"ax-document-unified-25/1"}},"pr":{"iou_thresholds":[0.5,0.55,0.6,0.65,0.7,0.75,0.8,0.85,0.8999999999999999,0.95],"precision":[[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9552238805970149,0.9305555555555556,0.9012345679012346,0.9012345679012346,0.8666666666666667,0.8666666666666667,0.845360824742268,0.8155339805825242,0.7719298245614035,0.7459016393442623,0.7401574803149606,0.7384615384615385,0.6959459459459459,0.6959459459459459,0.6862745098039216,0.6829268292682927,0.6829268292682927,0.6666666666666666,0.6464088397790055,0.6417112299465241,0.615,0.6086956521739131,0.5909090909090909,0.5866666666666667,0.569620253164557,0.45874587458745875,0.43653250773993807,0.4289940828402367,0.4164305949008499,0.40540540540540543,0.3974358974358974,0.3954659949622166,0.375886524822695,0.34989200863930886,0.3098330241187384,0.3037974683544304,0.28859060402684567,0.2766295707472178,0.2657856093979442,0.2657856093979442,0.24563758389261744,0.24412532637075718,0.23833543505674654,0.2350061199510404,0.22860492379835873,0.21536796536796537,0.20997920997921,0.2042042042042042,0.1707920792079208,0.15373352855051245,0.14333781965006728,0.13506815365551425,0.13004750593824227,0.12177729018102029,0.11398176291793313,0.11057225994180407,0.09709962168978563,0.08715083798882682,0.0747722274583726,0.0639488409272582,0.05207886840977283,0.04792518994739918,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9402985074626866,0.9402985074626866,0.8918918918918919,0.8765432098765432,0.8314606741573034,0.8085106382978723,0.8041237113402062,0.7714285714285715,0.7368421052631579,0.6929133858267716,0.6923076923076923,0.6554054054054054,0.6554054054054054,0.6410256410256411,0.6402439024390244,0.6402439024390244,0.5966850828729282,0.5935828877005348,0.57,0.5652173913043478,0.5333333333333333,0.5189873417721519,0.41914191419141916,0.3993808049535604,0.3905325443786982,0.3788300835654596,0.37567567567567567,0.36855670103092786,0.36523929471032746,0.34988179669030733,0.3393665158371041,0.3248407643312102,0.2899628252788104,0.2760416666666667,0.2647058823529412,0.24963289280469897,0.24963289280469897,0.24818577648766327,0.2297650130548303,0.2244640605296343,0.22249690976514216,0.21453692848769051,0.20238095238095238,0.19750519750519752,0.1921921921921922,0.1608910891089109,0.14494875549048317,0.13526244952893673,0.12763320941759604,0.12292161520190023,0.1151947339550192,0.11216429699842022,0.10624692572552878,0.09538327526132404,0.08995137763371151,0.07847924659923265,0.07163053722902922,0.06155075939248601,0.05015002143163309,0.046171829339567504,0.01513431706394249,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9402985074626866,0.9402985074626866,0.8918918918918919,0.8765432098765432,0.8314606741573034,0.8085106382978723,0.7878787878787878,0.7363636363636363,0.6967213114754098,0.6850393700787402,0.6418918918918919,0.6418918918918919,0.64,0.6280487804878049,0.6280487804878049,0.5898876404494382,0.5828877005347594,0.5634517766497462,0.5560975609756098,0.5318181818181819,0.5106382978723404,0.41694915254237286,0.3931888544891641,0.38461538461538464,0.37393767705382436,0.371900826446281,0.3641160949868074,0.3634020618556701,0.3564356435643564,0.33715596330275227,0.32397408207343414,0.2862453531598513,0.2736842105263158,0.26677852348993286,0.25194401244167963,0.24522760646108663,0.24383164005805516,0.22715404699738903,0.22715404699738903,0.2200247218788628,0.2155688622754491,0.20748299319727892,0.19957081545064378,0.19404517453798767,0.16566005176876616,0.15776699029126215,0.140625,0.12639405204460966,0.12639405204460966,0.1148723640399556,0.11290322580645161,0.1056547619047619,0.10414657666345227,0.09132610508757298,0.08268156424581005,0.07100219918316054,0.06291390728476821,0.05167785234899329,0.04578219364893824,0.024325156522631633,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9402985074626866,0.9402985074626866,0.8918918918918919,0.8765432098765432,0.8314606741573034,0.8085106382978723,0.7878787878787878,0.7363636363636363,0.6967213114754098,0.6850393700787402,0.6351351351351351,0.6351351351351351,0.6219512195121951,0.6219512195121951,0.6219512195121951,0.5737704918032787,0.5482233502538071,0.5414634146341464,0.5181818181818182,0.4978902953586498,0.4067796610169492,0.38390092879256965,0.3757396449704142,0.3654390934844193,0.36363636363636365,0.3562005277044855,0.3556701030927835,0.349009900990099,0.3302752293577982,0.3174946004319654,0.28066914498141265,0.26842105263157895,0.26174496644295303,0.24727838258164853,0.2393538913362702,0.2301255230125523,0.22193211488250653,0.21689785624211855,0.21508034610630408,0.20750293083235638,0.1958874458874459,0.19022869022869024,0.17079889807162535,0.15372168284789645,0.138328530259366,0.1282051282051282,0.12329615861214374,0.11273135165451487,0.11021505376344086,0.10486322188449848,0.10184287099903007,0.08953341740226986,0.08184918529746116,0.07103470645475186,0.06216746009521142,0.052521008403361345,0.047010309278350516,0.03128385698808234,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9402985074626866,0.9402985074626866,0.8918918918918919,0.8765432098765432,0.8295454545454546,0.78125,0.7428571428571429,0.7105263157894737,0.6692913385826772,0.6170212765957447,0.6148648648648649,0.6036585365853658,0.6036585365853658,0.6036585365853658,0.5573770491803278,0.5172413793103449,0.5,0.47257383966244726,0.3864406779661017,0.3653250773993808,0.35798816568047337,0.34844192634560905,0.34324324324324323,0.3368146214099217,0.33249370277078083,0.30963302752293576,0.2929936305732484,0.2620817843866171,0.25,0.23370429252782193,0.22320117474302498,0.2220609579100145,0.206266318537859,0.201765447667087,0.20024721878862795,0.19347319347319347,0.1829004329004329,0.17775467775467776,0.17125984251968504,0.14603960396039603,0.13177159590043924,0.12314939434724091,0.1171003717472119,0.1171003717472119,0.10654827968923418,0.10483870967741936,0.09821428571428571,0.09691417550626807,0.08507089241034195,0.07709497206703911,0.06628966383914546,0.058774834437086095,0.04832214765100671,0.04285992596921878,0.022785589654110643,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9402985074626866,0.9402985074626866,0.8918918918918919,0.8765432098765432,0.8295454545454546,0.78125,0.7428571428571429,0.7105263157894737,0.6692913385826772,0.6170212765957447,0.6148648648648649,0.6036585365853658,0.6036585365853658,0.6036585365853658,0.5573770491803278,0.5172413793103449,0.5,0.47257383966244726,0.3864406779661017,0.3653250773993808,0.35798816568047337,0.34844192634560905,0.3324538258575198,0.30641330166270786,0.2926829268292683,0.2527881040892193,0.24642857142857144,0.23657718120805368,0.223950233281493,0.2173274596182085,0.20134228187919462,0.19973890339425587,0.19330855018587362,0.1864801864801865,0.1764069264069264,0.17151767151767153,0.16535433070866143,0.14108910891089108,0.1273792093704246,0.11911170928667564,0.11338289962825279,0.11338289962825279,0.10431856421761077,0.10215053763440861,0.0972644376899696,0.09456838021338507,0.0832282471626734,0.07616521409624857,0.06616931560168667,0.05796695603472417,0.049019607843137254,0.043917525773195874,0.022169762906702247,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9833333333333333,0.9402985074626866,0.9402985074626866,0.8918918918918919,0.8765432098765432,0.8295454545454546,0.78125,0.7428571428571429,0.7105263157894737,0.6692913385826772,0.6170212765957447,0.6148648648648649,0.6,0.5975609756097561,0.5892857142857143,0.5396825396825397,0.5121951219512195,0.48,0.3908450704225352,0.37623762376237624,0.34911242603550297,0.33994334277620397,0.31139240506329113,0.2850678733031674,0.25851703406813625,0.23869801084990958,0.234375,0.21939586645468998,0.20998531571218795,0.20899854862119013,0.19321148825065274,0.18915510718789408,0.18323353293413175,0.17687074829931973,0.17060085836909872,0.1594488188976378,0.13613861386138615,0.12103746397694524,0.11242603550295859,0.10842627013630732,0.10405643738977072,0.09873834339001646,0.09270516717325228,0.09020368574199807,0.07944514501891552,0.07275483137552104,0.06325008108984755,0.05544665359843181,0.0469187675070028,0.04206185567010309,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9821428571428571,0.9821428571428571,0.9821428571428571,0.9821428571428571,0.9821428571428571,0.9821428571428571,0.9666666666666667,0.9253731343283582,0.8888888888888888,0.8641975308641975,0.8641975308641975,0.8181818181818182,0.6818181818181818,0.6446280991735537,0.6230769230769231,0.5753424657534246,0.5612903225806452,0.5521472392638037,0.5081967213114754,0.4729064039408867,0.4177215189873418,0.33993399339933994,0.3220858895705521,0.3059490084985836,0.2810126582278481,0.2579185520361991,0.23446893787575152,0.21699819168173598,0.21354166666666666,0.20031796502384738,0.19089574155653452,0.17718120805369128,0.1762402088772846,0.17100371747211895,0.1655011655011655,0.15692640692640691,0.15092402464065707,0.12942191544434858,0.11200585651537336,0.10497981157469717,0.09913258983890955,0.09085810431856421,0.0889967637540453,0.08333333333333333,0.08244937319189971,0.0725604670558799,0.061737007324729684,0.05655042412818096,0.04876099120703437,0.039862837548221175,0.03682057276446522,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.975609756097561,0.9636363636363636,0.9636363636363636,0.9636363636363636,0.9636363636363636,0.9333333333333333,0.8955223880597015,0.8955223880597015,0.8513513513513513,0.8148148148148148,0.6272727272727273,0.5714285714285714,0.5136986301369864,0.5032258064516129,0.48214285714285715,0.4444444444444444,0.37130801687763715,0.29900332225913623,0.26345609065155806,0.22802850356294538,0.21019108280254778,0.18214285714285713,0.16329704510108864,0.1567489114658926,0.1462140992167102,0.1336459554513482,0.1266233766233766,0.12012012012012012,0.10148514851485149,0.08948863636363637,0.07992565055762081,0.07240811848601207,0.06640432857845549,0.058007566204287514,0.04461200125667609,0.03836930455635491,0.03150450064294899,0.029222676797194622,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9642857142857143,0.8823529411764706,0.8333333333333334,0.8333333333333334,0.8333333333333334,0.8333333333333334,0.8333333333333334,0.8,0.7727272727272727,0.6923076923076923,0.5087719298245614,0.425531914893617,0.42,0.3707865168539326,0.350253807106599,0.23920265780730898,0.12254901960784313,0.10469798657718121,0.08108108108108109,0.06818181818181818,0.047723532638507954,0.04339440694310511,0.029531888155827836,0.020574367766823833,0.007099318752240947,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]],"recall_thresholds":[0.0,0.01,0.02,0.03,0.04,0.05,0.06,0.07,0.08,0.09,0.1,0.11,0.12,0.13,0.14,0.15,0.16,0.17,0.18,0.19,0.2,0.21,0.22,0.23,0.24,0.25,0.26,0.27,0.28,0.29,0.3,0.31,0.32,0.33,0.34,0.35000000000000003,0.36,0.37,0.38,0.39,0.4,0.41000000000000003,0.42,0.43,0.44,0.45,0.46,0.47000000000000003,0.48,0.49,0.5,0.51,0.52,0.53,0.54,0.55,0.56,0.5700000000000001,0.58,0.59,0.6,0.61,0.62,0.63,0.64,0.65,0.66,0.67,0.68,0.6900000000000001,0.7000000000000001,0.71,0.72,0.73,0.74,0.75,0.76,0.77,0.78,0.79,0.8,0.81,0.8200000000000001,0.8300000000000001,0.84,0.85,0.86,0.87,0.88,0.89,0.9,0.91,0.92,0.93,0.9400000000000001,0.9500000000000001,0.96,0.97,0.98,0.99,1.0],"scores":[[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9589502215385437,0.9579772353172302,0.9574539065361023,0.9564370512962341,0.9528476595878601,0.9513405561447144,0.9449191689491272,0.9412716031074524,0.8671646118164062,0.8186838626861572,0.7771591544151306,0.7497007250785828,0.7136091589927673,0.7056397795677185,0.6818967461585999,0.6522378921508789,0.6200374364852905,0.5956525206565857,0.5766485929489136,0.5692108273506165,0.539625346660614,0.5348696112632751,0.524004340171814,0.5048508644104004,0.49664923548698425,0.4751901626586914,0.46791937947273254,0.462502121925354,0.44887426495552063,0.4381474554538727,0.42415472865104675,0.41848909854888916,0.40364307165145874,0.350677490234375,0.3406250774860382,0.33488965034484863,0.3237136900424957,0.30961132049560547,0.2981020212173462,0.2913847267627716,0.2782512903213501,0.25974375009536743,0.2321736365556717,0.2247842401266098,0.21412034332752228,0.20708627998828888,0.19726358354091644,0.19437378644943237,0.18283788859844208,0.17937682569026947,0.17665082216262817,0.17276422679424286,0.16816474497318268,0.16026897728443146,0.15627551078796387,0.15263104438781738,0.13487662374973297,0.12580697238445282,0.11885173618793488,0.11403951793909073,0.1101522222161293,0.10546615719795227,0.10069839656352997,0.09812770783901215,0.09037834405899048,0.08403317630290985,0.0756792351603508,0.06853865087032318,0.060330018401145935,0.05722614750266075,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7571200132369995,0.7136091589927673,0.6877915859222412,0.6697161793708801,0.6510984897613525,0.6180610060691833,0.5766485929489136,0.5692108273506165,0.539625346660614,0.5348696112632751,0.5178893208503723,0.5004462003707886,0.49275708198547363,0.46791937947273254,0.462502121925354,0.44887426495552063,0.4381474554538727,0.41848909854888916,0.40364307165145874,0.350677490234375,0.3406250774860382,0.33450010418891907,0.3199605643749237,0.3099183440208435,0.30080175399780273,0.2913847267627716,0.27900320291519165,0.27025362849235535,0.25574302673339844,0.23165062069892883,0.21900638937950134,0.210280179977417,0.19950267672538757,0.195187509059906,0.19172407686710358,0.1798563301563263,0.1768106371164322,0.17373819649219513,0.16816474497318268,0.16026897728443146,0.15627551078796387,0.15263104438781738,0.13487662374973297,0.12580697238445282,0.11885173618793488,0.11403951793909073,0.1101522222161293,0.10546615719795227,0.10333684086799622,0.09880973398685455,0.09254797548055649,0.08846885710954666,0.08045994490385056,0.07556277513504028,0.06853865087032318,0.060330018401145935,0.05722614750266075,0.026615668088197708,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7571200132369995,0.7136091589927673,0.6877915859222412,0.6569941639900208,0.6329759955406189,0.5956525206565857,0.574152410030365,0.5408576726913452,0.5353946089744568,0.5319778323173523,0.5048508644104004,0.49664923548698425,0.4710395634174347,0.4628496766090393,0.4503069519996643,0.4392332434654236,0.42334437370300293,0.40728917717933655,0.35393026471138,0.3422738015651703,0.33488965034484863,0.3237136900424957,0.3147604763507843,0.30488234758377075,0.2980095148086548,0.28888583183288574,0.27182137966156006,0.25974375009536743,0.2321736365556717,0.22084392607212067,0.2140979766845703,0.20460821688175201,0.195187509059906,0.19172407686710358,0.17989522218704224,0.17912280559539795,0.17394860088825226,0.17063970863819122,0.16492217779159546,0.1592438668012619,0.1544380784034729,0.1390257477760315,0.13348928093910217,0.12305901199579239,0.11452692747116089,0.11342701315879822,0.10599956661462784,0.10449545830488205,0.09935172647237778,0.09788438677787781,0.08989707380533218,0.08403317630290985,0.0756792351603508,0.06973738223314285,0.06194167956709862,0.05723701789975166,0.03908626735210419,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7571200132369995,0.7136091589927673,0.6877915859222412,0.6569941639900208,0.6329759955406189,0.5956525206565857,0.574152410030365,0.5408576726913452,0.5348696112632751,0.5178893208503723,0.5004462003707886,0.49275708198547363,0.4657750725746155,0.4503069519996643,0.4392332434654236,0.42334437370300293,0.40728917717933655,0.35393026471138,0.3422738015651703,0.33488965034484863,0.3237136900424957,0.3147604763507843,0.30488234758377075,0.2980095148086548,0.28888583183288574,0.27182137966156006,0.25974375009536743,0.2321736365556717,0.22084392607212067,0.2140979766845703,0.20460821688175201,0.19437378644943237,0.18659290671348572,0.1798563301563263,0.1768106371164322,0.17373819649219513,0.16816474497318268,0.16026897728443146,0.15594027936458588,0.14424945414066315,0.13393591344356537,0.12465009093284607,0.11719609797000885,0.11345991492271423,0.10664643347263336,0.10463906824588776,0.10069839656352997,0.09812770783901215,0.09037834405899048,0.08487530052661896,0.07703690230846405,0.07037324458360672,0.06332047283649445,0.059061672538518906,0.046421777456998825,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7571200132369995,0.7136091589927673,0.6818967461585999,0.6510984897613525,0.6180610060691833,0.5766485929489136,0.5444192886352539,0.5348696112632751,0.5178893208503723,0.5004462003707886,0.49275708198547363,0.4657750725746155,0.4445972740650177,0.4271862208843231,0.40728917717933655,0.35393026471138,0.3422738015651703,0.33488965034484863,0.3237136900424957,0.3099183440208435,0.30080175399780273,0.290158748626709,0.27182137966156006,0.25574302673339844,0.23165062069892883,0.21900638937950134,0.20708627998828888,0.1955386847257614,0.19172407686710358,0.1798563301563263,0.1768106371164322,0.17373819649219513,0.16816474497318268,0.16026897728443146,0.15594027936458588,0.1509931981563568,0.13487662374973297,0.12580697238445282,0.11885173618793488,0.11452692747116089,0.11342701315879822,0.10599956661462784,0.10449545830488205,0.09935172647237778,0.09788438677787781,0.08989707380533218,0.08403317630290985,0.0756792351603508,0.06973738223314285,0.06194167956709862,0.05723701789975166,0.03908626735210419,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7571200132369995,0.7136091589927673,0.6818967461585999,0.6510984897613525,0.6180610060691833,0.5766485929489136,0.5444192886352539,0.5348696112632751,0.5178893208503723,0.5004462003707886,0.49275708198547363,0.4657750725746155,0.4445972740650177,0.4271862208843231,0.40728917717933655,0.35393026471138,0.3422738015651703,0.33488965034484863,0.3237136900424957,0.30488234758377075,0.27900320291519165,0.265285462141037,0.2321736365556717,0.22373263537883759,0.2140979766845703,0.20460821688175201,0.19437378644943237,0.18283788859844208,0.17912280559539795,0.17394860088825226,0.16816474497318268,0.16026897728443146,0.15594027936458588,0.1509931981563568,0.13487662374973297,0.12580697238445282,0.11885173618793488,0.11452692747116089,0.11342701315879822,0.10664643347263336,0.10463906824588776,0.10069839656352997,0.09812770783901215,0.09037834405899048,0.08487530052661896,0.07703690230846405,0.07037324458360672,0.06332047283649445,0.059061672538518906,0.03908626735210419,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7571200132369995,0.7136091589927673,0.6818967461585999,0.6510984897613525,0.6180610060691833,0.5766485929489136,0.5444192886352539,0.5348696112632751,0.5178893208503723,0.49930691719055176,0.48559483885765076,0.4597071707248688,0.4392332434654236,0.41848909854888916,0.3606284260749817,0.34981614351272583,0.33488965034484863,0.3237136900424957,0.2913847267627716,0.27025362849235535,0.2480878382921219,0.2247842401266098,0.21900638937950134,0.20708627998828888,0.1955386847257614,0.19172407686710358,0.1798563301563263,0.17665082216262817,0.17063970863819122,0.16492217779159546,0.1592438668012619,0.1509931981563568,0.13487662374973297,0.12465009093284607,0.11719609797000885,0.11345991492271423,0.1095149964094162,0.10546615719795227,0.10069839656352997,0.09812770783901215,0.09037834405899048,0.08487530052661896,0.07703690230846405,0.07037324458360672,0.06332047283649445,0.059061672538518906,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.9578291177749634,0.9568666815757751,0.9542897939682007,0.9523355960845947,0.9507055282592773,0.9430616497993469,0.8762680888175964,0.8186838626861572,0.7771591544151306,0.7497007250785828,0.7133811116218567,0.6329759955406189,0.5956525206565857,0.5692108273506165,0.5353946089744568,0.5178893208503723,0.49664923548698425,0.4657750725746155,0.4445972740650177,0.40364307165145874,0.350677490234375,0.3398614227771759,0.3237136900424957,0.2913847267627716,0.27025362849235535,0.2480878382921219,0.2247842401266098,0.21900638937950134,0.20708627998828888,0.19437378644943237,0.18283788859844208,0.17912280559539795,0.17394860088825226,0.16816474497318268,0.16026897728443146,0.1544380784034729,0.1390257477760315,0.12580697238445282,0.11885173618793488,0.11345991492271423,0.10664643347263336,0.10463906824588776,0.09935172647237778,0.09788438677787781,0.08989707380533218,0.08045994490385056,0.07556277513504028,0.06853865087032318,0.060330018401145935,0.05722614750266075,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.9659830331802368,0.964566707611084,0.9623371362686157,0.9607317447662354,0.9588751196861267,0.957758903503418,0.9568484425544739,0.9537208080291748,0.9522246718406677,0.9441413283348083,0.9042176604270935,0.8646613359451294,0.7874107360839844,0.7373836040496826,0.6329759955406189,0.5766485929489136,0.5353946089744568,0.5178893208503723,0.48559483885765076,0.4597071707248688,0.40728917717933655,0.350677490234375,0.3237136900424957,0.27900320291519165,0.25574302673339844,0.22373263537883759,0.20460821688175201,0.19172407686710358,0.1798563301563263,0.16816474497318268,0.1596909761428833,0.15263104438781738,0.13487662374973297,0.12305901199579239,0.11342701315879822,0.10546615719795227,0.09880973398685455,0.09037834405899048,0.0756792351603508,0.06853865087032318,0.060330018401145935,0.05722614750266075,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9808706641197205,0.9795452356338501,0.9784899353981018,0.977661669254303,0.9764427542686462,0.9749583601951599,0.9738199710845947,0.9721789956092834,0.9713567495346069,0.965752124786377,0.9620546102523804,0.9588751196861267,0.9574539065361023,0.9564370512962341,0.9528476595878601,0.9513405561447144,0.9412716031074524,0.8671646118164062,0.7717852592468262,0.6200374364852905,0.5444192886352539,0.5319778323173523,0.4710395634174347,0.4503069519996643,0.350677490234375,0.210280179977417,0.18283788859844208,0.15263104438781738,0.13393591344356537,0.10546615719795227,0.09788438677787781,0.0756792351603508,0.060330018401145935,0.029932433739304543,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]]},"title":{"ap":37.09773755641038,"ap50":47.67067642108576,"ap70":39.006786088722876,"ap90":28.09417805581423,"ar100":68.2943143812709}},"H51-title":{"counts":{"fn":131,"fp":296,"iou":0.5,"precision":36.206896551724135,"recall":56.187290969899664,"threshold":0.3,"tp":168},"model":{"completed_updates":1024,"sha256":"44b75b2ca14d7d4756ca51d402d470d069f17ee99145717e1994549b32ef87d2","stage":"H51-title"},"panels":{"fin_val":{"ap":91.57739593169711,"ap50":96.39212272259813,"ap70":95.6720891685565,"ap90":88.44809936812516,"ar100":97.12025316455696,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":256,"per_class_ap":{"9":91.57739593169711},"taxonomy":"ax-document-unified-25/1"},"financial_val":{"ap":61.73305632696384,"ap50":74.96501865247365,"ap70":68.85316694919942,"ap90":43.47744892431575,"ar100":83.61329149193345,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":1745,"per_class_ap":{"1":50.78315145536768,"10":87.04993624291704,"11":22.668975296494782,"2":21.06518949188169,"3":-1.0,"4":86.4342933581353,"5":63.68508463365829,"6":48.562555445664245,"7":81.62495775148074,"8":65.49366226902261,"9":89.96275732501599},"taxonomy":"ax-document-unified-25/1"},"gold_val":{"ap":71.53267127947552,"ap50":88.96970146715404,"ap70":79.30542557035115,"ap90":51.442965386769316,"ar100":84.26815515047466,"ignore_regions_policy":"historical_d5_unfiltered","independent_final_test":false,"pages":6489,"per_class_ap":{"1":87.08961007399112,"10":85.14502829116108,"11":38.745347586625584,"2":71.23827368382588,"3":65.97418621206323,"4":86.56001042643845,"5":54.89541594216855,"6":57.75922516457215,"7":86.42092276593523,"8":68.62054515710344,"9":84.41081877034607},"taxonomy":"ax-document-unified-25/1"}},"pr":{"iou_thresholds":[0.5,0.55,0.6,0.65,0.7,0.75,0.8,0.85,0.8999999999999999,0.95],"precision":[[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.967741935483871,0.967741935483871,0.967741935483871,0.9402985074626866,0.9358974358974359,0.9358974358974359,0.9358974358974359,0.9259259259259259,0.8876404494382022,0.8350515463917526,0.8018867924528302,0.7767857142857143,0.7711864406779662,0.768595041322314,0.7559055118110236,0.7333333333333333,0.7222222222222222,0.7114093959731543,0.7105263157894737,0.6608187134502924,0.6555555555555556,0.6555555555555556,0.6417112299465241,0.6358974358974359,0.6116504854368932,0.583710407239819,0.5833333333333334,0.5793991416309013,0.5348837209302325,0.5280898876404494,0.4816053511705686,0.4625,0.438953488372093,0.43714285714285717,0.43213296398891965,0.412987012987013,0.40198511166253104,0.39855072463768115,0.36363636363636365,0.3426294820717131,0.3252336448598131,0.3089005235602094,0.30016583747927034,0.2785388127853881,0.2719298245614035,0.2650771388499299,0.26265389876880985,0.2496798975672215,0.2391304347826087,0.2376470588235294,0.2357630979498861,0.2357630979498861,0.22950819672131148,0.21215139442231076,0.19427036705461057,0.19193689745836984,0.17494089834515367,0.15141318977119786,0.14941022280471822,0.1476038338658147,0.1472624292007552,0.13412563667232597,0.1301518438177874,0.11970443349753694,0.11373092926490985,0.09507445589919816,0.0860655737704918,0.07736650485436893,0.06275845293116031,0.059944878272852546,0.04154209284028324,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9516129032258065,0.9516129032258065,0.9104477611940298,0.8888888888888888,0.8717948717948718,0.8625,0.8202247191011236,0.7731958762886598,0.7155963302752294,0.7043478260869566,0.6942148760330579,0.6850393700787402,0.6546762589928058,0.6527777777777778,0.6447368421052632,0.61875,0.6023391812865497,0.5965909090909091,0.5901639344262295,0.5773195876288659,0.5533980582524272,0.5263157894736842,0.5263157894736842,0.5125,0.4846153846153846,0.47601476014760147,0.4414715719063545,0.4231974921630094,0.4011627906976744,0.39385474860335196,0.38666666666666666,0.37468354430379747,0.3719806763285024,0.3719806763285024,0.36027713625866054,0.3258655804480652,0.32270916334661354,0.3044280442804428,0.2847457627118644,0.2835820895522388,0.26165413533834586,0.25578034682080925,0.25,0.24696356275303644,0.23604060913705585,0.22588235294117648,0.22588235294117648,0.22413793103448276,0.22048997772828507,0.20119521912350596,0.18664226898444647,0.183348095659876,0.16894609814963799,0.15627292736610418,0.14361702127659576,0.14285714285714285,0.14096916299559473,0.1391465677179963,0.12903225806451613,0.12527114967462039,0.11527093596059114,0.10957004160887657,0.09163802978235967,0.08299180327868852,0.07463592233009708,0.06056920457309657,0.05787781350482315,0.044463818657367045,0.025242148517757558,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9516129032258065,0.9516129032258065,0.9104477611940298,0.8888888888888888,0.8717948717948718,0.8625,0.8202247191011236,0.7731958762886598,0.6964285714285714,0.6864406779661016,0.6774193548387096,0.6590909090909091,0.6474820143884892,0.6458333333333334,0.6381578947368421,0.6073619631901841,0.5964912280701754,0.5888888888888889,0.5775401069518716,0.5721649484536082,0.5219298245614035,0.5219298245614035,0.5194805194805194,0.4807692307692308,0.4772727272727273,0.4574468085106383,0.4370860927152318,0.40298507462686567,0.39714285714285713,0.39058171745152354,0.384,0.3721518987341772,0.3695652173913043,0.3695652173913043,0.3398268398268398,0.32382892057026474,0.30916030534351147,0.29891304347826086,0.2823529411764706,0.27491961414790994,0.2577777777777778,0.2539454806312769,0.24861878453038674,0.23431498079385404,0.2246376811594203,0.2235294117647059,0.2218390804597701,0.2182628062360802,0.20996818663838812,0.20019920318725098,0.18352730528200537,0.18141980718667836,0.16548463356973994,0.14450474898236093,0.142668428005284,0.14193130265716136,0.14033983637507866,0.13711151736745886,0.1281618887015177,0.11708058793715155,0.11331719128329298,0.09846281678437889,0.0893189430591738,0.07982917214191852,0.06693877551020408,0.05948399426660296,0.04849884526558892,0.04012588512981904,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9516129032258065,0.9516129032258065,0.9104477611940298,0.8888888888888888,0.8717948717948718,0.8625,0.8202247191011236,0.7731958762886598,0.6964285714285714,0.6864406779661016,0.6774193548387096,0.6590909090909091,0.6474820143884892,0.6458333333333334,0.631578947368421,0.5906432748538012,0.5852272727272727,0.5737704918032787,0.5618556701030928,0.5067873303167421,0.5066666666666667,0.5021459227467812,0.4653846153846154,0.4606741573033708,0.43448275862068964,0.41346153846153844,0.3866279069767442,0.38571428571428573,0.37333333333333335,0.36623376623376624,0.35990338164251207,0.35990338164251207,0.3546099290780142,0.33116883116883117,0.31274900398406374,0.297196261682243,0.28272251308900526,0.2752902155887231,0.2557077625570776,0.25,0.24403927068723702,0.2388663967611336,0.2236024844720497,0.21764705882352942,0.21627906976744185,0.2152619589977221,0.2098360655737705,0.1952191235059761,0.18115279048490393,0.17803365810451727,0.1607565011820331,0.14043419267299864,0.13870541611624834,0.13804277381723914,0.13656387665198239,0.13345521023765997,0.12478920741989882,0.11403953370501774,0.11041162227602906,0.09597008724553385,0.08708596948269445,0.0778580814717477,0.0653061224489796,0.058050645007166744,0.046153846153846156,0.03449231195456434,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9516129032258065,0.9516129032258065,0.9104477611940298,0.8888888888888888,0.8717948717948718,0.8625,0.8202247191011236,0.7731958762886598,0.6869565217391305,0.6776859504132231,0.6692913385826772,0.6330935251798561,0.625,0.6118421052631579,0.5730994152046783,0.5657142857142857,0.5454545454545454,0.5412371134020618,0.4888888888888889,0.4868421052631579,0.44357976653696496,0.43820224719101125,0.41379310344827586,0.3942307692307692,0.3691860465116279,0.36857142857142855,0.3546666666666667,0.34430379746835443,0.3414043583535109,0.3414043583535109,0.3130434782608696,0.29282868525896416,0.2767527675276753,0.2593220338983051,0.2508038585209003,0.23909774436090225,0.23410404624277456,0.2292817679558011,0.21510883482714468,0.20652173913043478,0.20588235294117646,0.2045977011494253,0.20155902004454343,0.1890495867768595,0.1712707182320442,0.1692032229185318,0.15446500402252614,0.15069551777434312,0.13432835820895522,0.13276089828269486,0.1322099805573558,0.13089993706733793,0.12797074954296161,0.11973018549747048,0.10947795235681702,0.10605326876513317,0.0922309929372663,0.08373650911797544,0.07547169811320754,0.07008495145631068,0.056920457309657016,0.04561200923787529,0.03324560188391744,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9516129032258065,0.9516129032258065,0.9104477611940298,0.8888888888888888,0.8717948717948718,0.8625,0.8202247191011236,0.7731958762886598,0.6869565217391305,0.6776859504132231,0.6692913385826772,0.6330935251798561,0.625,0.6118421052631579,0.5730994152046783,0.5657142857142857,0.5454545454545454,0.5412371134020618,0.4888888888888889,0.4868421052631579,0.44357976653696496,0.4317343173431734,0.4013377926421405,0.38557993730407525,0.36627906976744184,0.3466666666666667,0.3367088607594937,0.33171912832929784,0.3262411347517731,0.28775510204081634,0.2801556420233463,0.266304347826087,0.25210084033613445,0.23404255319148937,0.2311111111111111,0.22812051649928264,0.22375690607734808,0.20939086294416243,0.20047449584816132,0.19885057471264367,0.19817767653758542,0.1828512396694215,0.16574585635359115,0.1638316920322292,0.14963797264682221,0.14605873261205565,0.13025780189959293,0.1287978863936592,0.12832145171743356,0.12712397734424166,0.12431444241316271,0.1163575042158516,0.10643689812468322,0.10314769975786925,0.08973826339842127,0.08150353554149609,0.07348560079443893,0.06826456310679611,0.055460958404281196,0.044457274826789836,0.02289404167889639,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9516129032258065,0.9516129032258065,0.9104477611940298,0.8888888888888888,0.8717948717948718,0.8625,0.8202247191011236,0.7731958762886598,0.6869565217391305,0.6776859504132231,0.6692913385826772,0.6330935251798561,0.625,0.58125,0.5672514619883041,0.55,0.5360824742268041,0.5121951219512195,0.48444444444444446,0.4723404255319149,0.42066420664206644,0.391304347826087,0.3761755485893417,0.3524355300859599,0.32151898734177214,0.3161764705882353,0.30484988452655887,0.27091633466135456,0.2633587786259542,0.24607329842931938,0.24,0.22340425531914893,0.21929824561403508,0.21458625525946703,0.21052631578947367,0.19751552795031055,0.19217081850533807,0.19080459770114944,0.1870824053452116,0.17031872509960158,0.1566696508504924,0.14700996677740863,0.14084507042253522,0.13426265590608952,0.12285336856010567,0.12248865845755022,0.12113564668769716,0.11430246189917936,0.11024498886414254,0.09901477832512315,0.09431345353675451,0.07903780068728522,0.07172131147540983,0.06576103735720902,0.05278592375366569,0.050694444444444445,0.03493312352478364,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9807692307692307,0.9482758620689655,0.9354838709677419,0.8955223880597015,0.875,0.8589743589743589,0.8214285714285714,0.8089887640449438,0.7142857142857143,0.6299212598425197,0.5899280575539568,0.5833333333333334,0.54375,0.5263157894736842,0.5081967213114754,0.4948453608247423,0.44,0.3968871595330739,0.3723404255319149,0.3576158940397351,0.33134328358208953,0.304,0.28921568627450983,0.28368794326241137,0.2510204081632653,0.245136186770428,0.23369565217391305,0.2218487394957983,0.2066869300911854,0.20444444444444446,0.20229555236728838,0.19433198380566802,0.1826086956521739,0.17793594306049823,0.17701149425287357,0.17371937639198218,0.15836653386454183,0.1459265890778872,0.13704318936877077,0.13145539906103287,0.11601085481682497,0.1141552511415525,0.11309904153354633,0.11131725417439703,0.1035653650254669,0.10086767895878525,0.09104046242774566,0.07532365633581797,0.06825341267063353,0.06504599211563732,0.054693877551020405,0.048733874820831344,0.03883677298311445,0.008199281586756209,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.975609756097561,0.975609756097561,0.9615384615384616,0.9615384615384616,0.9615384615384616,0.9444444444444444,0.9032258064516129,0.8656716417910447,0.8472222222222222,0.8333333333333334,0.825,0.711340206185567,0.5748031496062992,0.539568345323741,0.527027027027027,0.47953216374269003,0.45901639344262296,0.39545454545454545,0.3829787234042553,0.32978723404255317,0.2865671641791045,0.264,0.25,0.21115537848605578,0.20610687022900764,0.188135593220339,0.16666666666666666,0.14980793854033292,0.14492753623188406,0.14367816091954022,0.14350797266514806,0.12848605577689243,0.11691762621789194,0.10641627543035993,0.1012472487160675,0.09197651663405088,0.09085173501577287,0.0831918505942275,0.07389162561576355,0.0635646032405484,0.05805731298846297,0.05263157894736842,0.0491504854368932,0.04013621989783508,0.03151969981238274,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,1.0,0.9393939393939394,0.868421052631579,0.8461538461538461,0.8461538461538461,0.8461538461538461,0.8333333333333334,0.7903225806451613,0.7611940298507462,0.7236842105263158,0.7125,0.48031496062992124,0.45323741007194246,0.4370860927152318,0.3942857142857143,0.32727272727272727,0.22388059701492538,0.14130434782608695,0.11187845303867404,0.08677685950413223,0.07705934455270151,0.0695517774343122,0.06131767775603392,0.05627198124267292,0.03883876029815614,0.03483606557377049,0.031856796116504854,0.025,0.004953809077520418,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]],"recall_thresholds":[0.0,0.01,0.02,0.03,0.04,0.05,0.06,0.07,0.08,0.09,0.1,0.11,0.12,0.13,0.14,0.15,0.16,0.17,0.18,0.19,0.2,0.21,0.22,0.23,0.24,0.25,0.26,0.27,0.28,0.29,0.3,0.31,0.32,0.33,0.34,0.35000000000000003,0.36,0.37,0.38,0.39,0.4,0.41000000000000003,0.42,0.43,0.44,0.45,0.46,0.47000000000000003,0.48,0.49,0.5,0.51,0.52,0.53,0.54,0.55,0.56,0.5700000000000001,0.58,0.59,0.6,0.61,0.62,0.63,0.64,0.65,0.66,0.67,0.68,0.6900000000000001,0.7000000000000001,0.71,0.72,0.73,0.74,0.75,0.76,0.77,0.78,0.79,0.8,0.81,0.8200000000000001,0.8300000000000001,0.84,0.85,0.86,0.87,0.88,0.89,0.9,0.91,0.92,0.93,0.9400000000000001,0.9500000000000001,0.96,0.97,0.98,0.99,1.0],"scores":[[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9629714488983154,0.9615183472633362,0.9605504274368286,0.9588898420333862,0.9571018218994141,0.9555457234382629,0.9531269073486328,0.9481960535049438,0.9433715343475342,0.9076800346374512,0.87974613904953,0.8446134328842163,0.8336793184280396,0.8082473278045654,0.7811501026153564,0.7390376329421997,0.7180711030960083,0.6880785822868347,0.6772570610046387,0.6660756468772888,0.6564875245094299,0.640059769153595,0.6213714480400085,0.6026830077171326,0.5962578654289246,0.5664708018302917,0.5504096150398254,0.5445513725280762,0.5356774926185608,0.5271704196929932,0.5125007629394531,0.4921359121799469,0.481460839509964,0.47479113936424255,0.43466997146606445,0.4281533360481262,0.41068172454833984,0.39142918586730957,0.37547633051872253,0.36762404441833496,0.359282910823822,0.3424796164035797,0.328922837972641,0.32525625824928284,0.3003810942173004,0.28375929594039917,0.2715235650539398,0.25922268629074097,0.25030452013015747,0.23297248780727386,0.22520454227924347,0.21885305643081665,0.21617181599140167,0.20599210262298584,0.1984744668006897,0.19511975347995758,0.19228166341781616,0.19017817080020905,0.18525399267673492,0.17422926425933838,0.16283322870731354,0.16059510409832,0.15097030997276306,0.1369762271642685,0.13480252027511597,0.13268029689788818,0.13131868839263916,0.12294713407754898,0.11934226751327515,0.11162718385457993,0.10728315263986588,0.09616993367671967,0.08916086703538895,0.08277712017297745,0.07225973159074783,0.06968650966882706,0.055977463722229004,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7811501026153564,0.7390376329421997,0.694173276424408,0.6790473461151123,0.6660756468772888,0.6564875245094299,0.6329349279403687,0.6149629950523376,0.5988551378250122,0.5786262154579163,0.5619102716445923,0.5497795343399048,0.5403891205787659,0.5274484157562256,0.5125007629394531,0.48913753032684326,0.4780247211456299,0.46633657813072205,0.4330444633960724,0.42489781975746155,0.41068172454833984,0.39142918586730957,0.37489739060401917,0.3630130887031555,0.34822750091552734,0.33368465304374695,0.3280494511127472,0.32532382011413574,0.315093070268631,0.28804418444633484,0.28350386023521423,0.26811912655830383,0.25391218066215515,0.24939848482608795,0.23169970512390137,0.2235763967037201,0.2174646407365799,0.21398881077766418,0.20492784678936005,0.19571982324123383,0.19490286707878113,0.19172120094299316,0.1877792775630951,0.17446237802505493,0.16470730304718018,0.16193658113479614,0.15275368094444275,0.1442631334066391,0.13610313832759857,0.13434408605098724,0.13151021301746368,0.1296055018901825,0.12294713407754898,0.11934226751327515,0.11162718385457993,0.10728315263986588,0.09616993367671967,0.08916086703538895,0.08277712017297745,0.07225973159074783,0.06968650966882706,0.05930357798933983,0.04148801788687706,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7811501026153564,0.7390376329421997,0.6880785822868347,0.6736862063407898,0.6633931398391724,0.6428402066230774,0.6278647184371948,0.6132718324661255,0.5963529944419861,0.5743433833122253,0.5528514981269836,0.5445513725280762,0.5356774926185608,0.5271704196929932,0.49229180812835693,0.4853269159793854,0.4760103225708008,0.43552282452583313,0.4300670623779297,0.4189802408218384,0.40791991353034973,0.3792928457260132,0.36810338497161865,0.359282910823822,0.3471105098724365,0.33272337913513184,0.3276786804199219,0.32525625824928284,0.3005905747413635,0.2879815399646759,0.27462443709373474,0.2644333839416504,0.25238364934921265,0.24327366054058075,0.2279558628797531,0.2220805287361145,0.21730713546276093,0.20599210262298584,0.1984744668006897,0.19511975347995758,0.19228166341781616,0.18838012218475342,0.182417631149292,0.17422926425933838,0.16283322870731354,0.16059510409832,0.15097030997276306,0.1376299411058426,0.13543038070201874,0.13392850756645203,0.13145868480205536,0.12878748774528503,0.12242215871810913,0.11382649093866348,0.110428586602211,0.10141030699014664,0.09445390105247498,0.08708543330430984,0.07713226974010468,0.07143411040306091,0.06280248612165451,0.055977463722229004,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7811501026153564,0.7390376329421997,0.6880785822868347,0.6736862063407898,0.6633931398391724,0.6428402066230774,0.6278647184371948,0.6132718324661255,0.5962578654289246,0.5664708018302917,0.5504096150398254,0.5403891205787659,0.5274484157562256,0.49229180812835693,0.4853269159793854,0.47479113936424255,0.43466997146606445,0.4281533360481262,0.4164971709251404,0.39566493034362793,0.37547633051872253,0.36762404441833496,0.3482542037963867,0.3424796164035797,0.328922837972641,0.325533002614975,0.31834208965301514,0.3003810942173004,0.28375929594039917,0.2715235650539398,0.25922268629074097,0.25030452013015747,0.23297248780727386,0.22520454227924347,0.21885305643081665,0.21398881077766418,0.20184257626533508,0.19554291665554047,0.19373691082000732,0.19017817080020905,0.18525399267673492,0.17446237802505493,0.16470730304718018,0.16193658113479614,0.15097030997276306,0.1376299411058426,0.13543038070201874,0.13392850756645203,0.13145868480205536,0.12878748774528503,0.12242215871810913,0.11382649093866348,0.110428586602211,0.10141030699014664,0.09445390105247498,0.08708543330430984,0.07713226974010468,0.07143411040306091,0.06191325560212135,0.051841989159584045,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7811501026153564,0.7390376329421997,0.6858900785446167,0.6663841009140015,0.659410297870636,0.6329349279403687,0.6132718324661255,0.5962578654289246,0.5664708018302917,0.5504096150398254,0.5356774926185608,0.5271704196929932,0.4921359121799469,0.4780247211456299,0.43552282452583313,0.4281533360481262,0.4164971709251404,0.39566493034362793,0.37547633051872253,0.36762404441833496,0.34822750091552734,0.33368465304374695,0.3280494511127472,0.32532382011413574,0.3005905747413635,0.28350386023521423,0.26811912655830383,0.25391218066215515,0.24327366054058075,0.23169970512390137,0.2235763967037201,0.2174646407365799,0.20599210262298584,0.1984744668006897,0.19511975347995758,0.19228166341781616,0.18838012218475342,0.17932172119617462,0.16553345322608948,0.16266736388206482,0.15275368094444275,0.1490997076034546,0.1376299411058426,0.13543038070201874,0.13392850756645203,0.13145868480205536,0.12878748774528503,0.12242215871810913,0.11382649093866348,0.110428586602211,0.10141030699014664,0.09445390105247498,0.08751267939805984,0.08277712017297745,0.07225973159074783,0.06280248612165451,0.051841989159584045,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7811501026153564,0.7390376329421997,0.6858900785446167,0.6663841009140015,0.659410297870636,0.6329349279403687,0.6132718324661255,0.5962578654289246,0.5664708018302917,0.5504096150398254,0.5356774926185608,0.5271704196929932,0.4921359121799469,0.4780247211456299,0.43552282452583313,0.42489781975746155,0.41068172454833984,0.39142918586730957,0.37489739060401917,0.34822750091552734,0.33368465304374695,0.3276786804199219,0.31834208965301514,0.28804418444633484,0.27871719002723694,0.2644333839416504,0.25238364934921265,0.23297248780727386,0.2279558628797531,0.2220805287361145,0.21730713546276093,0.20492784678936005,0.19571982324123383,0.19373691082000732,0.19017817080020905,0.17932172119617462,0.16553345322608948,0.16266736388206482,0.15275368094444275,0.1490997076034546,0.1376299411058426,0.13543038070201874,0.13392850756645203,0.13145868480205536,0.12878748774528503,0.12242215871810913,0.11382649093866348,0.110428586602211,0.10141030699014664,0.09445390105247498,0.08751267939805984,0.08277712017297745,0.07225973159074783,0.06280248612165451,0.04148801788687706,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7811501026153564,0.7390376329421997,0.6858900785446167,0.6663841009140015,0.659410297870636,0.6329349279403687,0.6132718324661255,0.5786262154579163,0.5619102716445923,0.5432311296463013,0.5320197343826294,0.5125149488449097,0.48913753032684326,0.4718821346759796,0.42489781975746155,0.41068172454833984,0.39142918586730957,0.36810338497161865,0.33368465304374695,0.3276786804199219,0.315093070268631,0.28375929594039917,0.27462443709373474,0.25922268629074097,0.25030452013015747,0.2326257973909378,0.22520454227924347,0.21885305643081665,0.21398881077766418,0.20184257626533508,0.19554291665554047,0.19228166341781616,0.1877792775630951,0.17422926425933838,0.16283322870731354,0.15503786504268646,0.15020263195037842,0.1442631334066391,0.13543038070201874,0.13392850756645203,0.13145868480205536,0.12556064128875732,0.12133629620075226,0.11162718385457993,0.10728315263986588,0.09616993367671967,0.08916086703538895,0.08370442688465118,0.07249525189399719,0.07006561011075974,0.055977463722229004,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9595380425453186,0.9587544798851013,0.9563312530517578,0.954447865486145,0.9528976678848267,0.9456404447555542,0.9076800346374512,0.8658453226089478,0.8336793184280396,0.8009905815124512,0.7778369784355164,0.7180711030960083,0.6633931398391724,0.6329349279403687,0.6132718324661255,0.5786262154579163,0.5528514981269836,0.5403891205787659,0.5271704196929932,0.4853269159793854,0.43552282452583313,0.4189802408218384,0.40791991353034973,0.3792928457260132,0.3471105098724365,0.3280494511127472,0.31834208965301514,0.28804418444633484,0.27871719002723694,0.2644333839416504,0.25238364934921265,0.23297248780727386,0.2279558628797531,0.2220805287361145,0.21398881077766418,0.20184257626533508,0.19554291665554047,0.19228166341781616,0.1877792775630951,0.17422926425933838,0.16283322870731354,0.15503786504268646,0.15020263195037842,0.1376299411058426,0.13480252027511597,0.13268029689788818,0.1296055018901825,0.12294713407754898,0.11934226751327515,0.11010704934597015,0.09797786176204681,0.0904771164059639,0.08708543330430984,0.07713226974010468,0.07143411040306091,0.06191325560212135,0.015630995854735374,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9658343195915222,0.9643577933311462,0.9622560739517212,0.9612163305282593,0.9591854214668274,0.9585354924201965,0.9556007981300354,0.9538430571556091,0.9481749534606934,0.9178938269615173,0.87974613904953,0.8351814150810242,0.8157678842544556,0.7390376329421997,0.659410297870636,0.6278647184371948,0.6026830077171326,0.5619102716445923,0.5403891205787659,0.49229180812835693,0.4718821346759796,0.4189802408218384,0.3792928457260132,0.3471105098724365,0.3276786804199219,0.28375929594039917,0.27462443709373474,0.25391218066215515,0.22520454227924347,0.20599210262298584,0.1984744668006897,0.19373691082000732,0.19017817080020905,0.17422926425933838,0.16193658113479614,0.15097030997276306,0.1442631334066391,0.13434408605098724,0.13145868480205536,0.12294713407754898,0.11162718385457993,0.10141030699014664,0.09445390105247498,0.08751267939805984,0.08277712017297745,0.07225973159074783,0.06191325560212135,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0],[0.9815001487731934,0.9801337718963623,0.9793535470962524,0.9779238104820251,0.9775661826133728,0.9765563011169434,0.9747013449668884,0.9737294316291809,0.9724805951118469,0.9670511484146118,0.9653592705726624,0.9615682363510132,0.9595380425453186,0.9585354924201965,0.9556007981300354,0.9538430571556091,0.9456404447555542,0.9076800346374512,0.8443565368652344,0.8157678842544556,0.659410297870636,0.6278647184371948,0.5963529944419861,0.5504096150398254,0.49229180812835693,0.3792928457260132,0.2644333839416504,0.21730713546276093,0.17932172119617462,0.16193658113479614,0.1490997076034546,0.13480252027511597,0.12556064128875732,0.09797786176204681,0.08916086703538895,0.08277712017297745,0.07006561011075974,0.019777249544858932,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0,0.0]]},"title":{"ap":38.745347586625584,"ap50":50.12263329992115,"ap70":40.83531017420843,"ap90":29.40280420667828,"ar100":74.24749163879598}}},"independent_final_test":false,"production_promotion_allowed":false,"schema":"ax-doclayout.h51-descriptive-title-metrics/1","step":1024}
|
evaluation.json
ADDED
|
@@ -0,0 +1,255 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"arms": {
|
| 3 |
+
"H5": {
|
| 4 |
+
"counts": {
|
| 5 |
+
"fn": 153,
|
| 6 |
+
"fp": 229,
|
| 7 |
+
"iou": 0.5,
|
| 8 |
+
"precision": 38.93333333333333,
|
| 9 |
+
"recall": 48.82943143812709,
|
| 10 |
+
"threshold": 0.3,
|
| 11 |
+
"tp": 146
|
| 12 |
+
},
|
| 13 |
+
"panels": {
|
| 14 |
+
"fin_val": {
|
| 15 |
+
"ap": 91.58560936970301,
|
| 16 |
+
"ap50": 96.42307172412028,
|
| 17 |
+
"ap70": 95.68967016952253,
|
| 18 |
+
"ap90": 89.04728335091869,
|
| 19 |
+
"ar100": 97.18354430379745,
|
| 20 |
+
"ignore_regions_policy": "historical_d5_unfiltered",
|
| 21 |
+
"independent_final_test": false,
|
| 22 |
+
"pages": 256,
|
| 23 |
+
"per_class_ap": {
|
| 24 |
+
"9": 91.58560936970301
|
| 25 |
+
},
|
| 26 |
+
"taxonomy": "ax-document-unified-25/1"
|
| 27 |
+
},
|
| 28 |
+
"financial_val": {
|
| 29 |
+
"ap": 61.51128145000217,
|
| 30 |
+
"ap50": 74.86946506958374,
|
| 31 |
+
"ap70": 68.45692502635225,
|
| 32 |
+
"ap90": 43.322561206462275,
|
| 33 |
+
"ar100": 83.24266432330124,
|
| 34 |
+
"ignore_regions_policy": "historical_d5_unfiltered",
|
| 35 |
+
"independent_final_test": false,
|
| 36 |
+
"pages": 1745,
|
| 37 |
+
"per_class_ap": {
|
| 38 |
+
"1": 50.27375835762371,
|
| 39 |
+
"10": 86.8442236905189,
|
| 40 |
+
"11": 21.853779071996104,
|
| 41 |
+
"2": 21.565227712119672,
|
| 42 |
+
"3": -1.0,
|
| 43 |
+
"4": 86.21879623969116,
|
| 44 |
+
"5": 63.222417086128445,
|
| 45 |
+
"6": 48.35856172317618,
|
| 46 |
+
"7": 81.51771563437424,
|
| 47 |
+
"8": 65.42208145342498,
|
| 48 |
+
"9": 89.8362535309683
|
| 49 |
+
},
|
| 50 |
+
"taxonomy": "ax-document-unified-25/1"
|
| 51 |
+
},
|
| 52 |
+
"gold_val": {
|
| 53 |
+
"ap": 70.65715440191167,
|
| 54 |
+
"ap50": 88.40568243846039,
|
| 55 |
+
"ap70": 78.13845865429131,
|
| 56 |
+
"ap90": 50.450114112981545,
|
| 57 |
+
"ar100": 82.83261306670309,
|
| 58 |
+
"ignore_regions_policy": "historical_d5_unfiltered",
|
| 59 |
+
"independent_final_test": false,
|
| 60 |
+
"pages": 6489,
|
| 61 |
+
"per_class_ap": {
|
| 62 |
+
"1": 86.97437605372829,
|
| 63 |
+
"10": 84.58897292266664,
|
| 64 |
+
"11": 35.963737455625406,
|
| 65 |
+
"2": 70.84972376935531,
|
| 66 |
+
"3": 66.0621205795928,
|
| 67 |
+
"4": 86.0096104111741,
|
| 68 |
+
"5": 53.05098211411177,
|
| 69 |
+
"6": 56.16971374829491,
|
| 70 |
+
"7": 86.3866260466923,
|
| 71 |
+
"8": 67.48086426451377,
|
| 72 |
+
"9": 83.69197105527309
|
| 73 |
+
},
|
| 74 |
+
"taxonomy": "ax-document-unified-25/1"
|
| 75 |
+
}
|
| 76 |
+
},
|
| 77 |
+
"title": {
|
| 78 |
+
"ap": 35.963737455625406,
|
| 79 |
+
"ap50": 45.82497853510442,
|
| 80 |
+
"ap70": 37.919540471954086,
|
| 81 |
+
"ap90": 27.58934006257302,
|
| 82 |
+
"ar100": 62.943143812709025
|
| 83 |
+
}
|
| 84 |
+
},
|
| 85 |
+
"H51-control": {
|
| 86 |
+
"counts": {
|
| 87 |
+
"fn": 147,
|
| 88 |
+
"fp": 232,
|
| 89 |
+
"iou": 0.5,
|
| 90 |
+
"precision": 39.583333333333336,
|
| 91 |
+
"recall": 50.836120401337794,
|
| 92 |
+
"threshold": 0.3,
|
| 93 |
+
"tp": 152
|
| 94 |
+
},
|
| 95 |
+
"panels": {
|
| 96 |
+
"fin_val": {
|
| 97 |
+
"ap": 91.73710137237188,
|
| 98 |
+
"ap50": 96.4099632632333,
|
| 99 |
+
"ap70": 95.72830310105967,
|
| 100 |
+
"ap90": 89.01546582174996,
|
| 101 |
+
"ar100": 97.31012658227849,
|
| 102 |
+
"ignore_regions_policy": "historical_d5_unfiltered",
|
| 103 |
+
"independent_final_test": false,
|
| 104 |
+
"pages": 256,
|
| 105 |
+
"per_class_ap": {
|
| 106 |
+
"9": 91.73710137237188
|
| 107 |
+
},
|
| 108 |
+
"taxonomy": "ax-document-unified-25/1"
|
| 109 |
+
},
|
| 110 |
+
"financial_val": {
|
| 111 |
+
"ap": 61.54451332090731,
|
| 112 |
+
"ap50": 74.82347437893793,
|
| 113 |
+
"ap70": 68.37143078364227,
|
| 114 |
+
"ap90": 43.45150000241278,
|
| 115 |
+
"ar100": 83.51945585499091,
|
| 116 |
+
"ignore_regions_policy": "historical_d5_unfiltered",
|
| 117 |
+
"independent_final_test": false,
|
| 118 |
+
"pages": 1745,
|
| 119 |
+
"per_class_ap": {
|
| 120 |
+
"1": 50.790307872052466,
|
| 121 |
+
"10": 86.95649329534332,
|
| 122 |
+
"11": 21.537754862532495,
|
| 123 |
+
"2": 21.089752984835016,
|
| 124 |
+
"3": -1.0,
|
| 125 |
+
"4": 86.26630590510274,
|
| 126 |
+
"5": 63.45967663532532,
|
| 127 |
+
"6": 48.37271223360353,
|
| 128 |
+
"7": 81.63817745625849,
|
| 129 |
+
"8": 65.42434020637644,
|
| 130 |
+
"9": 89.90961175764326
|
| 131 |
+
},
|
| 132 |
+
"taxonomy": "ax-document-unified-25/1"
|
| 133 |
+
},
|
| 134 |
+
"gold_val": {
|
| 135 |
+
"ap": 71.12138935941007,
|
| 136 |
+
"ap50": 88.67129396706581,
|
| 137 |
+
"ap70": 78.75562209735875,
|
| 138 |
+
"ap90": 50.94979086232245,
|
| 139 |
+
"ar100": 83.49783844438394,
|
| 140 |
+
"ignore_regions_policy": "historical_d5_unfiltered",
|
| 141 |
+
"independent_final_test": false,
|
| 142 |
+
"pages": 6489,
|
| 143 |
+
"per_class_ap": {
|
| 144 |
+
"1": 87.04700605626007,
|
| 145 |
+
"10": 84.91962874561692,
|
| 146 |
+
"11": 37.09773755641038,
|
| 147 |
+
"2": 70.98562257535825,
|
| 148 |
+
"3": 66.03273966396873,
|
| 149 |
+
"4": 86.30603620785666,
|
| 150 |
+
"5": 54.172316702963194,
|
| 151 |
+
"6": 57.063027563254366,
|
| 152 |
+
"7": 86.45057247965717,
|
| 153 |
+
"8": 68.17739410145994,
|
| 154 |
+
"9": 84.08320130070514
|
| 155 |
+
},
|
| 156 |
+
"taxonomy": "ax-document-unified-25/1"
|
| 157 |
+
}
|
| 158 |
+
},
|
| 159 |
+
"title": {
|
| 160 |
+
"ap": 37.09773755641038,
|
| 161 |
+
"ap50": 47.67067642108576,
|
| 162 |
+
"ap70": 39.006786088722876,
|
| 163 |
+
"ap90": 28.09417805581423,
|
| 164 |
+
"ar100": 68.2943143812709
|
| 165 |
+
}
|
| 166 |
+
},
|
| 167 |
+
"H51-title": {
|
| 168 |
+
"counts": {
|
| 169 |
+
"fn": 131,
|
| 170 |
+
"fp": 296,
|
| 171 |
+
"iou": 0.5,
|
| 172 |
+
"precision": 36.206896551724135,
|
| 173 |
+
"recall": 56.187290969899664,
|
| 174 |
+
"threshold": 0.3,
|
| 175 |
+
"tp": 168
|
| 176 |
+
},
|
| 177 |
+
"panels": {
|
| 178 |
+
"fin_val": {
|
| 179 |
+
"ap": 91.57739593169711,
|
| 180 |
+
"ap50": 96.39212272259813,
|
| 181 |
+
"ap70": 95.6720891685565,
|
| 182 |
+
"ap90": 88.44809936812516,
|
| 183 |
+
"ar100": 97.12025316455696,
|
| 184 |
+
"ignore_regions_policy": "historical_d5_unfiltered",
|
| 185 |
+
"independent_final_test": false,
|
| 186 |
+
"pages": 256,
|
| 187 |
+
"per_class_ap": {
|
| 188 |
+
"9": 91.57739593169711
|
| 189 |
+
},
|
| 190 |
+
"taxonomy": "ax-document-unified-25/1"
|
| 191 |
+
},
|
| 192 |
+
"financial_val": {
|
| 193 |
+
"ap": 61.73305632696384,
|
| 194 |
+
"ap50": 74.96501865247365,
|
| 195 |
+
"ap70": 68.85316694919942,
|
| 196 |
+
"ap90": 43.47744892431575,
|
| 197 |
+
"ar100": 83.61329149193345,
|
| 198 |
+
"ignore_regions_policy": "historical_d5_unfiltered",
|
| 199 |
+
"independent_final_test": false,
|
| 200 |
+
"pages": 1745,
|
| 201 |
+
"per_class_ap": {
|
| 202 |
+
"1": 50.78315145536768,
|
| 203 |
+
"10": 87.04993624291704,
|
| 204 |
+
"11": 22.668975296494782,
|
| 205 |
+
"2": 21.06518949188169,
|
| 206 |
+
"3": -1.0,
|
| 207 |
+
"4": 86.4342933581353,
|
| 208 |
+
"5": 63.68508463365829,
|
| 209 |
+
"6": 48.562555445664245,
|
| 210 |
+
"7": 81.62495775148074,
|
| 211 |
+
"8": 65.49366226902261,
|
| 212 |
+
"9": 89.96275732501599
|
| 213 |
+
},
|
| 214 |
+
"taxonomy": "ax-document-unified-25/1"
|
| 215 |
+
},
|
| 216 |
+
"gold_val": {
|
| 217 |
+
"ap": 71.53267127947552,
|
| 218 |
+
"ap50": 88.96970146715404,
|
| 219 |
+
"ap70": 79.30542557035115,
|
| 220 |
+
"ap90": 51.442965386769316,
|
| 221 |
+
"ar100": 84.26815515047466,
|
| 222 |
+
"ignore_regions_policy": "historical_d5_unfiltered",
|
| 223 |
+
"independent_final_test": false,
|
| 224 |
+
"pages": 6489,
|
| 225 |
+
"per_class_ap": {
|
| 226 |
+
"1": 87.08961007399112,
|
| 227 |
+
"10": 85.14502829116108,
|
| 228 |
+
"11": 38.745347586625584,
|
| 229 |
+
"2": 71.23827368382588,
|
| 230 |
+
"3": 65.97418621206323,
|
| 231 |
+
"4": 86.56001042643845,
|
| 232 |
+
"5": 54.89541594216855,
|
| 233 |
+
"6": 57.75922516457215,
|
| 234 |
+
"7": 86.42092276593523,
|
| 235 |
+
"8": 68.62054515710344,
|
| 236 |
+
"9": 84.41081877034607
|
| 237 |
+
},
|
| 238 |
+
"taxonomy": "ax-document-unified-25/1"
|
| 239 |
+
}
|
| 240 |
+
},
|
| 241 |
+
"title": {
|
| 242 |
+
"ap": 38.745347586625584,
|
| 243 |
+
"ap50": 50.12263329992115,
|
| 244 |
+
"ap70": 40.83531017420843,
|
| 245 |
+
"ap90": 29.40280420667828,
|
| 246 |
+
"ar100": 74.24749163879598
|
| 247 |
+
}
|
| 248 |
+
}
|
| 249 |
+
},
|
| 250 |
+
"extra_class_accuracy_measured": false,
|
| 251 |
+
"frozen_numerical_screen_passed": false,
|
| 252 |
+
"independent_final_test": false,
|
| 253 |
+
"schema": "ax-doclayout.h51-v15-evaluation/1",
|
| 254 |
+
"second_seed_reproducibility_established": false
|
| 255 |
+
}
|
export-receipt.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"all_tensors_exact_after_reload":true,"checkpoint_sha256":"44b75b2ca14d7d4756ca51d402d470d069f17ee99145717e1994549b32ef87d2","completed_updates":1024,"execution_provenance":{"changes":"immutable encoded source RAM cache and ordered four-thread decoding; input tensors and targets verified exact; model/loss/EMA/optimizer unchanged","core_source_identity":{"heron_finance.py":"0f14c5133b8a98e37f98ff01209372d363ac1b76e749ba9df9a468bda00f4b0d","heron_finance_data.py":"03490e911c888429049a386d0e16ca6827e79a8cbd6cab5556c526f89b44bf60","heron_finance_loss.py":"51169af0e72ede427682d36e0a911b61af90e00c0c809fdab23e315c0a66973a","heron_finance_run.py":"13bccf10b14b2ed5a4bb936a992c92ae0107c9e402b93220de0349ed0af2ca42","heron_finance_title.py":"002d70aab9367480f53e1ea0d4188476124cea5134db877da9d996a01efa0193","heron_finance_title_review.py":"febdfc33f8824c00a70d2d1d9adc35c10ec87c510a37d34d2b5c00bac79cf84c"},"decode_helper_sha256":"c6b2641cf1f35fef31e94ad709193970655c30deddea66a6326fa178a5542038","decode_proof_sha256":"5db24673bdc42dea70c7e3852971d41f16e31be6856242f2c92b8a295e34b939","wrapper_sha256":"6bcc65021922a3e7ced400a96b9eaac2f315892e3bc501f7c9b0b9bb81ae50ce"},"files":{"config.json":{"bytes":3263,"sha256":"7691e69a4e4cb70416c2e12bbefea3a90671790226b2c0d22ede944c48e11f05"},"model.safetensors":{"bytes":171658996,"sha256":"d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e"},"preprocessor_config.json":{"bytes":444,"sha256":"cd38cd59999e7a95d68e487fbe5132df3d4e5c32a0836add57e6126ba0c4eaf1"},"sdk-taxonomy.json":{"bytes":3206,"sha256":"81e7908ee7c8bbb6e00905a98ed43c988128faa38c0b1d55d20948f78e40e351"}},"manifest_sha256":"07f489a82441de50d699ee62923003d161733593ca2f40a7ea9049dbdf2bdcb8","public_contract_or_hub_pin_changed":false,"published":false,"schema":"ax-doclayout.owner-selected-ema-export/1","source_identity":{"heron_finance.py":"0f14c5133b8a98e37f98ff01209372d363ac1b76e749ba9df9a468bda00f4b0d","heron_finance_data.py":"03490e911c888429049a386d0e16ca6827e79a8cbd6cab5556c526f89b44bf60","heron_finance_loss.py":"51169af0e72ede427682d36e0a911b61af90e00c0c809fdab23e315c0a66973a","heron_finance_run.py":"13bccf10b14b2ed5a4bb936a992c92ae0107c9e402b93220de0349ed0af2ca42","heron_finance_title.py":"002d70aab9367480f53e1ea0d4188476124cea5134db877da9d996a01efa0193","heron_finance_title_review.py":"febdfc33f8824c00a70d2d1d9adc35c10ec87c510a37d34d2b5c00bac79cf84c"},"stage":"H51-title","state_dict_entries":818,"synthetic_forward_exact_after_reload":true,"title_plan_sha256":"408478883c2ec34f1fd65c61ae6f23d728c658c0981a538bca77d7fd63256a07"}
|
frozen-numerical-screen.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"analysis_source_sha256":"9e890beec165b2ab843a6f456efed830ac68217bc77d27282405994a97e74aec","changes_pp":{"H5/fin_val/ap":-0.008213438005896023,"H5/fin_val/ap90":-0.5991839827935337,"H5/financial_val/ap":0.22177487696166764,"H5/gold_val/ap":0.8755168775638538,"H5/gold_val/class_1":0.11523402026283236,"H5/gold_val/class_10":0.5560553684944409,"H5/gold_val/class_2":0.3885499144705733,"H5/gold_val/class_3":-0.08793436752957007,"H5/gold_val/class_4":0.5504000152643584,"H5/gold_val/class_5":1.8444338280567791,"H5/gold_val/class_6":1.5895114162772401,"H5/gold_val/class_7":0.03429671924293132,"H5/gold_val/class_8":1.1396808925896664,"H5/gold_val/class_9":0.7188477150729824,"H5/title_precision":-2.726436781609195,"H51-control/fin_val/ap":-0.15970544067477022,"H51-control/fin_val/ap90":-0.5673664536247998,"H51-control/financial_val/ap":0.18854300605652696,"H51-control/gold_val/ap":0.4112819200654485,"H51-control/gold_val/class_1":0.04260401773105116,"H51-control/gold_val/class_10":0.22539954554416397,"H51-control/gold_val/class_2":0.2526511084676315,"H51-control/gold_val/class_3":-0.05855345190549599,"H51-control/gold_val/class_4":0.2539742185817886,"H51-control/gold_val/class_5":0.7230992392053537,"H51-control/gold_val/class_6":0.6961976013177846,"H51-control/gold_val/class_7":-0.029649713721937587,"H51-control/gold_val/class_8":0.4431510556434972,"H51-control/gold_val/class_9":0.3276174696409271,"H51-control/title_precision":-3.3764367816092005},"checks":{"H5/fin_val/ap":true,"H5/fin_val/ap90":false,"H5/financial_val/ap":true,"H5/gold_val/ap":true,"H5/gold_val/class_1":true,"H5/gold_val/class_10":true,"H5/gold_val/class_2":true,"H5/gold_val/class_3":true,"H5/gold_val/class_4":true,"H5/gold_val/class_5":true,"H5/gold_val/class_6":true,"H5/gold_val/class_7":true,"H5/gold_val/class_8":true,"H5/gold_val/class_9":true,"H5/title_precision":false,"H51-control/fin_val/ap":true,"H51-control/fin_val/ap90":false,"H51-control/financial_val/ap":true,"H51-control/gold_val/ap":true,"H51-control/gold_val/class_1":true,"H51-control/gold_val/class_10":true,"H51-control/gold_val/class_2":true,"H51-control/gold_val/class_3":true,"H51-control/gold_val/class_4":true,"H51-control/gold_val/class_5":true,"H51-control/gold_val/class_6":true,"H51-control/gold_val/class_7":true,"H51-control/gold_val/class_8":true,"H51-control/gold_val/class_9":true,"H51-control/title_precision":false,"title_ap_ci_positive":true,"title_ap_gain":false},"evaluation_sha256":{"H5/fin_val":"05d0097b186bd93f1d9a4527346188562203852d14c396fef6499ad183ec32f6","H5/financial_val":"1e9126de8b7ae96708b2e2bfaf399fb4f2c4bb948e2e2593480e67334c8d5673","H5/gold_val":"609ed589daa14f08517964701d67137bc2514ead69658109209fcd85ee6bdca3","H51-control/fin_val":"b5a523c1d30bc17353da67c1b68521320edc438ef31472faef1246c2dfeb168e","H51-control/financial_val":"7a6cb57a1a62b3e610bb476ab596adc3fcb5e1e128b5ff1015075121fc7c8826","H51-control/gold_val":"b5d3197836faddb583db6c06fdd23bd3f4406d592dbd059b3cf210085b3af258","H51-title/fin_val":"a3618b3b8e4b7536f499394e6ad08d46f9e44f68528e9d5ed20cfc42c136f088","H51-title/financial_val":"27bbfcdc7e6a0d5704d64631de0022ea941273d9e487a5a88b10fd0e39e26d91","H51-title/gold_val":"ec2ca77515304adf99580a7a65850afda8040bd179f2d3123967d88b4bd69c43"},"extra_class_quality_measured":false,"independent_final_test":false,"next_step_if_passed":"paired second seed and owner retention review","passed":false,"production_promotion_allowed":false,"schema":"ax-doclayout.h51-final-screen/1","title_counts":{"H5":{"fn":153,"fp":229,"iou":0.5,"precision":38.93333333333333,"recall":48.82943143812709,"threshold":0.3,"tp":146},"H51-control":{"fn":147,"fp":232,"iou":0.5,"precision":39.583333333333336,"recall":50.836120401337794,"threshold":0.3,"tp":152},"H51-title":{"fn":131,"fp":296,"iou":0.5,"precision":36.206896551724135,"recall":56.187290969899664,"threshold":0.3,"tp":168}},"title_interval":{"ci95_pp":[0.4850736373909948,2.8211530543936187],"control_title_ap":37.09773755641038,"delta_pp":1.6476100302152048,"families":160,"grouping_independence_verified":false,"independent_final_test":false,"resamples":1000,"seed":17,"status":"estimated","treatment_title_ap":38.745347586625584},"title_plan_sha256":"408478883c2ec34f1fd65c61ae6f23d728c658c0981a538bca77d7fd63256a07"}
|
model-selection.json
ADDED
|
@@ -0,0 +1,49 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"completed_updates": 1024,
|
| 3 |
+
"decision": "take it; owner considers improvement good",
|
| 4 |
+
"frozen_numerical_screen_passed": false,
|
| 5 |
+
"model_identity": "AutomatosX/AXDocLayout-M-v1.5-CUDA-TF32",
|
| 6 |
+
"model_version": "1.5",
|
| 7 |
+
"numeric_gate_reclassified_as_passed": false,
|
| 8 |
+
"public_loader_pin_changed": false,
|
| 9 |
+
"publication_authority": "owner explicitly requested this exact Hub repository",
|
| 10 |
+
"published": true,
|
| 11 |
+
"published_v14_changed": false,
|
| 12 |
+
"release_selected": true,
|
| 13 |
+
"schema": "ax-doclayout.owner-model-selection/1",
|
| 14 |
+
"sdk_class_ids": [
|
| 15 |
+
1,
|
| 16 |
+
2,
|
| 17 |
+
3,
|
| 18 |
+
4,
|
| 19 |
+
5,
|
| 20 |
+
6,
|
| 21 |
+
7,
|
| 22 |
+
8,
|
| 23 |
+
9,
|
| 24 |
+
10,
|
| 25 |
+
11,
|
| 26 |
+
12,
|
| 27 |
+
13,
|
| 28 |
+
14,
|
| 29 |
+
15,
|
| 30 |
+
16,
|
| 31 |
+
17
|
| 32 |
+
],
|
| 33 |
+
"selected": true,
|
| 34 |
+
"selected_training_stage": "H51-title",
|
| 35 |
+
"selection_authority": "owner directive after reported Title AP, precision, recall and table AP90 tradeoffs",
|
| 36 |
+
"source_checkpoint_sha256": "44b75b2ca14d7d4756ca51d402d470d069f17ee99145717e1994549b32ef87d2",
|
| 37 |
+
"source_git_revision": "adce6c2ddfc1977956fc180463ab221f780c8271",
|
| 38 |
+
"unsupported_sdk_class_ids": [
|
| 39 |
+
18,
|
| 40 |
+
19,
|
| 41 |
+
20,
|
| 42 |
+
21,
|
| 43 |
+
22,
|
| 44 |
+
23,
|
| 45 |
+
24,
|
| 46 |
+
25
|
| 47 |
+
],
|
| 48 |
+
"weights_sha256": "d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e"
|
| 49 |
+
}
|
model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e
|
| 3 |
+
size 171658996
|
original-cpu-parity.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"all_predictions_exact":true,"boxes_at_030":2405,"device":"cpu","elapsed_seconds":41.683596957998816,"example_sha256":"e7d60ca02f40ea2eb973c46ae6aa452f0d820bf8cdd54a153465f9437f26260d","new_example_cuda_rerun":false,"pages":150,"raw_detections":45000,"review_manifest_sha256":"8083a57308277239d5e5de7acd7a0fec4635bc23c1b3238bb2fd47d35b1b2e72","schema":"ax-doclayout.selected-bundle-cpu-parity/1","torch":"2.12.1","transformers":"4.53.3","weights_sha256":"d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e"}
|
predict_image.py
ADDED
|
@@ -0,0 +1,131 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
"""Pinned owner-selected H5.1 raster inference example; native model outputs map to AX PDF SDK IDs."""
|
| 2 |
+
from __future__ import annotations
|
| 3 |
+
|
| 4 |
+
import argparse
|
| 5 |
+
import hashlib
|
| 6 |
+
import importlib.metadata
|
| 7 |
+
import json
|
| 8 |
+
import math
|
| 9 |
+
from pathlib import Path
|
| 10 |
+
|
| 11 |
+
import torch
|
| 12 |
+
from PIL import Image
|
| 13 |
+
from transformers import RTDetrImageProcessor, RTDetrV2ForObjectDetection
|
| 14 |
+
|
| 15 |
+
REPO_ID = 'AutomatosX/AXDocLayout-M-v1.5-CUDA-TF32'
|
| 16 |
+
CORE_HASHES = {'config.json': '7691e69a4e4cb70416c2e12bbefea3a90671790226b2c0d22ede944c48e11f05', 'model.safetensors': 'd0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e', 'preprocessor_config.json': 'cd38cd59999e7a95d68e487fbe5132df3d4e5c32a0836add57e6126ba0c4eaf1', 'sdk-taxonomy.json': '81e7908ee7c8bbb6e00905a98ed43c988128faa38c0b1d55d20948f78e40e351'}
|
| 17 |
+
|
| 18 |
+
|
| 19 |
+
def digest(path: Path) -> str:
|
| 20 |
+
with path.open('rb') as stream:
|
| 21 |
+
return hashlib.file_digest(stream, 'sha256').hexdigest()
|
| 22 |
+
|
| 23 |
+
|
| 24 |
+
def validate_threshold(value: float) -> float:
|
| 25 |
+
if isinstance(value, bool) or not isinstance(value, (float, int)):
|
| 26 |
+
raise TypeError('score_threshold_invalid')
|
| 27 |
+
if not math.isfinite(value) or not 0 <= value <= 1:
|
| 28 |
+
raise ValueError('score_threshold_invalid')
|
| 29 |
+
return float(value)
|
| 30 |
+
|
| 31 |
+
|
| 32 |
+
def load_bundle(*, model_dir: Path, device: str = 'cuda') -> tuple:
|
| 33 |
+
"""Load exact local files with an explicit device; never fall back from CUDA."""
|
| 34 |
+
if device not in ('cuda', 'cpu'):
|
| 35 |
+
raise ValueError('device_invalid')
|
| 36 |
+
if importlib.metadata.version('transformers') != '4.53.3':
|
| 37 |
+
raise RuntimeError('transformers_version_mismatch')
|
| 38 |
+
if torch.__version__.split('+')[0] != '2.12.1':
|
| 39 |
+
raise RuntimeError('torch_version_mismatch')
|
| 40 |
+
for name, expected in CORE_HASHES.items():
|
| 41 |
+
path = model_dir / name
|
| 42 |
+
if not path.is_file() or digest(path) != expected:
|
| 43 |
+
raise RuntimeError('model_bundle_hash_mismatch')
|
| 44 |
+
if device == 'cuda':
|
| 45 |
+
if not torch.cuda.is_available():
|
| 46 |
+
raise RuntimeError('cuda_required_no_cpu_fallback')
|
| 47 |
+
if torch.cuda.get_device_capability()[0] < 8:
|
| 48 |
+
raise RuntimeError('ampere_or_newer_required_for_tf32_profile')
|
| 49 |
+
# Preserve the actual three-panel CUDA evaluation configuration.
|
| 50 |
+
torch.backends.cuda.matmul.allow_tf32 = False
|
| 51 |
+
torch.backends.cudnn.allow_tf32 = True
|
| 52 |
+
model, loading = RTDetrV2ForObjectDetection.from_pretrained(
|
| 53 |
+
model_dir, local_files_only=True, output_loading_info=True,
|
| 54 |
+
)
|
| 55 |
+
if any(loading[key] for key in ('missing_keys', 'unexpected_keys', 'mismatched_keys', 'error_msgs')):
|
| 56 |
+
raise RuntimeError('model_state_mismatch')
|
| 57 |
+
binding = json.loads((model_dir / 'sdk-taxonomy.json').read_text())
|
| 58 |
+
if binding['taxonomy'] != 'ax-document-unified-25/1' or binding['model_sdk_class_ids'] != list(range(1, 18)):
|
| 59 |
+
raise RuntimeError('sdk_binding_mismatch')
|
| 60 |
+
definitions = {row['id']: row for row in binding['classes']}
|
| 61 |
+
for native, sdk in binding['native_index_to_sdk_id'].items():
|
| 62 |
+
if model.config.id2label[int(native)] != definitions[sdk]['name']:
|
| 63 |
+
raise RuntimeError('sdk_name_mismatch')
|
| 64 |
+
processor = RTDetrImageProcessor.from_pretrained(model_dir, local_files_only=True)
|
| 65 |
+
return model.float().to(device).eval(), processor, binding
|
| 66 |
+
|
| 67 |
+
|
| 68 |
+
def predict_rgb(*, rgb: Image.Image, model: object, processor: object,
|
| 69 |
+
binding: dict, threshold: float = .30) -> list[dict]:
|
| 70 |
+
"""Return original-raster xyxy boxes with SDK IDs1-17 and finite scores."""
|
| 71 |
+
threshold = validate_threshold(threshold)
|
| 72 |
+
if not isinstance(rgb, Image.Image) or rgb.mode != 'RGB' or min(rgb.size) < 1:
|
| 73 |
+
raise ValueError('decoded_rgb_image_required')
|
| 74 |
+
device = next(model.parameters()).device
|
| 75 |
+
inputs = processor(images=rgb, return_tensors='pt')['pixel_values']
|
| 76 |
+
if tuple(inputs.shape) != (1, 3, 640, 640):
|
| 77 |
+
raise RuntimeError('preprocessor_shape_mismatch')
|
| 78 |
+
with torch.inference_mode():
|
| 79 |
+
outputs = model(pixel_values=inputs.to(device))
|
| 80 |
+
predictions = processor.post_process_object_detection(
|
| 81 |
+
outputs, threshold=0.,
|
| 82 |
+
target_sizes=torch.tensor([[rgb.height, rgb.width]], device=device),
|
| 83 |
+
)[0]
|
| 84 |
+
definitions = {row['id']: row['name'] for row in binding['classes']}
|
| 85 |
+
result = []
|
| 86 |
+
for native, score, box in zip(predictions['labels'].tolist(), predictions['scores'].tolist(),
|
| 87 |
+
predictions['boxes'].tolist(), strict=True):
|
| 88 |
+
if not all(math.isfinite(v) for v in [score, *box]) or not 0 <= score <= 1:
|
| 89 |
+
raise RuntimeError('nonfinite_or_invalid_prediction')
|
| 90 |
+
if score < threshold:
|
| 91 |
+
continue
|
| 92 |
+
sdk = binding['native_index_to_sdk_id'][str(native)]
|
| 93 |
+
clipped = [min(max(box[0], 0.), rgb.width), min(max(box[1], 0.), rgb.height),
|
| 94 |
+
min(max(box[2], 0.), rgb.width), min(max(box[3], 0.), rgb.height)]
|
| 95 |
+
if clipped[2] <= clipped[0] or clipped[3] <= clipped[1]:
|
| 96 |
+
continue
|
| 97 |
+
result.append({'class_id': sdk, 'class_name': definitions[sdk],
|
| 98 |
+
'score': score, 'bbox_xyxy': clipped})
|
| 99 |
+
return result
|
| 100 |
+
|
| 101 |
+
|
| 102 |
+
def main() -> None:
|
| 103 |
+
parser = argparse.ArgumentParser(description=__doc__)
|
| 104 |
+
parser.add_argument('--model-dir', type=Path, required=True)
|
| 105 |
+
parser.add_argument('--image', type=Path, required=True)
|
| 106 |
+
parser.add_argument('--output', type=Path, required=True)
|
| 107 |
+
parser.add_argument('--device', choices=('cuda', 'cpu'), default='cuda')
|
| 108 |
+
parser.add_argument('--threshold', type=float, default=.30)
|
| 109 |
+
args = parser.parse_args()
|
| 110 |
+
validate_threshold(args.threshold)
|
| 111 |
+
if args.output.exists():
|
| 112 |
+
raise RuntimeError('output_already_exists')
|
| 113 |
+
try:
|
| 114 |
+
with Image.open(args.image) as image:
|
| 115 |
+
if image.format not in ('PNG', 'JPEG', 'TIFF', 'WEBP', 'BMP'):
|
| 116 |
+
raise ValueError('raster_format_required')
|
| 117 |
+
rgb = image.convert('RGB')
|
| 118 |
+
except (OSError, ValueError):
|
| 119 |
+
raise RuntimeError('raster_image_read_failed') from None
|
| 120 |
+
model, processor, binding = load_bundle(model_dir=args.model_dir, device=args.device)
|
| 121 |
+
detections = predict_rgb(rgb=rgb, model=model, processor=processor,
|
| 122 |
+
binding=binding, threshold=args.threshold)
|
| 123 |
+
result = {'model_id': REPO_ID, 'model_sha256': CORE_HASHES['model.safetensors'],
|
| 124 |
+
'taxonomy': binding['taxonomy'], 'width': rgb.width, 'height': rgb.height,
|
| 125 |
+
'coordinate_space': 'original-raster-pixel-xyxy', 'device': args.device,
|
| 126 |
+
'score_threshold': args.threshold, 'detections': detections}
|
| 127 |
+
args.output.write_text(json.dumps(result, sort_keys=True, allow_nan=False) + '\n')
|
| 128 |
+
|
| 129 |
+
|
| 130 |
+
if __name__ == '__main__':
|
| 131 |
+
main()
|
preprocessor_config.json
ADDED
|
@@ -0,0 +1,26 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"do_convert_annotations": true,
|
| 3 |
+
"do_normalize": false,
|
| 4 |
+
"do_pad": false,
|
| 5 |
+
"do_rescale": true,
|
| 6 |
+
"do_resize": true,
|
| 7 |
+
"format": "coco_detection",
|
| 8 |
+
"image_mean": [
|
| 9 |
+
0.485,
|
| 10 |
+
0.456,
|
| 11 |
+
0.406
|
| 12 |
+
],
|
| 13 |
+
"image_processor_type": "RTDetrImageProcessor",
|
| 14 |
+
"image_std": [
|
| 15 |
+
0.229,
|
| 16 |
+
0.224,
|
| 17 |
+
0.225
|
| 18 |
+
],
|
| 19 |
+
"pad_size": null,
|
| 20 |
+
"resample": 2,
|
| 21 |
+
"rescale_factor": 0.00392156862745098,
|
| 22 |
+
"size": {
|
| 23 |
+
"height": 640,
|
| 24 |
+
"width": 640
|
| 25 |
+
}
|
| 26 |
+
}
|
qualification.json
ADDED
|
@@ -0,0 +1,21 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"boundary_tests_passed": 14,
|
| 3 |
+
"cpu_example": {
|
| 4 |
+
"all_predictions_exact": true,
|
| 5 |
+
"boxes_at_030": 2405,
|
| 6 |
+
"device": "cpu",
|
| 7 |
+
"example_sha256": "afe45b076c2b2688e1b58307a923c5c001333a8440dd303cf19a2e1cf21b929b",
|
| 8 |
+
"new_example_cuda_rerun": false,
|
| 9 |
+
"pages": 150,
|
| 10 |
+
"raw_detections": 45000,
|
| 11 |
+
"review_manifest_sha256": "8083a57308277239d5e5de7acd7a0fec4635bc23c1b3238bb2fd47d35b1b2e72",
|
| 12 |
+
"schema": "ax-doclayout.h51-v15-cpu-parity/1",
|
| 13 |
+
"seconds": 39.956092542008264,
|
| 14 |
+
"weights_sha256": "d0949704220ee50d94359cb6417e3481ac4ef5078a9f63795989e9f5d76e9b7e"
|
| 15 |
+
},
|
| 16 |
+
"existing_cuda_evidence": "exact H51-title final1024 three-panel evaluation and exact exported tensor reload",
|
| 17 |
+
"new_example_cuda_rerun": false,
|
| 18 |
+
"owner_selected_despite_frozen_screen_failure": true,
|
| 19 |
+
"ruff_passed": true,
|
| 20 |
+
"schema": "ax-doclayout.h51-v15-qualification/1"
|
| 21 |
+
}
|
requirements.txt
ADDED
|
@@ -0,0 +1,8 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Match the recorded CUDA runtime. Install CUDA PyTorch wheels separately as shown in README.
|
| 2 |
+
torch==2.12.1
|
| 3 |
+
transformers==4.53.3
|
| 4 |
+
Pillow==12.3.0
|
| 5 |
+
numpy==2.5.2
|
| 6 |
+
safetensors==0.8.0
|
| 7 |
+
huggingface-hub==0.36.2
|
| 8 |
+
tokenizers==0.21.4
|
retention-drift.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"accuracy_claim":false,"analysis_source_sha256":"a0b3cdf2c18b79ef8b861bb8954ad6ab58f7009d47e958e0f835ee35aad02015","counts":{"H5":{"1":16,"10":1005,"11":4,"12":1,"13":0,"14":0,"15":1,"16":0,"17":26,"2":20,"3":0,"4":415,"5":178,"6":134,"7":22,"8":523,"9":113},"H51-control":{"1":16,"10":994,"11":4,"12":1,"13":0,"14":0,"15":0,"16":0,"17":24,"2":20,"3":0,"4":411,"5":177,"6":131,"7":23,"8":520,"9":115},"H51-title":{"1":14,"10":977,"11":7,"12":1,"13":0,"14":0,"15":0,"16":0,"17":16,"2":20,"3":0,"4":406,"5":175,"6":134,"7":23,"8":519,"9":113}},"extra_class_quality_measured":false,"page_count_changes_from_h5":{"H51-control":[{"delta":{"4":-1},"id":"006"},{"delta":{"10":-3,"9":1},"id":"010"},{"delta":{"10":1},"id":"029"},{"delta":{"10":-1,"9":1},"id":"033"},{"delta":{"10":1},"id":"034"},{"delta":{"8":2},"id":"038"},{"delta":{"8":-1,"9":1},"id":"040"},{"delta":{"10":-1,"6":-1},"id":"041"},{"delta":{"4":1},"id":"043"},{"delta":{"5":-1},"id":"047"},{"delta":{"10":-1,"8":-1},"id":"049"},{"delta":{"10":1,"8":1},"id":"050"},{"delta":{"10":1,"4":-1,"8":-1},"id":"055"},{"delta":{"10":-2,"17":-1,"4":-1},"id":"060"},{"delta":{"8":1},"id":"061"},{"delta":{"10":1},"id":"063"},{"delta":{"10":-1},"id":"068"},{"delta":{"10":-1,"4":-1},"id":"069"},{"delta":{"10":-2,"15":-1},"id":"070"},{"delta":{"8":-1},"id":"077"},{"delta":{"6":-1},"id":"079"},{"delta":{"7":1},"id":"084"},{"delta":{"4":-1,"9":-1},"id":"085"},{"delta":{"10":-1},"id":"087"},{"delta":{"10":-1},"id":"088"},{"delta":{"10":-1},"id":"089"},{"delta":{"8":-1},"id":"091"},{"delta":{"5":-1,"6":-1,"8":-1},"id":"094"},{"delta":{"5":1},"id":"098"},{"delta":{"4":1},"id":"101"},{"delta":{"10":-1,"8":1},"id":"102"},{"delta":{"4":-1},"id":"103"},{"delta":{"10":1},"id":"106"},{"delta":{"10":-1},"id":"107"},{"delta":{"8":-1},"id":"118"},{"delta":{"10":1},"id":"125"},{"delta":{"10":-1,"17":-1},"id":"130"},{"delta":{"4":1},"id":"134"},{"delta":{"4":-1},"id":"137"},{"delta":{"8":-1},"id":"144"}],"H51-title":[{"delta":{"4":-1},"id":"006"},{"delta":{"10":1},"id":"007"},{"delta":{"10":-3,"17":-1},"id":"010"},{"delta":{"1":-1},"id":"018"},{"delta":{"11":1},"id":"020"},{"delta":{"4":-1},"id":"024"},{"delta":{"10":1},"id":"029"},{"delta":{"10":-1,"11":1},"id":"031"},{"delta":{"10":-1,"9":1},"id":"033"},{"delta":{"9":1},"id":"034"},{"delta":{"8":1},"id":"038"},{"delta":{"8":-1},"id":"040"},{"delta":{"10":-1,"17":-1},"id":"041"},{"delta":{"6":1},"id":"042"},{"delta":{"4":-1,"5":-1},"id":"043"},{"delta":{"5":-1},"id":"047"},{"delta":{"10":-2,"8":-1},"id":"049"},{"delta":{"8":1},"id":"050"},{"delta":{"10":1,"4":-1,"8":-1},"id":"055"},{"delta":{"10":-3,"17":-1},"id":"060"},{"delta":{"10":-1,"8":1},"id":"061"},{"delta":{"6":1},"id":"067"},{"delta":{"10":-1,"4":-1,"8":-1},"id":"069"},{"delta":{"10":-15,"15":-1,"17":-3,"8":1},"id":"070"},{"delta":{"10":2},"id":"071"},{"delta":{"8":-1},"id":"077"},{"delta":{"6":-1},"id":"079"},{"delta":{"7":1},"id":"084"},{"delta":{"4":-2,"8":2,"9":-2},"id":"085"},{"delta":{"5":-1},"id":"086"},{"delta":{"10":-1},"id":"087"},{"delta":{"10":-1},"id":"089"},{"delta":{"8":-1},"id":"091"},{"delta":{"5":-1,"6":-1,"8":-1},"id":"094"},{"delta":{"1":-1},"id":"096"},{"delta":{"5":1},"id":"098"},{"delta":{"10":-1,"5":-1},"id":"102"},{"delta":{"4":-1,"8":-1},"id":"103"},{"delta":{"10":1},"id":"106"},{"delta":{"8":1},"id":"112"},{"delta":{"8":-1},"id":"118"},{"delta":{"17":-1},"id":"123"},{"delta":{"10":-2},"id":"125"},{"delta":{"10":-1,"17":-1,"9":-1},"id":"130"},{"delta":{"11":1},"id":"132"},{"delta":{"17":-1},"id":"136"},{"delta":{"8":-1},"id":"137"},{"delta":{"4":-1,"9":1},"id":"138"},{"delta":{"5":1,"8":-1},"id":"144"},{"delta":{"17":-1},"id":"149"}]},"pages":150,"production_promotion_allowed":false,"schema":"ax-doclayout.h51-retention-count-drift/1","score_threshold":0.3}
|
runtime-profile.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"activation_dtype":"float32","all_matmul_tf32_qualified":false,"autocast":false,"cuda_matmul_allow_tf32":false,"cudnn_allow_tf32":true,"device":"cuda","id":"cuda-fp32-cudnn-tf32/1","input":"RGB640directresize","new_packaged_example_cuda_rerun":false,"onnx_artifact_included":false,"preprocessor_sha256":"cd38cd59999e7a95d68e487fbe5132df3d4e5c32a0836add57e6126ba0c4eaf1","qualification_source":"exact H51-title final1024 three-panel CUDA evaluation; reloaded export tensor parity","schema":"ax-doclayout.runtime-profile/1","storage_dtype":"float32","tensorrt_qualified":false,"tested_cuda":"12.9","tested_cudnn":92000,"tested_gpu":"NVIDIA RTX PRO 6000 Blackwell Server Edition","tested_torch":"2.12.1+cu129","tested_transformers":"4.53.3","tf32_scope":"cuDNN operations only; GEMM matmul TF32 is disabled"}
|
sdk-taxonomy.json
ADDED
|
@@ -0,0 +1 @@
|
|
|
|
|
|
|
| 1 |
+
{"additional_class_retention_verified":false,"catalog_implies_detection_support":false,"catalog_sha256":"f0c332ec6ff5871f911b20b4405573b4db088497480f337f65b6b8950e15cc50","classes":[{"description":"Reserved slot; never a public detection class.","id":0,"name":"reserved","task":"reserved"},{"description":"Caption describing a figure, table or illustration.","id":1,"name":"caption","task":"layout"},{"description":"Supplementary note linked to main text.","id":2,"name":"footnote","task":"layout"},{"description":"Standalone mathematical expression or equation.","id":3,"name":"formula","task":"layout"},{"description":"Individual bulleted or numbered list item.","id":4,"name":"list_item","task":"layout"},{"description":"Footer content such as page numbers or recurring text.","id":5,"name":"page_footer","task":"layout"},{"description":"Recurring content at the top of a page.","id":6,"name":"page_header","task":"layout"},{"description":"Figure, photograph, diagram or illustration.","id":7,"name":"picture","task":"layout"},{"description":"Heading introducing a section or subsection.","id":8,"name":"section_header","task":"layout"},{"description":"Information arranged in rows and columns.","id":9,"name":"table","task":"layout"},{"description":"General body text or paragraph.","id":10,"name":"text","task":"layout"},{"description":"Main document title.","id":11,"name":"title","task":"layout"},{"description":"Document index or table of contents region.","id":12,"name":"document_index","task":"layout"},{"description":"Source code or programming listing.","id":13,"name":"code","task":"layout"},{"description":"Checked or selected checkbox.","id":14,"name":"checkbox_selected","task":"layout"},{"description":"Empty or unselected checkbox.","id":15,"name":"checkbox_unselected","task":"layout"},{"description":"Form region containing fields or controls.","id":16,"name":"form","task":"layout"},{"description":"Related label and value information.","id":17,"name":"key_value_region","task":"layout"},{"description":"Comment or review annotation.","id":18,"name":"comment","task":"markup"},{"description":"Highlighted content.","id":19,"name":"highlighted","task":"markup"},{"description":"Handwritten annotation or content.","id":20,"name":"handwritten","task":"markup"},{"description":"Content marked with a strikeout line.","id":21,"name":"strikethrough","task":"markup"},{"description":"Caption specifically describing a table.","id":22,"name":"table_caption","task":"layout"},{"description":"Supplementary note associated with a table.","id":23,"name":"table_footnote","task":"layout"},{"description":"Caption or explanatory label associated with a formula.","id":24,"name":"formula_caption","task":"layout"},{"description":"Other region; no automatic mapping from source abandon labels.","id":25,"name":"other","task":"layout"}],"fine_tuning_positive_class_ids":[1,2,3,4,5,6,7,8,9,10,11],"model_sdk_class_ids":[1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17],"native_index_to_sdk_id":{"0":1,"1":2,"10":11,"11":12,"12":13,"13":14,"14":15,"15":16,"16":17,"2":3,"3":4,"4":5,"5":6,"6":7,"7":8,"8":9,"9":10},"taxonomy":"ax-document-unified-25/1","unsupported_sdk_class_ids":[18,19,20,21,22,23,24,25]}
|