Add endoedge_qwen3vl8b_peft_suite: Qwen3-VL-8B GI adapter, SAGE-benchmarked
Browse files
endoedge_qwen3vl8b_peft_suite/README.md
ADDED
|
@@ -0,0 +1,39 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Endoedge Qwen3-VL-8B GI adapters — four PEFT configurations
|
| 2 |
+
|
| 3 |
+
Four adapters for `Qwen/Qwen3-VL-8B-Instruct`, trained identically on the same data in
|
| 4 |
+
the same order with the same effective batch (64) for the same 1,200 optimizer updates.
|
| 5 |
+
**Rank and quantization are the only variables**, which is what makes the four
|
| 6 |
+
comparable.
|
| 7 |
+
|
| 8 |
+
| adapter | method | rank | SAGE macro-F1 | in-domain | ms/img | resident weights | adapter |
|
| 9 |
+
|---|---|---|---|---|---|---|---|
|
| 10 |
+
| [`endoedge_qwen3vl8b_lora_r128`](./endoedge_qwen3vl8b_lora_r128) | lora | 128 | **0.2191** | 0.6342 | 344 | 16.98 GiB | 0.65 GiB |
|
| 11 |
+
| [`endoedge_qwen3vl8b_lora_r512`](./endoedge_qwen3vl8b_lora_r512) | lora | 512 | **0.2050** | 0.6772 | 347 | 18.93 GiB | 2.60 GiB |
|
| 12 |
+
| [`endoedge_qwen3vl8b_qlora_r128`](./endoedge_qwen3vl8b_qlora_r128) | qlora | 128 | **0.2509** | 0.6262 | 652 | 8.92 GiB | 0.65 GiB |
|
| 13 |
+
| [`endoedge_qwen3vl8b_qlora_r512`](./endoedge_qwen3vl8b_qlora_r512) | qlora | 512 | **0.2509** | 0.6366 | 662 | 10.87 GiB | 2.60 GiB |
|
| 14 |
+
|
| 15 |
+
Published baselines on SAGE, trained on HyperKvasir or GastroVision (Oli et al. 2026):
|
| 16 |
+
macro-F1 **0.1164 – 0.2431**. Both QLoRA adapters exceed the best of them.
|
| 17 |
+
|
| 18 |
+
## The result worth knowing
|
| 19 |
+
|
| 20 |
+
**In-domain and out-of-domain rankings disagree.** The configuration that fits the
|
| 21 |
+
European training corpora best (LoRA r512) transfers worst to South Asian endoscopy,
|
| 22 |
+
and both QLoRA runs — the weakest in-domain — tie for best under population shift.
|
| 23 |
+
NF4 quantization appears to act as a regulariser against source-domain overfitting.
|
| 24 |
+
|
| 25 |
+
Caveat: four runs, one seed each, 420 test images. The QLoRA-vs-LoRA gap exceeds the
|
| 26 |
+
within-family spread; the rank effect does not.
|
| 27 |
+
|
| 28 |
+
## Choosing one
|
| 29 |
+
|
| 30 |
+
- **Same population as training** → `lora_r512`: best in-domain and ~1.9x faster to serve.
|
| 31 |
+
- **Unseen population** → either QLoRA adapter: +0.046 macro-F1 under shift, at ~1.9x
|
| 32 |
+
the latency. NF4 nearly halves resident weights but barely reduces *peak* inference
|
| 33 |
+
VRAM, because activations dominate at batch 16.
|
| 34 |
+
|
| 35 |
+
Full protocol, projection tables, per-label scores and profiling are in
|
| 36 |
+
`reports/qwen3vl_gi_sage_benchmark_results.pdf` in this folder.
|
| 37 |
+
|
| 38 |
+
All four share the output contract, prompt, limitations and attribution documented in
|
| 39 |
+
each adapter's own card.
|
endoedge_qwen3vl8b_peft_suite/reports/benchmark_results.json
ADDED
|
@@ -0,0 +1,3523 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"gpu": "NVIDIA H100",
|
| 3 |
+
"software": {
|
| 4 |
+
"python": "3.13.13",
|
| 5 |
+
"torch": "2.12.1",
|
| 6 |
+
"transformers": "5.16.1",
|
| 7 |
+
"peft": "0.20.0",
|
| 8 |
+
"accelerate": "1.14.0",
|
| 9 |
+
"bitsandbytes": "0.50.2",
|
| 10 |
+
"wandb": "0.27.2",
|
| 11 |
+
"numpy": "2.5.0",
|
| 12 |
+
"pillow": "12.2.0",
|
| 13 |
+
"jsonschema": "4.26.0",
|
| 14 |
+
"cuda": "13.0",
|
| 15 |
+
"gpu_model": "NVIDIA H100",
|
| 16 |
+
"gpu_count": "1"
|
| 17 |
+
},
|
| 18 |
+
"protocol": {
|
| 19 |
+
"select_n": 600,
|
| 20 |
+
"batch_size": 16,
|
| 21 |
+
"candidates": [
|
| 22 |
+
"step_000750",
|
| 23 |
+
"step_001000",
|
| 24 |
+
"final"
|
| 25 |
+
],
|
| 26 |
+
"taus": [
|
| 27 |
+
0.0,
|
| 28 |
+
0.3,
|
| 29 |
+
0.5,
|
| 30 |
+
0.6,
|
| 31 |
+
0.7,
|
| 32 |
+
0.75,
|
| 33 |
+
0.8,
|
| 34 |
+
0.85,
|
| 35 |
+
0.9,
|
| 36 |
+
0.95,
|
| 37 |
+
0.98,
|
| 38 |
+
0.99
|
| 39 |
+
],
|
| 40 |
+
"decoding": "greedy, max_new_tokens=96",
|
| 41 |
+
"prompt_system": "You are an expert gastrointestinal endoscopist. You read a single endoscopy frame and report your findings as one JSON object.",
|
| 42 |
+
"prompt_instruction": "Report the findings in this GI endoscopy frame as a single JSON object with\nexactly these keys, in this order: tract, landmark, abnormality_present, abnormality_type, grade, prep_quality, procedure, instrument_present.\nUse null for any key this frame does not establish.\n"
|
| 43 |
+
},
|
| 44 |
+
"sage": {
|
| 45 |
+
"n_test": 420,
|
| 46 |
+
"n_train": 880,
|
| 47 |
+
"label_counts_test": {
|
| 48 |
+
"blood": 13,
|
| 49 |
+
"colon": 49,
|
| 50 |
+
"diverticulum": 6,
|
| 51 |
+
"duodenum": 15,
|
| 52 |
+
"esophagitis": 15,
|
| 53 |
+
"esophagus": 73,
|
| 54 |
+
"foreign-body": 9,
|
| 55 |
+
"fundus": 16,
|
| 56 |
+
"gej": 27,
|
| 57 |
+
"growth": 11,
|
| 58 |
+
"inflammation": 40,
|
| 59 |
+
"instrument": 79,
|
| 60 |
+
"polyp": 58,
|
| 61 |
+
"pylorus": 84,
|
| 62 |
+
"rectum": 11,
|
| 63 |
+
"stomach": 126,
|
| 64 |
+
"ulcer": 15,
|
| 65 |
+
"z-line": 17
|
| 66 |
+
}
|
| 67 |
+
},
|
| 68 |
+
"projection": {
|
| 69 |
+
"sage_labels": [
|
| 70 |
+
"blood",
|
| 71 |
+
"colon",
|
| 72 |
+
"diverticulum",
|
| 73 |
+
"duodenum",
|
| 74 |
+
"esophagitis",
|
| 75 |
+
"esophagus",
|
| 76 |
+
"foreign-body",
|
| 77 |
+
"fundus",
|
| 78 |
+
"gej",
|
| 79 |
+
"growth",
|
| 80 |
+
"inflammation",
|
| 81 |
+
"instrument",
|
| 82 |
+
"polyp",
|
| 83 |
+
"pylorus",
|
| 84 |
+
"rectum",
|
| 85 |
+
"stomach",
|
| 86 |
+
"ulcer",
|
| 87 |
+
"z-line"
|
| 88 |
+
],
|
| 89 |
+
"reachable": [
|
| 90 |
+
"blood",
|
| 91 |
+
"colon",
|
| 92 |
+
"diverticulum",
|
| 93 |
+
"duodenum",
|
| 94 |
+
"esophagitis",
|
| 95 |
+
"esophagus",
|
| 96 |
+
"fundus",
|
| 97 |
+
"gej",
|
| 98 |
+
"growth",
|
| 99 |
+
"inflammation",
|
| 100 |
+
"instrument",
|
| 101 |
+
"polyp",
|
| 102 |
+
"pylorus",
|
| 103 |
+
"rectum",
|
| 104 |
+
"stomach",
|
| 105 |
+
"ulcer",
|
| 106 |
+
"z-line"
|
| 107 |
+
],
|
| 108 |
+
"unreachable": [
|
| 109 |
+
"foreign-body"
|
| 110 |
+
],
|
| 111 |
+
"landmark_map": {
|
| 112 |
+
"cecum": [
|
| 113 |
+
"colon"
|
| 114 |
+
],
|
| 115 |
+
"large_bowel_mucosa": [
|
| 116 |
+
"colon"
|
| 117 |
+
],
|
| 118 |
+
"ileocecal_valve": [
|
| 119 |
+
"colon"
|
| 120 |
+
],
|
| 121 |
+
"retroflex_rectum": [
|
| 122 |
+
"rectum"
|
| 123 |
+
],
|
| 124 |
+
"duodenal_bulb": [
|
| 125 |
+
"duodenum"
|
| 126 |
+
],
|
| 127 |
+
"stomach": [
|
| 128 |
+
"stomach"
|
| 129 |
+
],
|
| 130 |
+
"retroflex_stomach": [
|
| 131 |
+
"stomach",
|
| 132 |
+
"fundus"
|
| 133 |
+
],
|
| 134 |
+
"pylorus": [
|
| 135 |
+
"pylorus"
|
| 136 |
+
],
|
| 137 |
+
"gej_zline": [
|
| 138 |
+
"gej",
|
| 139 |
+
"z-line"
|
| 140 |
+
],
|
| 141 |
+
"esophagus": [
|
| 142 |
+
"esophagus"
|
| 143 |
+
],
|
| 144 |
+
"ileum": []
|
| 145 |
+
},
|
| 146 |
+
"abnormality_map": {
|
| 147 |
+
"polyp": [
|
| 148 |
+
"polyp"
|
| 149 |
+
],
|
| 150 |
+
"ulcer": [
|
| 151 |
+
"ulcer"
|
| 152 |
+
],
|
| 153 |
+
"ulcerative_colitis": [
|
| 154 |
+
"inflammation"
|
| 155 |
+
],
|
| 156 |
+
"mucosal_inflammation": [
|
| 157 |
+
"inflammation"
|
| 158 |
+
],
|
| 159 |
+
"erythema": [
|
| 160 |
+
"inflammation"
|
| 161 |
+
],
|
| 162 |
+
"esophagitis": [
|
| 163 |
+
"esophagitis"
|
| 164 |
+
],
|
| 165 |
+
"colon_diverticula": [
|
| 166 |
+
"diverticulum"
|
| 167 |
+
],
|
| 168 |
+
"colorectal_cancer": [
|
| 169 |
+
"growth"
|
| 170 |
+
],
|
| 171 |
+
"blood_in_lumen": [
|
| 172 |
+
"blood"
|
| 173 |
+
],
|
| 174 |
+
"hemorrhoids": [],
|
| 175 |
+
"angiectasia": [],
|
| 176 |
+
"esophageal_varices": [],
|
| 177 |
+
"barretts": []
|
| 178 |
+
},
|
| 179 |
+
"procedure_map": {
|
| 180 |
+
"dyed_lifted_polyp": [
|
| 181 |
+
"instrument"
|
| 182 |
+
],
|
| 183 |
+
"dyed_resection_margin": [
|
| 184 |
+
"instrument"
|
| 185 |
+
],
|
| 186 |
+
"resected_polyp": [
|
| 187 |
+
"instrument"
|
| 188 |
+
],
|
| 189 |
+
"resection_margin": [
|
| 190 |
+
"instrument"
|
| 191 |
+
]
|
| 192 |
+
},
|
| 193 |
+
"inert_fields": [
|
| 194 |
+
"tract",
|
| 195 |
+
"abnormality_present",
|
| 196 |
+
"grade",
|
| 197 |
+
"prep_quality"
|
| 198 |
+
],
|
| 199 |
+
"unmapped_canonical": {
|
| 200 |
+
"landmark": [
|
| 201 |
+
"ileum"
|
| 202 |
+
],
|
| 203 |
+
"abnormality_type": [
|
| 204 |
+
"hemorrhoids",
|
| 205 |
+
"angiectasia",
|
| 206 |
+
"esophageal_varices",
|
| 207 |
+
"barretts"
|
| 208 |
+
],
|
| 209 |
+
"grade": [
|
| 210 |
+
"<all values>"
|
| 211 |
+
],
|
| 212 |
+
"prep_quality": [
|
| 213 |
+
"<all values>"
|
| 214 |
+
]
|
| 215 |
+
},
|
| 216 |
+
"ambiguous_decisions": [
|
| 217 |
+
{
|
| 218 |
+
"source": "landmark=gej_zline",
|
| 219 |
+
"target": "gej + z-line",
|
| 220 |
+
"rationale": "our schema merged the two; emitting both is what the output asserts, at a precision cost on whichever SAGE did not label"
|
| 221 |
+
},
|
| 222 |
+
{
|
| 223 |
+
"source": "landmark=retroflex_stomach",
|
| 224 |
+
"target": "stomach + fundus",
|
| 225 |
+
"rationale": "SAGE's multi-class taxonomy names this view 'fundus-retroflexion'"
|
| 226 |
+
},
|
| 227 |
+
{
|
| 228 |
+
"source": "landmark=ileocecal_valve",
|
| 229 |
+
"target": "colon",
|
| 230 |
+
"rationale": "the valve is imaged from the caecum; SAGE has no ileocaecal label"
|
| 231 |
+
},
|
| 232 |
+
{
|
| 233 |
+
"source": "abnormality_type=ulcerative_colitis",
|
| 234 |
+
"target": "inflammation",
|
| 235 |
+
"rationale": "SAGE has no UC-specific label; inflammation is its nearest class"
|
| 236 |
+
},
|
| 237 |
+
{
|
| 238 |
+
"source": "abnormality_type=colorectal_cancer",
|
| 239 |
+
"target": "growth",
|
| 240 |
+
"rationale": "SAGE's 'growth' covers tumour-like lesions"
|
| 241 |
+
},
|
| 242 |
+
{
|
| 243 |
+
"source": "procedure=*",
|
| 244 |
+
"target": "instrument",
|
| 245 |
+
"rationale": "all four procedure values name an instrument-mediated act"
|
| 246 |
+
}
|
| 247 |
+
]
|
| 248 |
+
},
|
| 249 |
+
"runs": {
|
| 250 |
+
"LoRA_r128": {
|
| 251 |
+
"method": "lora",
|
| 252 |
+
"rank": 128,
|
| 253 |
+
"candidates": {
|
| 254 |
+
"step_000750": {
|
| 255 |
+
"adapter_dir": "/work/FAC/HEC/DESI/yshresth/ai_health/checkpoints/qwen3_vl_8b_unified/LoRA_r128/step_000750/adapter",
|
| 256 |
+
"adapter_bytes": 698434660,
|
| 257 |
+
"checkpoint_bytes": 2095586386,
|
| 258 |
+
"in_domain": {
|
| 259 |
+
"per_field_macro_f1": {
|
| 260 |
+
"instrument_present": 1.0,
|
| 261 |
+
"abnormality_present": 0.19743589743589746,
|
| 262 |
+
"abnormality_type": 0.3443247384423855,
|
| 263 |
+
"tract": 0.9818271604938272,
|
| 264 |
+
"landmark": 0.8500006247657591,
|
| 265 |
+
"procedure": 0.4714285714285714,
|
| 266 |
+
"grade": 0.4392817200584416,
|
| 267 |
+
"prep_quality": 0.6551724137931035
|
| 268 |
+
},
|
| 269 |
+
"mean_macro_f1": 0.6174338908022483,
|
| 270 |
+
"schema_valid_rate": 1.0,
|
| 271 |
+
"n": 600
|
| 272 |
+
}
|
| 273 |
+
},
|
| 274 |
+
"step_001000": {
|
| 275 |
+
"adapter_dir": "/work/FAC/HEC/DESI/yshresth/ai_health/checkpoints/qwen3_vl_8b_unified/LoRA_r128/step_001000/adapter",
|
| 276 |
+
"adapter_bytes": 698434660,
|
| 277 |
+
"checkpoint_bytes": 2095586394,
|
| 278 |
+
"in_domain": {
|
| 279 |
+
"per_field_macro_f1": {
|
| 280 |
+
"instrument_present": 1.0,
|
| 281 |
+
"abnormality_present": 0.19743589743589746,
|
| 282 |
+
"abnormality_type": 0.3792477018850563,
|
| 283 |
+
"tract": 0.9819197525247931,
|
| 284 |
+
"landmark": 0.8841549974421586,
|
| 285 |
+
"procedure": 0.47169968966340414,
|
| 286 |
+
"grade": 0.41239924210105805,
|
| 287 |
+
"prep_quality": 0.7027914614121511
|
| 288 |
+
},
|
| 289 |
+
"mean_macro_f1": 0.6287060928080649,
|
| 290 |
+
"schema_valid_rate": 1.0,
|
| 291 |
+
"n": 600
|
| 292 |
+
}
|
| 293 |
+
},
|
| 294 |
+
"final": {
|
| 295 |
+
"adapter_dir": "/work/FAC/HEC/DESI/yshresth/ai_health/checkpoints/qwen3_vl_8b_unified/LoRA_r128/final/adapter",
|
| 296 |
+
"adapter_bytes": 698434660,
|
| 297 |
+
"checkpoint_bytes": 2095586392,
|
| 298 |
+
"in_domain": {
|
| 299 |
+
"per_field_macro_f1": {
|
| 300 |
+
"instrument_present": 1.0,
|
| 301 |
+
"abnormality_present": 0.19743589743589746,
|
| 302 |
+
"abnormality_type": 0.3778946861357557,
|
| 303 |
+
"tract": 0.9798339957914426,
|
| 304 |
+
"landmark": 0.8684526365981942,
|
| 305 |
+
"procedure": 0.5161155017881585,
|
| 306 |
+
"grade": 0.4310143572526437,
|
| 307 |
+
"prep_quality": 0.7027914614121511
|
| 308 |
+
},
|
| 309 |
+
"mean_macro_f1": 0.6341923170517804,
|
| 310 |
+
"schema_valid_rate": 1.0,
|
| 311 |
+
"n": 600
|
| 312 |
+
}
|
| 313 |
+
}
|
| 314 |
+
},
|
| 315 |
+
"selected": "final",
|
| 316 |
+
"selection_criterion": "max mean per-field macro-F1 on a stratified in-domain validation subset (n=600); ties broken toward the later step",
|
| 317 |
+
"profiling": {
|
| 318 |
+
"adapter_bytes_on_disk": 698434660,
|
| 319 |
+
"checkpoint_bytes_on_disk": 2095586392,
|
| 320 |
+
"final_adapter_bytes_on_disk": 698434660,
|
| 321 |
+
"load_seconds": 18.275278568267822,
|
| 322 |
+
"weights_vram_bytes": -512,
|
| 323 |
+
"trainable_parameters": 349175808,
|
| 324 |
+
"total_parameters": 9116299504,
|
| 325 |
+
"trainable_percentage": 3.830236247139429,
|
| 326 |
+
"peak_vram_bytes_inference": 23346407936,
|
| 327 |
+
"peak_vram_reserved_bytes": 37549506560,
|
| 328 |
+
"sage_test_wall_seconds": 147.8819031715393,
|
| 329 |
+
"images_per_second": 2.8401041032911953,
|
| 330 |
+
"latency_mean_s": 0.34411949877006315,
|
| 331 |
+
"latency_p50_s": 0.3368639631808037,
|
| 332 |
+
"latency_p90_s": 0.34150418431090657,
|
| 333 |
+
"latency_p99_s": 0.3556850166351069,
|
| 334 |
+
"gen_tokens_mean": 69.55952380952381,
|
| 335 |
+
"tokens_per_second": 197.55628899441015,
|
| 336 |
+
"weights": {
|
| 337 |
+
"baseline_bytes": 0,
|
| 338 |
+
"resident_after_load_bytes": 18232670720,
|
| 339 |
+
"weights_vram_bytes": 18232670720,
|
| 340 |
+
"weights_vram_gib": 16.98049783706665,
|
| 341 |
+
"param_bytes": 18232599008,
|
| 342 |
+
"buffer_bytes": 584,
|
| 343 |
+
"param_dtype_counts": {
|
| 344 |
+
"torch.bfloat16": 9116299504
|
| 345 |
+
},
|
| 346 |
+
"load_seconds": 18.34323501586914,
|
| 347 |
+
"adapter_bytes_on_disk": 698434660,
|
| 348 |
+
"adapter_gib_on_disk": 0.6504679657518864,
|
| 349 |
+
"trainable_parameters": 349175808,
|
| 350 |
+
"total_parameters": 9116299504
|
| 351 |
+
}
|
| 352 |
+
},
|
| 353 |
+
"sage_raw": {
|
| 354 |
+
"tau": 0.0,
|
| 355 |
+
"n_images": 420,
|
| 356 |
+
"macro_f1": 0.2190964942210551,
|
| 357 |
+
"macro_f1_reachable": 0.23198452329288186,
|
| 358 |
+
"micro_f1": 0.3372093023255814,
|
| 359 |
+
"micro_precision": 0.2746212121212121,
|
| 360 |
+
"micro_recall": 0.4367469879518072,
|
| 361 |
+
"samples_exact_match": 0.02142857142857143,
|
| 362 |
+
"map_macro": 0.2568800696517516,
|
| 363 |
+
"map_weighted": 0.38415340330940506,
|
| 364 |
+
"map_micro": 0.31111488620268424,
|
| 365 |
+
"mean_labels_gold": 1.5809523809523809,
|
| 366 |
+
"mean_labels_pred": 2.5142857142857142,
|
| 367 |
+
"per_label": {
|
| 368 |
+
"blood": {
|
| 369 |
+
"support": 13,
|
| 370 |
+
"tp": 0,
|
| 371 |
+
"fp": 0,
|
| 372 |
+
"fn": 13,
|
| 373 |
+
"precision": 0.0,
|
| 374 |
+
"recall": 0.0,
|
| 375 |
+
"f1": 0.0,
|
| 376 |
+
"ap": 0.030952380952380953,
|
| 377 |
+
"n_predicted": 0,
|
| 378 |
+
"reachable": true
|
| 379 |
+
},
|
| 380 |
+
"colon": {
|
| 381 |
+
"support": 49,
|
| 382 |
+
"tp": 42,
|
| 383 |
+
"fp": 145,
|
| 384 |
+
"fn": 7,
|
| 385 |
+
"precision": 0.22459893048128343,
|
| 386 |
+
"recall": 0.8571428571428571,
|
| 387 |
+
"f1": 0.35593220338983045,
|
| 388 |
+
"ap": 0.3535809106568859,
|
| 389 |
+
"n_predicted": 187,
|
| 390 |
+
"reachable": true
|
| 391 |
+
},
|
| 392 |
+
"diverticulum": {
|
| 393 |
+
"support": 6,
|
| 394 |
+
"tp": 0,
|
| 395 |
+
"fp": 0,
|
| 396 |
+
"fn": 6,
|
| 397 |
+
"precision": 0.0,
|
| 398 |
+
"recall": 0.0,
|
| 399 |
+
"f1": 0.0,
|
| 400 |
+
"ap": 0.014285714285714285,
|
| 401 |
+
"n_predicted": 0,
|
| 402 |
+
"reachable": true
|
| 403 |
+
},
|
| 404 |
+
"duodenum": {
|
| 405 |
+
"support": 15,
|
| 406 |
+
"tp": 0,
|
| 407 |
+
"fp": 0,
|
| 408 |
+
"fn": 15,
|
| 409 |
+
"precision": 0.0,
|
| 410 |
+
"recall": 0.0,
|
| 411 |
+
"f1": 0.0,
|
| 412 |
+
"ap": 0.03571428571428571,
|
| 413 |
+
"n_predicted": 0,
|
| 414 |
+
"reachable": true
|
| 415 |
+
},
|
| 416 |
+
"esophagitis": {
|
| 417 |
+
"support": 15,
|
| 418 |
+
"tp": 0,
|
| 419 |
+
"fp": 8,
|
| 420 |
+
"fn": 15,
|
| 421 |
+
"precision": 0.0,
|
| 422 |
+
"recall": 0.0,
|
| 423 |
+
"f1": 0.0,
|
| 424 |
+
"ap": 0.03571428571428571,
|
| 425 |
+
"n_predicted": 8,
|
| 426 |
+
"reachable": true
|
| 427 |
+
},
|
| 428 |
+
"esophagus": {
|
| 429 |
+
"support": 73,
|
| 430 |
+
"tp": 11,
|
| 431 |
+
"fp": 2,
|
| 432 |
+
"fn": 62,
|
| 433 |
+
"precision": 0.8461538461538461,
|
| 434 |
+
"recall": 0.1506849315068493,
|
| 435 |
+
"f1": 0.2558139534883721,
|
| 436 |
+
"ap": 0.29830397912589696,
|
| 437 |
+
"n_predicted": 13,
|
| 438 |
+
"reachable": true
|
| 439 |
+
},
|
| 440 |
+
"foreign-body": {
|
| 441 |
+
"support": 9,
|
| 442 |
+
"tp": 0,
|
| 443 |
+
"fp": 0,
|
| 444 |
+
"fn": 9,
|
| 445 |
+
"precision": 0.0,
|
| 446 |
+
"recall": 0.0,
|
| 447 |
+
"f1": 0.0,
|
| 448 |
+
"ap": 0.02142857142857143,
|
| 449 |
+
"n_predicted": 0,
|
| 450 |
+
"reachable": false
|
| 451 |
+
},
|
| 452 |
+
"fundus": {
|
| 453 |
+
"support": 16,
|
| 454 |
+
"tp": 0,
|
| 455 |
+
"fp": 0,
|
| 456 |
+
"fn": 16,
|
| 457 |
+
"precision": 0.0,
|
| 458 |
+
"recall": 0.0,
|
| 459 |
+
"f1": 0.0,
|
| 460 |
+
"ap": 0.0380952380952381,
|
| 461 |
+
"n_predicted": 0,
|
| 462 |
+
"reachable": true
|
| 463 |
+
},
|
| 464 |
+
"gej": {
|
| 465 |
+
"support": 27,
|
| 466 |
+
"tp": 13,
|
| 467 |
+
"fp": 17,
|
| 468 |
+
"fn": 14,
|
| 469 |
+
"precision": 0.43333333333333335,
|
| 470 |
+
"recall": 0.48148148148148145,
|
| 471 |
+
"f1": 0.456140350877193,
|
| 472 |
+
"ap": 0.26478755812089144,
|
| 473 |
+
"n_predicted": 30,
|
| 474 |
+
"reachable": true
|
| 475 |
+
},
|
| 476 |
+
"growth": {
|
| 477 |
+
"support": 11,
|
| 478 |
+
"tp": 1,
|
| 479 |
+
"fp": 0,
|
| 480 |
+
"fn": 10,
|
| 481 |
+
"precision": 1.0,
|
| 482 |
+
"recall": 0.09090909090909091,
|
| 483 |
+
"f1": 0.16666666666666669,
|
| 484 |
+
"ap": 0.11471861471861472,
|
| 485 |
+
"n_predicted": 1,
|
| 486 |
+
"reachable": true
|
| 487 |
+
},
|
| 488 |
+
"inflammation": {
|
| 489 |
+
"support": 40,
|
| 490 |
+
"tp": 20,
|
| 491 |
+
"fp": 44,
|
| 492 |
+
"fn": 20,
|
| 493 |
+
"precision": 0.3125,
|
| 494 |
+
"recall": 0.5,
|
| 495 |
+
"f1": 0.38461538461538464,
|
| 496 |
+
"ap": 0.27389044197188844,
|
| 497 |
+
"n_predicted": 64,
|
| 498 |
+
"reachable": true
|
| 499 |
+
},
|
| 500 |
+
"instrument": {
|
| 501 |
+
"support": 79,
|
| 502 |
+
"tp": 77,
|
| 503 |
+
"fp": 264,
|
| 504 |
+
"fn": 2,
|
| 505 |
+
"precision": 0.22580645161290322,
|
| 506 |
+
"recall": 0.9746835443037974,
|
| 507 |
+
"f1": 0.3666666666666667,
|
| 508 |
+
"ap": 0.7270885058546405,
|
| 509 |
+
"n_predicted": 341,
|
| 510 |
+
"reachable": true
|
| 511 |
+
},
|
| 512 |
+
"polyp": {
|
| 513 |
+
"support": 58,
|
| 514 |
+
"tp": 55,
|
| 515 |
+
"fp": 215,
|
| 516 |
+
"fn": 3,
|
| 517 |
+
"precision": 0.2037037037037037,
|
| 518 |
+
"recall": 0.9482758620689655,
|
| 519 |
+
"f1": 0.33536585365853655,
|
| 520 |
+
"ap": 0.6758311715790841,
|
| 521 |
+
"n_predicted": 270,
|
| 522 |
+
"reachable": true
|
| 523 |
+
},
|
| 524 |
+
"pylorus": {
|
| 525 |
+
"support": 84,
|
| 526 |
+
"tp": 30,
|
| 527 |
+
"fp": 1,
|
| 528 |
+
"fn": 54,
|
| 529 |
+
"precision": 0.967741935483871,
|
| 530 |
+
"recall": 0.35714285714285715,
|
| 531 |
+
"f1": 0.5217391304347826,
|
| 532 |
+
"ap": 0.48533026113671274,
|
| 533 |
+
"n_predicted": 31,
|
| 534 |
+
"reachable": true
|
| 535 |
+
},
|
| 536 |
+
"rectum": {
|
| 537 |
+
"support": 11,
|
| 538 |
+
"tp": 4,
|
| 539 |
+
"fp": 12,
|
| 540 |
+
"fn": 7,
|
| 541 |
+
"precision": 0.25,
|
| 542 |
+
"recall": 0.36363636363636365,
|
| 543 |
+
"f1": 0.2962962962962963,
|
| 544 |
+
"ap": 0.20252525252525252,
|
| 545 |
+
"n_predicted": 16,
|
| 546 |
+
"reachable": true
|
| 547 |
+
},
|
| 548 |
+
"stomach": {
|
| 549 |
+
"support": 126,
|
| 550 |
+
"tp": 24,
|
| 551 |
+
"fp": 41,
|
| 552 |
+
"fn": 102,
|
| 553 |
+
"precision": 0.36923076923076925,
|
| 554 |
+
"recall": 0.19047619047619047,
|
| 555 |
+
"f1": 0.2513089005235602,
|
| 556 |
+
"ap": 0.33768920164872707,
|
| 557 |
+
"n_predicted": 65,
|
| 558 |
+
"reachable": true
|
| 559 |
+
},
|
| 560 |
+
"ulcer": {
|
| 561 |
+
"support": 15,
|
| 562 |
+
"tp": 0,
|
| 563 |
+
"fp": 0,
|
| 564 |
+
"fn": 15,
|
| 565 |
+
"precision": 0.0,
|
| 566 |
+
"recall": 0.0,
|
| 567 |
+
"f1": 0.0,
|
| 568 |
+
"ap": 0.03571428571428571,
|
| 569 |
+
"n_predicted": 0,
|
| 570 |
+
"reachable": true
|
| 571 |
+
},
|
| 572 |
+
"z-line": {
|
| 573 |
+
"support": 17,
|
| 574 |
+
"tp": 13,
|
| 575 |
+
"fp": 17,
|
| 576 |
+
"fn": 4,
|
| 577 |
+
"precision": 0.43333333333333335,
|
| 578 |
+
"recall": 0.7647058823529411,
|
| 579 |
+
"f1": 0.5531914893617021,
|
| 580 |
+
"ap": 0.6781905944881723,
|
| 581 |
+
"n_predicted": 30,
|
| 582 |
+
"reachable": true
|
| 583 |
+
}
|
| 584 |
+
}
|
| 585 |
+
},
|
| 586 |
+
"sage_calibrated": {
|
| 587 |
+
"tau": 0.99,
|
| 588 |
+
"n_images": 420,
|
| 589 |
+
"macro_f1": 0.21283666617724373,
|
| 590 |
+
"macro_f1_reachable": 0.22535647007002277,
|
| 591 |
+
"micro_f1": 0.37247706422018345,
|
| 592 |
+
"micro_precision": 0.4765258215962441,
|
| 593 |
+
"micro_recall": 0.3057228915662651,
|
| 594 |
+
"samples_exact_match": 0.1595238095238095,
|
| 595 |
+
"map_macro": 0.2568800696517516,
|
| 596 |
+
"map_weighted": 0.38415340330940506,
|
| 597 |
+
"map_micro": 0.31111488620268424,
|
| 598 |
+
"mean_labels_gold": 1.5809523809523809,
|
| 599 |
+
"mean_labels_pred": 1.0142857142857142,
|
| 600 |
+
"per_label": {
|
| 601 |
+
"blood": {
|
| 602 |
+
"support": 13,
|
| 603 |
+
"tp": 0,
|
| 604 |
+
"fp": 0,
|
| 605 |
+
"fn": 13,
|
| 606 |
+
"precision": 0.0,
|
| 607 |
+
"recall": 0.0,
|
| 608 |
+
"f1": 0.0,
|
| 609 |
+
"ap": 0.030952380952380953,
|
| 610 |
+
"n_predicted": 0,
|
| 611 |
+
"reachable": true
|
| 612 |
+
},
|
| 613 |
+
"colon": {
|
| 614 |
+
"support": 49,
|
| 615 |
+
"tp": 27,
|
| 616 |
+
"fp": 67,
|
| 617 |
+
"fn": 22,
|
| 618 |
+
"precision": 0.2872340425531915,
|
| 619 |
+
"recall": 0.5510204081632653,
|
| 620 |
+
"f1": 0.3776223776223776,
|
| 621 |
+
"ap": 0.3535809106568859,
|
| 622 |
+
"n_predicted": 94,
|
| 623 |
+
"reachable": true
|
| 624 |
+
},
|
| 625 |
+
"diverticulum": {
|
| 626 |
+
"support": 6,
|
| 627 |
+
"tp": 0,
|
| 628 |
+
"fp": 0,
|
| 629 |
+
"fn": 6,
|
| 630 |
+
"precision": 0.0,
|
| 631 |
+
"recall": 0.0,
|
| 632 |
+
"f1": 0.0,
|
| 633 |
+
"ap": 0.014285714285714285,
|
| 634 |
+
"n_predicted": 0,
|
| 635 |
+
"reachable": true
|
| 636 |
+
},
|
| 637 |
+
"duodenum": {
|
| 638 |
+
"support": 15,
|
| 639 |
+
"tp": 0,
|
| 640 |
+
"fp": 0,
|
| 641 |
+
"fn": 15,
|
| 642 |
+
"precision": 0.0,
|
| 643 |
+
"recall": 0.0,
|
| 644 |
+
"f1": 0.0,
|
| 645 |
+
"ap": 0.03571428571428571,
|
| 646 |
+
"n_predicted": 0,
|
| 647 |
+
"reachable": true
|
| 648 |
+
},
|
| 649 |
+
"esophagitis": {
|
| 650 |
+
"support": 15,
|
| 651 |
+
"tp": 0,
|
| 652 |
+
"fp": 0,
|
| 653 |
+
"fn": 15,
|
| 654 |
+
"precision": 0.0,
|
| 655 |
+
"recall": 0.0,
|
| 656 |
+
"f1": 0.0,
|
| 657 |
+
"ap": 0.03571428571428571,
|
| 658 |
+
"n_predicted": 0,
|
| 659 |
+
"reachable": true
|
| 660 |
+
},
|
| 661 |
+
"esophagus": {
|
| 662 |
+
"support": 73,
|
| 663 |
+
"tp": 5,
|
| 664 |
+
"fp": 0,
|
| 665 |
+
"fn": 68,
|
| 666 |
+
"precision": 1.0,
|
| 667 |
+
"recall": 0.0684931506849315,
|
| 668 |
+
"f1": 0.1282051282051282,
|
| 669 |
+
"ap": 0.29830397912589696,
|
| 670 |
+
"n_predicted": 5,
|
| 671 |
+
"reachable": true
|
| 672 |
+
},
|
| 673 |
+
"foreign-body": {
|
| 674 |
+
"support": 9,
|
| 675 |
+
"tp": 0,
|
| 676 |
+
"fp": 0,
|
| 677 |
+
"fn": 9,
|
| 678 |
+
"precision": 0.0,
|
| 679 |
+
"recall": 0.0,
|
| 680 |
+
"f1": 0.0,
|
| 681 |
+
"ap": 0.02142857142857143,
|
| 682 |
+
"n_predicted": 0,
|
| 683 |
+
"reachable": false
|
| 684 |
+
},
|
| 685 |
+
"fundus": {
|
| 686 |
+
"support": 16,
|
| 687 |
+
"tp": 0,
|
| 688 |
+
"fp": 0,
|
| 689 |
+
"fn": 16,
|
| 690 |
+
"precision": 0.0,
|
| 691 |
+
"recall": 0.0,
|
| 692 |
+
"f1": 0.0,
|
| 693 |
+
"ap": 0.0380952380952381,
|
| 694 |
+
"n_predicted": 0,
|
| 695 |
+
"reachable": true
|
| 696 |
+
},
|
| 697 |
+
"gej": {
|
| 698 |
+
"support": 27,
|
| 699 |
+
"tp": 12,
|
| 700 |
+
"fp": 13,
|
| 701 |
+
"fn": 15,
|
| 702 |
+
"precision": 0.48,
|
| 703 |
+
"recall": 0.4444444444444444,
|
| 704 |
+
"f1": 0.4615384615384615,
|
| 705 |
+
"ap": 0.26478755812089144,
|
| 706 |
+
"n_predicted": 25,
|
| 707 |
+
"reachable": true
|
| 708 |
+
},
|
| 709 |
+
"growth": {
|
| 710 |
+
"support": 11,
|
| 711 |
+
"tp": 0,
|
| 712 |
+
"fp": 0,
|
| 713 |
+
"fn": 11,
|
| 714 |
+
"precision": 0.0,
|
| 715 |
+
"recall": 0.0,
|
| 716 |
+
"f1": 0.0,
|
| 717 |
+
"ap": 0.11471861471861472,
|
| 718 |
+
"n_predicted": 0,
|
| 719 |
+
"reachable": true
|
| 720 |
+
},
|
| 721 |
+
"inflammation": {
|
| 722 |
+
"support": 40,
|
| 723 |
+
"tp": 2,
|
| 724 |
+
"fp": 0,
|
| 725 |
+
"fn": 38,
|
| 726 |
+
"precision": 1.0,
|
| 727 |
+
"recall": 0.05,
|
| 728 |
+
"f1": 0.09523809523809523,
|
| 729 |
+
"ap": 0.27389044197188844,
|
| 730 |
+
"n_predicted": 2,
|
| 731 |
+
"reachable": true
|
| 732 |
+
},
|
| 733 |
+
"instrument": {
|
| 734 |
+
"support": 79,
|
| 735 |
+
"tp": 58,
|
| 736 |
+
"fp": 54,
|
| 737 |
+
"fn": 21,
|
| 738 |
+
"precision": 0.5178571428571429,
|
| 739 |
+
"recall": 0.7341772151898734,
|
| 740 |
+
"f1": 0.6073298429319371,
|
| 741 |
+
"ap": 0.7270885058546405,
|
| 742 |
+
"n_predicted": 112,
|
| 743 |
+
"reachable": true
|
| 744 |
+
},
|
| 745 |
+
"polyp": {
|
| 746 |
+
"support": 58,
|
| 747 |
+
"tp": 42,
|
| 748 |
+
"fp": 47,
|
| 749 |
+
"fn": 16,
|
| 750 |
+
"precision": 0.47191011235955055,
|
| 751 |
+
"recall": 0.7241379310344828,
|
| 752 |
+
"f1": 0.5714285714285714,
|
| 753 |
+
"ap": 0.6758311715790841,
|
| 754 |
+
"n_predicted": 89,
|
| 755 |
+
"reachable": true
|
| 756 |
+
},
|
| 757 |
+
"pylorus": {
|
| 758 |
+
"support": 84,
|
| 759 |
+
"tp": 22,
|
| 760 |
+
"fp": 0,
|
| 761 |
+
"fn": 62,
|
| 762 |
+
"precision": 1.0,
|
| 763 |
+
"recall": 0.2619047619047619,
|
| 764 |
+
"f1": 0.41509433962264153,
|
| 765 |
+
"ap": 0.48533026113671274,
|
| 766 |
+
"n_predicted": 22,
|
| 767 |
+
"reachable": true
|
| 768 |
+
},
|
| 769 |
+
"rectum": {
|
| 770 |
+
"support": 11,
|
| 771 |
+
"tp": 3,
|
| 772 |
+
"fp": 4,
|
| 773 |
+
"fn": 8,
|
| 774 |
+
"precision": 0.42857142857142855,
|
| 775 |
+
"recall": 0.2727272727272727,
|
| 776 |
+
"f1": 0.33333333333333326,
|
| 777 |
+
"ap": 0.20252525252525252,
|
| 778 |
+
"n_predicted": 7,
|
| 779 |
+
"reachable": true
|
| 780 |
+
},
|
| 781 |
+
"stomach": {
|
| 782 |
+
"support": 126,
|
| 783 |
+
"tp": 19,
|
| 784 |
+
"fp": 26,
|
| 785 |
+
"fn": 107,
|
| 786 |
+
"precision": 0.4222222222222222,
|
| 787 |
+
"recall": 0.15079365079365079,
|
| 788 |
+
"f1": 0.22222222222222224,
|
| 789 |
+
"ap": 0.33768920164872707,
|
| 790 |
+
"n_predicted": 45,
|
| 791 |
+
"reachable": true
|
| 792 |
+
},
|
| 793 |
+
"ulcer": {
|
| 794 |
+
"support": 15,
|
| 795 |
+
"tp": 0,
|
| 796 |
+
"fp": 0,
|
| 797 |
+
"fn": 15,
|
| 798 |
+
"precision": 0.0,
|
| 799 |
+
"recall": 0.0,
|
| 800 |
+
"f1": 0.0,
|
| 801 |
+
"ap": 0.03571428571428571,
|
| 802 |
+
"n_predicted": 0,
|
| 803 |
+
"reachable": true
|
| 804 |
+
},
|
| 805 |
+
"z-line": {
|
| 806 |
+
"support": 17,
|
| 807 |
+
"tp": 13,
|
| 808 |
+
"fp": 12,
|
| 809 |
+
"fn": 4,
|
| 810 |
+
"precision": 0.52,
|
| 811 |
+
"recall": 0.7647058823529411,
|
| 812 |
+
"f1": 0.6190476190476191,
|
| 813 |
+
"ap": 0.6781905944881723,
|
| 814 |
+
"n_predicted": 25,
|
| 815 |
+
"reachable": true
|
| 816 |
+
}
|
| 817 |
+
}
|
| 818 |
+
},
|
| 819 |
+
"tau_star": 0.99,
|
| 820 |
+
"tau_sweep_train": [
|
| 821 |
+
{
|
| 822 |
+
"tau": 0.0,
|
| 823 |
+
"macro_f1": 0.19954730909033971,
|
| 824 |
+
"macro_f1_reachable": 0.2112853860956538,
|
| 825 |
+
"micro_f1": 0.3173348390739695,
|
| 826 |
+
"micro_precision": 0.2607888631090487,
|
| 827 |
+
"micro_recall": 0.40519105984138426,
|
| 828 |
+
"mean_labels_pred": 2.4488636363636362,
|
| 829 |
+
"samples_exact_match": 0.028409090909090908
|
| 830 |
+
},
|
| 831 |
+
{
|
| 832 |
+
"tau": 0.3,
|
| 833 |
+
"macro_f1": 0.19954730909033971,
|
| 834 |
+
"macro_f1_reachable": 0.2112853860956538,
|
| 835 |
+
"micro_f1": 0.3173348390739695,
|
| 836 |
+
"micro_precision": 0.2607888631090487,
|
| 837 |
+
"micro_recall": 0.40519105984138426,
|
| 838 |
+
"mean_labels_pred": 2.4488636363636362,
|
| 839 |
+
"samples_exact_match": 0.028409090909090908
|
| 840 |
+
},
|
| 841 |
+
{
|
| 842 |
+
"tau": 0.5,
|
| 843 |
+
"macro_f1": 0.19957044383726252,
|
| 844 |
+
"macro_f1_reachable": 0.21130988171004267,
|
| 845 |
+
"micro_f1": 0.31742445636825756,
|
| 846 |
+
"micro_precision": 0.26090993500464255,
|
| 847 |
+
"micro_recall": 0.40519105984138426,
|
| 848 |
+
"mean_labels_pred": 2.4477272727272728,
|
| 849 |
+
"samples_exact_match": 0.028409090909090908
|
| 850 |
+
},
|
| 851 |
+
{
|
| 852 |
+
"tau": 0.6,
|
| 853 |
+
"macro_f1": 0.19961687017684998,
|
| 854 |
+
"macro_f1_reachable": 0.21135903901078232,
|
| 855 |
+
"micro_f1": 0.3176038428934727,
|
| 856 |
+
"micro_precision": 0.2611524163568773,
|
| 857 |
+
"micro_recall": 0.40519105984138426,
|
| 858 |
+
"mean_labels_pred": 2.4454545454545453,
|
| 859 |
+
"samples_exact_match": 0.028409090909090908
|
| 860 |
+
},
|
| 861 |
+
{
|
| 862 |
+
"tau": 0.7,
|
| 863 |
+
"macro_f1": 0.19975741680897988,
|
| 864 |
+
"macro_f1_reachable": 0.21150785309186104,
|
| 865 |
+
"micro_f1": 0.31814322105859044,
|
| 866 |
+
"micro_precision": 0.2618825722273998,
|
| 867 |
+
"micro_recall": 0.40519105984138426,
|
| 868 |
+
"mean_labels_pred": 2.4386363636363635,
|
| 869 |
+
"samples_exact_match": 0.029545454545454545
|
| 870 |
+
},
|
| 871 |
+
{
|
| 872 |
+
"tau": 0.75,
|
| 873 |
+
"macro_f1": 0.19970157294323373,
|
| 874 |
+
"macro_f1_reachable": 0.2114487242928357,
|
| 875 |
+
"micro_f1": 0.31784702549575067,
|
| 876 |
+
"micro_precision": 0.26178254783014465,
|
| 877 |
+
"micro_recall": 0.40447007930785867,
|
| 878 |
+
"mean_labels_pred": 2.4352272727272726,
|
| 879 |
+
"samples_exact_match": 0.029545454545454545
|
| 880 |
+
},
|
| 881 |
+
{
|
| 882 |
+
"tau": 0.8,
|
| 883 |
+
"macro_f1": 0.1997252012682319,
|
| 884 |
+
"macro_f1_reachable": 0.21147374251930434,
|
| 885 |
+
"micro_f1": 0.31793709266081044,
|
| 886 |
+
"micro_precision": 0.2619047619047619,
|
| 887 |
+
"micro_recall": 0.40447007930785867,
|
| 888 |
+
"mean_labels_pred": 2.434090909090909,
|
| 889 |
+
"samples_exact_match": 0.029545454545454545
|
| 890 |
+
},
|
| 891 |
+
{
|
| 892 |
+
"tau": 0.85,
|
| 893 |
+
"macro_f1": 0.19997102608611128,
|
| 894 |
+
"macro_f1_reachable": 0.2117340276205884,
|
| 895 |
+
"micro_f1": 0.31875,
|
| 896 |
+
"micro_precision": 0.2630098452883263,
|
| 897 |
+
"micro_recall": 0.40447007930785867,
|
| 898 |
+
"mean_labels_pred": 2.4238636363636363,
|
| 899 |
+
"samples_exact_match": 0.03068181818181818
|
| 900 |
+
},
|
| 901 |
+
{
|
| 902 |
+
"tau": 0.9,
|
| 903 |
+
"macro_f1": 0.20155356017273368,
|
| 904 |
+
"macro_f1_reachable": 0.21340965194760037,
|
| 905 |
+
"micro_f1": 0.3240255962769052,
|
| 906 |
+
"micro_precision": 0.2715748415407119,
|
| 907 |
+
"micro_recall": 0.4015861571737563,
|
| 908 |
+
"mean_labels_pred": 2.330681818181818,
|
| 909 |
+
"samples_exact_match": 0.03409090909090909
|
| 910 |
+
},
|
| 911 |
+
{
|
| 912 |
+
"tau": 0.95,
|
| 913 |
+
"macro_f1": 0.1930876392835447,
|
| 914 |
+
"macro_f1_reachable": 0.20444573571198854,
|
| 915 |
+
"micro_f1": 0.3468208092485549,
|
| 916 |
+
"micro_precision": 0.3281853281853282,
|
| 917 |
+
"micro_recall": 0.36770007209805333,
|
| 918 |
+
"mean_labels_pred": 1.7659090909090909,
|
| 919 |
+
"samples_exact_match": 0.0659090909090909
|
| 920 |
+
},
|
| 921 |
+
{
|
| 922 |
+
"tau": 0.98,
|
| 923 |
+
"macro_f1": 0.1978402784350861,
|
| 924 |
+
"macro_f1_reachable": 0.2094779418724441,
|
| 925 |
+
"micro_f1": 0.36969192339716905,
|
| 926 |
+
"micro_precision": 0.4374384236453202,
|
| 927 |
+
"micro_recall": 0.3201153568853641,
|
| 928 |
+
"mean_labels_pred": 1.1534090909090908,
|
| 929 |
+
"samples_exact_match": 0.12045454545454545
|
| 930 |
+
},
|
| 931 |
+
{
|
| 932 |
+
"tau": 0.99,
|
| 933 |
+
"macro_f1": 0.20229408737507323,
|
| 934 |
+
"macro_f1_reachable": 0.21419373957360696,
|
| 935 |
+
"micro_f1": 0.3723502304147465,
|
| 936 |
+
"micro_precision": 0.5159642401021711,
|
| 937 |
+
"micro_recall": 0.2912761355443403,
|
| 938 |
+
"mean_labels_pred": 0.8897727272727273,
|
| 939 |
+
"samples_exact_match": 0.14545454545454545
|
| 940 |
+
}
|
| 941 |
+
],
|
| 942 |
+
"tau_sweep_test": [
|
| 943 |
+
{
|
| 944 |
+
"tau": 0.0,
|
| 945 |
+
"macro_f1": 0.2190964942210551,
|
| 946 |
+
"macro_f1_reachable": 0.23198452329288186,
|
| 947 |
+
"micro_f1": 0.3372093023255814,
|
| 948 |
+
"micro_precision": 0.2746212121212121,
|
| 949 |
+
"micro_recall": 0.4367469879518072,
|
| 950 |
+
"mean_labels_pred": 2.5142857142857142,
|
| 951 |
+
"samples_exact_match": 0.02142857142857143
|
| 952 |
+
},
|
| 953 |
+
{
|
| 954 |
+
"tau": 0.3,
|
| 955 |
+
"macro_f1": 0.2190964942210551,
|
| 956 |
+
"macro_f1_reachable": 0.23198452329288186,
|
| 957 |
+
"micro_f1": 0.3372093023255814,
|
| 958 |
+
"micro_precision": 0.2746212121212121,
|
| 959 |
+
"micro_recall": 0.4367469879518072,
|
| 960 |
+
"mean_labels_pred": 2.5142857142857142,
|
| 961 |
+
"samples_exact_match": 0.02142857142857143
|
| 962 |
+
},
|
| 963 |
+
{
|
| 964 |
+
"tau": 0.5,
|
| 965 |
+
"macro_f1": 0.218758175132736,
|
| 966 |
+
"macro_f1_reachable": 0.23162630308172047,
|
| 967 |
+
"micro_f1": 0.33566433566433573,
|
| 968 |
+
"micro_precision": 0.2737642585551331,
|
| 969 |
+
"micro_recall": 0.43373493975903615,
|
| 970 |
+
"mean_labels_pred": 2.5047619047619047,
|
| 971 |
+
"samples_exact_match": 0.02142857142857143
|
| 972 |
+
},
|
| 973 |
+
{
|
| 974 |
+
"tau": 0.6,
|
| 975 |
+
"macro_f1": 0.21880644513582526,
|
| 976 |
+
"macro_f1_reachable": 0.23167741249675616,
|
| 977 |
+
"micro_f1": 0.33586005830903787,
|
| 978 |
+
"micro_precision": 0.27402473834443386,
|
| 979 |
+
"micro_recall": 0.43373493975903615,
|
| 980 |
+
"mean_labels_pred": 2.5023809523809524,
|
| 981 |
+
"samples_exact_match": 0.02142857142857143
|
| 982 |
+
},
|
| 983 |
+
{
|
| 984 |
+
"tau": 0.7,
|
| 985 |
+
"macro_f1": 0.21890368640112862,
|
| 986 |
+
"macro_f1_reachable": 0.2317803738364891,
|
| 987 |
+
"micro_f1": 0.33625218914185645,
|
| 988 |
+
"micro_precision": 0.27454718779790277,
|
| 989 |
+
"micro_recall": 0.43373493975903615,
|
| 990 |
+
"mean_labels_pred": 2.4976190476190476,
|
| 991 |
+
"samples_exact_match": 0.02142857142857143
|
| 992 |
+
},
|
| 993 |
+
{
|
| 994 |
+
"tau": 0.75,
|
| 995 |
+
"macro_f1": 0.21890368640112862,
|
| 996 |
+
"macro_f1_reachable": 0.2317803738364891,
|
| 997 |
+
"micro_f1": 0.33625218914185645,
|
| 998 |
+
"micro_precision": 0.27454718779790277,
|
| 999 |
+
"micro_recall": 0.43373493975903615,
|
| 1000 |
+
"mean_labels_pred": 2.4976190476190476,
|
| 1001 |
+
"samples_exact_match": 0.02142857142857143
|
| 1002 |
+
},
|
| 1003 |
+
{
|
| 1004 |
+
"tau": 0.8,
|
| 1005 |
+
"macro_f1": 0.21895266106751318,
|
| 1006 |
+
"macro_f1_reachable": 0.2318322293656022,
|
| 1007 |
+
"micro_f1": 0.3364485981308411,
|
| 1008 |
+
"micro_precision": 0.2748091603053435,
|
| 1009 |
+
"micro_recall": 0.43373493975903615,
|
| 1010 |
+
"mean_labels_pred": 2.4952380952380953,
|
| 1011 |
+
"samples_exact_match": 0.02142857142857143
|
| 1012 |
+
},
|
| 1013 |
+
{
|
| 1014 |
+
"tau": 0.85,
|
| 1015 |
+
"macro_f1": 0.21912464355656885,
|
| 1016 |
+
"macro_f1_reachable": 0.23201432847166115,
|
| 1017 |
+
"micro_f1": 0.33703920421299005,
|
| 1018 |
+
"micro_precision": 0.2755980861244019,
|
| 1019 |
+
"micro_recall": 0.43373493975903615,
|
| 1020 |
+
"mean_labels_pred": 2.488095238095238,
|
| 1021 |
+
"samples_exact_match": 0.02142857142857143
|
| 1022 |
+
},
|
| 1023 |
+
{
|
| 1024 |
+
"tau": 0.9,
|
| 1025 |
+
"macro_f1": 0.22177101051828485,
|
| 1026 |
+
"macro_f1_reachable": 0.23481636407818396,
|
| 1027 |
+
"micro_f1": 0.3445783132530121,
|
| 1028 |
+
"micro_precision": 0.28714859437751006,
|
| 1029 |
+
"micro_recall": 0.4307228915662651,
|
| 1030 |
+
"mean_labels_pred": 2.3714285714285714,
|
| 1031 |
+
"samples_exact_match": 0.030952380952380953
|
| 1032 |
+
},
|
| 1033 |
+
{
|
| 1034 |
+
"tau": 0.95,
|
| 1035 |
+
"macro_f1": 0.20738019412555356,
|
| 1036 |
+
"macro_f1_reachable": 0.21957902907411553,
|
| 1037 |
+
"micro_f1": 0.35010337698139216,
|
| 1038 |
+
"micro_precision": 0.3227445997458704,
|
| 1039 |
+
"micro_recall": 0.3825301204819277,
|
| 1040 |
+
"mean_labels_pred": 1.8738095238095238,
|
| 1041 |
+
"samples_exact_match": 0.07857142857142857
|
| 1042 |
+
},
|
| 1043 |
+
{
|
| 1044 |
+
"tau": 0.98,
|
| 1045 |
+
"macro_f1": 0.21970023812993705,
|
| 1046 |
+
"macro_f1_reachable": 0.23262378154934507,
|
| 1047 |
+
"micro_f1": 0.37953795379537947,
|
| 1048 |
+
"micro_precision": 0.4197080291970803,
|
| 1049 |
+
"micro_recall": 0.3463855421686747,
|
| 1050 |
+
"mean_labels_pred": 1.3047619047619048,
|
| 1051 |
+
"samples_exact_match": 0.14285714285714285
|
| 1052 |
+
},
|
| 1053 |
+
{
|
| 1054 |
+
"tau": 0.99,
|
| 1055 |
+
"macro_f1": 0.21283666617724373,
|
| 1056 |
+
"macro_f1_reachable": 0.22535647007002277,
|
| 1057 |
+
"micro_f1": 0.37247706422018345,
|
| 1058 |
+
"micro_precision": 0.4765258215962441,
|
| 1059 |
+
"micro_recall": 0.3057228915662651,
|
| 1060 |
+
"mean_labels_pred": 1.0142857142857142,
|
| 1061 |
+
"samples_exact_match": 0.1595238095238095
|
| 1062 |
+
}
|
| 1063 |
+
],
|
| 1064 |
+
"parse_success_rate_test": 1.0,
|
| 1065 |
+
"uffr_test": 1.0
|
| 1066 |
+
},
|
| 1067 |
+
"LoRA_r512": {
|
| 1068 |
+
"method": "lora",
|
| 1069 |
+
"rank": 512,
|
| 1070 |
+
"candidates": {
|
| 1071 |
+
"step_000750": {
|
| 1072 |
+
"adapter_dir": "/work/FAC/HEC/DESI/yshresth/ai_health/checkpoints/qwen3_vl_8b_unified/LoRA_r512/step_000750/adapter",
|
| 1073 |
+
"adapter_bytes": 2793490268,
|
| 1074 |
+
"checkpoint_bytes": 8380757374,
|
| 1075 |
+
"in_domain": {
|
| 1076 |
+
"per_field_macro_f1": {
|
| 1077 |
+
"instrument_present": 1.0,
|
| 1078 |
+
"abnormality_present": 0.22985097078511643,
|
| 1079 |
+
"abnormality_type": 0.26935575574089415,
|
| 1080 |
+
"tract": 0.9818271604938272,
|
| 1081 |
+
"landmark": 0.8920155853076488,
|
| 1082 |
+
"procedure": 0.7562271062271062,
|
| 1083 |
+
"grade": 0.3539059918370263,
|
| 1084 |
+
"prep_quality": 0.799719887955182
|
| 1085 |
+
},
|
| 1086 |
+
"mean_macro_f1": 0.6603628072933502,
|
| 1087 |
+
"schema_valid_rate": 1.0,
|
| 1088 |
+
"n": 600
|
| 1089 |
+
}
|
| 1090 |
+
},
|
| 1091 |
+
"step_001000": {
|
| 1092 |
+
"adapter_dir": "/work/FAC/HEC/DESI/yshresth/ai_health/checkpoints/qwen3_vl_8b_unified/LoRA_r512/step_001000/adapter",
|
| 1093 |
+
"adapter_bytes": 2793490268,
|
| 1094 |
+
"checkpoint_bytes": 8380757379,
|
| 1095 |
+
"in_domain": {
|
| 1096 |
+
"per_field_macro_f1": {
|
| 1097 |
+
"instrument_present": 1.0,
|
| 1098 |
+
"abnormality_present": 0.21614853195164077,
|
| 1099 |
+
"abnormality_type": 0.379834221259591,
|
| 1100 |
+
"tract": 0.9779019197525248,
|
| 1101 |
+
"landmark": 0.8848120562032544,
|
| 1102 |
+
"procedure": 0.7347591386492988,
|
| 1103 |
+
"grade": 0.3692934029943834,
|
| 1104 |
+
"prep_quality": 0.8551724137931035
|
| 1105 |
+
},
|
| 1106 |
+
"mean_macro_f1": 0.6772402105754746,
|
| 1107 |
+
"schema_valid_rate": 1.0,
|
| 1108 |
+
"n": 600
|
| 1109 |
+
}
|
| 1110 |
+
},
|
| 1111 |
+
"final": {
|
| 1112 |
+
"adapter_dir": "/work/FAC/HEC/DESI/yshresth/ai_health/checkpoints/qwen3_vl_8b_unified/LoRA_r512/final/adapter",
|
| 1113 |
+
"adapter_bytes": 2793490268,
|
| 1114 |
+
"checkpoint_bytes": 8380757379,
|
| 1115 |
+
"in_domain": {
|
| 1116 |
+
"per_field_macro_f1": {
|
| 1117 |
+
"instrument_present": 1.0,
|
| 1118 |
+
"abnormality_present": 0.21614853195164077,
|
| 1119 |
+
"abnormality_type": 0.37411757832810466,
|
| 1120 |
+
"tract": 0.9797817009742875,
|
| 1121 |
+
"landmark": 0.878559911618619,
|
| 1122 |
+
"procedure": 0.5636647749060512,
|
| 1123 |
+
"grade": 0.37894549582389875,
|
| 1124 |
+
"prep_quality": 0.8444444444444444
|
| 1125 |
+
},
|
| 1126 |
+
"mean_macro_f1": 0.6544578047558808,
|
| 1127 |
+
"schema_valid_rate": 1.0,
|
| 1128 |
+
"n": 600
|
| 1129 |
+
}
|
| 1130 |
+
}
|
| 1131 |
+
},
|
| 1132 |
+
"selected": "step_001000",
|
| 1133 |
+
"selection_criterion": "max mean per-field macro-F1 on a stratified in-domain validation subset (n=600); ties broken toward the later step",
|
| 1134 |
+
"profiling": {
|
| 1135 |
+
"adapter_bytes_on_disk": 2793490268,
|
| 1136 |
+
"checkpoint_bytes_on_disk": 8380757379,
|
| 1137 |
+
"final_adapter_bytes_on_disk": 2793490268,
|
| 1138 |
+
"load_seconds": 27.928910493850708,
|
| 1139 |
+
"weights_vram_bytes": -512,
|
| 1140 |
+
"trainable_parameters": 1396703232,
|
| 1141 |
+
"total_parameters": 10163826928,
|
| 1142 |
+
"trainable_percentage": 13.741902945555548,
|
| 1143 |
+
"peak_vram_bytes_inference": 25453545984,
|
| 1144 |
+
"peak_vram_reserved_bytes": 43610275840,
|
| 1145 |
+
"sage_test_wall_seconds": 148.71586418151855,
|
| 1146 |
+
"images_per_second": 2.824177516713075,
|
| 1147 |
+
"latency_mean_s": 0.34654191500185766,
|
| 1148 |
+
"latency_p50_s": 0.33875724094104953,
|
| 1149 |
+
"latency_p90_s": 0.34844915942812804,
|
| 1150 |
+
"latency_p99_s": 0.3596106619370403,
|
| 1151 |
+
"gen_tokens_mean": 69.37380952380953,
|
| 1152 |
+
"tokens_per_second": 195.92395310587824,
|
| 1153 |
+
"weights": {
|
| 1154 |
+
"baseline_bytes": 1244659712,
|
| 1155 |
+
"resident_after_load_bytes": 21572385280,
|
| 1156 |
+
"weights_vram_bytes": 20327725568,
|
| 1157 |
+
"weights_vram_gib": 18.93166971206665,
|
| 1158 |
+
"param_bytes": 20327653856,
|
| 1159 |
+
"buffer_bytes": 584,
|
| 1160 |
+
"param_dtype_counts": {
|
| 1161 |
+
"torch.bfloat16": 10163826928
|
| 1162 |
+
},
|
| 1163 |
+
"load_seconds": 27.831176280975342,
|
| 1164 |
+
"adapter_bytes_on_disk": 2793490268,
|
| 1165 |
+
"adapter_gib_on_disk": 2.601640548557043,
|
| 1166 |
+
"trainable_parameters": 1396703232,
|
| 1167 |
+
"total_parameters": 10163826928
|
| 1168 |
+
}
|
| 1169 |
+
},
|
| 1170 |
+
"sage_raw": {
|
| 1171 |
+
"tau": 0.0,
|
| 1172 |
+
"n_images": 420,
|
| 1173 |
+
"macro_f1": 0.2049503618207934,
|
| 1174 |
+
"macro_f1_reachable": 0.21700626545731067,
|
| 1175 |
+
"micro_f1": 0.3220433092726263,
|
| 1176 |
+
"micro_precision": 0.25505716798592787,
|
| 1177 |
+
"micro_recall": 0.4367469879518072,
|
| 1178 |
+
"samples_exact_match": 0.011904761904761904,
|
| 1179 |
+
"map_macro": 0.23376678445060783,
|
| 1180 |
+
"map_weighted": 0.36361819336081647,
|
| 1181 |
+
"map_micro": 0.2867255849471246,
|
| 1182 |
+
"mean_labels_gold": 1.5809523809523809,
|
| 1183 |
+
"mean_labels_pred": 2.7071428571428573,
|
| 1184 |
+
"per_label": {
|
| 1185 |
+
"blood": {
|
| 1186 |
+
"support": 13,
|
| 1187 |
+
"tp": 1,
|
| 1188 |
+
"fp": 0,
|
| 1189 |
+
"fn": 12,
|
| 1190 |
+
"precision": 1.0,
|
| 1191 |
+
"recall": 0.07692307692307693,
|
| 1192 |
+
"f1": 0.14285714285714288,
|
| 1193 |
+
"ap": 0.10549450549450551,
|
| 1194 |
+
"n_predicted": 1,
|
| 1195 |
+
"reachable": true
|
| 1196 |
+
},
|
| 1197 |
+
"colon": {
|
| 1198 |
+
"support": 49,
|
| 1199 |
+
"tp": 42,
|
| 1200 |
+
"fp": 144,
|
| 1201 |
+
"fn": 7,
|
| 1202 |
+
"precision": 0.22580645161290322,
|
| 1203 |
+
"recall": 0.8571428571428571,
|
| 1204 |
+
"f1": 0.3574468085106383,
|
| 1205 |
+
"ap": 0.4023740999576936,
|
| 1206 |
+
"n_predicted": 186,
|
| 1207 |
+
"reachable": true
|
| 1208 |
+
},
|
| 1209 |
+
"diverticulum": {
|
| 1210 |
+
"support": 6,
|
| 1211 |
+
"tp": 0,
|
| 1212 |
+
"fp": 1,
|
| 1213 |
+
"fn": 6,
|
| 1214 |
+
"precision": 0.0,
|
| 1215 |
+
"recall": 0.0,
|
| 1216 |
+
"f1": 0.0,
|
| 1217 |
+
"ap": 0.014285714285714285,
|
| 1218 |
+
"n_predicted": 1,
|
| 1219 |
+
"reachable": true
|
| 1220 |
+
},
|
| 1221 |
+
"duodenum": {
|
| 1222 |
+
"support": 15,
|
| 1223 |
+
"tp": 0,
|
| 1224 |
+
"fp": 1,
|
| 1225 |
+
"fn": 15,
|
| 1226 |
+
"precision": 0.0,
|
| 1227 |
+
"recall": 0.0,
|
| 1228 |
+
"f1": 0.0,
|
| 1229 |
+
"ap": 0.03571428571428571,
|
| 1230 |
+
"n_predicted": 1,
|
| 1231 |
+
"reachable": true
|
| 1232 |
+
},
|
| 1233 |
+
"esophagitis": {
|
| 1234 |
+
"support": 15,
|
| 1235 |
+
"tp": 0,
|
| 1236 |
+
"fp": 1,
|
| 1237 |
+
"fn": 15,
|
| 1238 |
+
"precision": 0.0,
|
| 1239 |
+
"recall": 0.0,
|
| 1240 |
+
"f1": 0.0,
|
| 1241 |
+
"ap": 0.03571428571428571,
|
| 1242 |
+
"n_predicted": 1,
|
| 1243 |
+
"reachable": true
|
| 1244 |
+
},
|
| 1245 |
+
"esophagus": {
|
| 1246 |
+
"support": 73,
|
| 1247 |
+
"tp": 12,
|
| 1248 |
+
"fp": 0,
|
| 1249 |
+
"fn": 61,
|
| 1250 |
+
"precision": 1.0,
|
| 1251 |
+
"recall": 0.1643835616438356,
|
| 1252 |
+
"f1": 0.2823529411764706,
|
| 1253 |
+
"ap": 0.30962165688193083,
|
| 1254 |
+
"n_predicted": 12,
|
| 1255 |
+
"reachable": true
|
| 1256 |
+
},
|
| 1257 |
+
"foreign-body": {
|
| 1258 |
+
"support": 9,
|
| 1259 |
+
"tp": 0,
|
| 1260 |
+
"fp": 0,
|
| 1261 |
+
"fn": 9,
|
| 1262 |
+
"precision": 0.0,
|
| 1263 |
+
"recall": 0.0,
|
| 1264 |
+
"f1": 0.0,
|
| 1265 |
+
"ap": 0.02142857142857143,
|
| 1266 |
+
"n_predicted": 0,
|
| 1267 |
+
"reachable": false
|
| 1268 |
+
},
|
| 1269 |
+
"fundus": {
|
| 1270 |
+
"support": 16,
|
| 1271 |
+
"tp": 0,
|
| 1272 |
+
"fp": 0,
|
| 1273 |
+
"fn": 16,
|
| 1274 |
+
"precision": 0.0,
|
| 1275 |
+
"recall": 0.0,
|
| 1276 |
+
"f1": 0.0,
|
| 1277 |
+
"ap": 0.0380952380952381,
|
| 1278 |
+
"n_predicted": 0,
|
| 1279 |
+
"reachable": true
|
| 1280 |
+
},
|
| 1281 |
+
"gej": {
|
| 1282 |
+
"support": 27,
|
| 1283 |
+
"tp": 10,
|
| 1284 |
+
"fp": 13,
|
| 1285 |
+
"fn": 17,
|
| 1286 |
+
"precision": 0.43478260869565216,
|
| 1287 |
+
"recall": 0.37037037037037035,
|
| 1288 |
+
"f1": 0.39999999999999997,
|
| 1289 |
+
"ap": 0.2657651837390399,
|
| 1290 |
+
"n_predicted": 23,
|
| 1291 |
+
"reachable": true
|
| 1292 |
+
},
|
| 1293 |
+
"growth": {
|
| 1294 |
+
"support": 11,
|
| 1295 |
+
"tp": 0,
|
| 1296 |
+
"fp": 1,
|
| 1297 |
+
"fn": 11,
|
| 1298 |
+
"precision": 0.0,
|
| 1299 |
+
"recall": 0.0,
|
| 1300 |
+
"f1": 0.0,
|
| 1301 |
+
"ap": 0.02619047619047619,
|
| 1302 |
+
"n_predicted": 1,
|
| 1303 |
+
"reachable": true
|
| 1304 |
+
},
|
| 1305 |
+
"inflammation": {
|
| 1306 |
+
"support": 40,
|
| 1307 |
+
"tp": 14,
|
| 1308 |
+
"fp": 45,
|
| 1309 |
+
"fn": 26,
|
| 1310 |
+
"precision": 0.23728813559322035,
|
| 1311 |
+
"recall": 0.35,
|
| 1312 |
+
"f1": 0.2828282828282828,
|
| 1313 |
+
"ap": 0.17650123047652444,
|
| 1314 |
+
"n_predicted": 59,
|
| 1315 |
+
"reachable": true
|
| 1316 |
+
},
|
| 1317 |
+
"instrument": {
|
| 1318 |
+
"support": 79,
|
| 1319 |
+
"tp": 78,
|
| 1320 |
+
"fp": 300,
|
| 1321 |
+
"fn": 1,
|
| 1322 |
+
"precision": 0.20634920634920634,
|
| 1323 |
+
"recall": 0.9873417721518988,
|
| 1324 |
+
"f1": 0.3413566739606127,
|
| 1325 |
+
"ap": 0.6566970824515012,
|
| 1326 |
+
"n_predicted": 378,
|
| 1327 |
+
"reachable": true
|
| 1328 |
+
},
|
| 1329 |
+
"polyp": {
|
| 1330 |
+
"support": 58,
|
| 1331 |
+
"tp": 56,
|
| 1332 |
+
"fp": 260,
|
| 1333 |
+
"fn": 2,
|
| 1334 |
+
"precision": 0.17721518987341772,
|
| 1335 |
+
"recall": 0.9655172413793104,
|
| 1336 |
+
"f1": 0.29946524064171126,
|
| 1337 |
+
"ap": 0.6623946504927503,
|
| 1338 |
+
"n_predicted": 316,
|
| 1339 |
+
"reachable": true
|
| 1340 |
+
},
|
| 1341 |
+
"pylorus": {
|
| 1342 |
+
"support": 84,
|
| 1343 |
+
"tp": 25,
|
| 1344 |
+
"fp": 1,
|
| 1345 |
+
"fn": 59,
|
| 1346 |
+
"precision": 0.9615384615384616,
|
| 1347 |
+
"recall": 0.2976190476190476,
|
| 1348 |
+
"f1": 0.45454545454545453,
|
| 1349 |
+
"ap": 0.4376373626373627,
|
| 1350 |
+
"n_predicted": 26,
|
| 1351 |
+
"reachable": true
|
| 1352 |
+
},
|
| 1353 |
+
"rectum": {
|
| 1354 |
+
"support": 11,
|
| 1355 |
+
"tp": 2,
|
| 1356 |
+
"fp": 8,
|
| 1357 |
+
"fn": 9,
|
| 1358 |
+
"precision": 0.2,
|
| 1359 |
+
"recall": 0.18181818181818182,
|
| 1360 |
+
"f1": 0.1904761904761905,
|
| 1361 |
+
"ap": 0.13506493506493505,
|
| 1362 |
+
"n_predicted": 10,
|
| 1363 |
+
"reachable": true
|
| 1364 |
+
},
|
| 1365 |
+
"stomach": {
|
| 1366 |
+
"support": 126,
|
| 1367 |
+
"tp": 38,
|
| 1368 |
+
"fp": 61,
|
| 1369 |
+
"fn": 88,
|
| 1370 |
+
"precision": 0.3838383838383838,
|
| 1371 |
+
"recall": 0.30158730158730157,
|
| 1372 |
+
"f1": 0.3377777777777778,
|
| 1373 |
+
"ap": 0.34636000017316637,
|
| 1374 |
+
"n_predicted": 99,
|
| 1375 |
+
"reachable": true
|
| 1376 |
+
},
|
| 1377 |
+
"ulcer": {
|
| 1378 |
+
"support": 15,
|
| 1379 |
+
"tp": 0,
|
| 1380 |
+
"fp": 0,
|
| 1381 |
+
"fn": 15,
|
| 1382 |
+
"precision": 0.0,
|
| 1383 |
+
"recall": 0.0,
|
| 1384 |
+
"f1": 0.0,
|
| 1385 |
+
"ap": 0.03571428571428571,
|
| 1386 |
+
"n_predicted": 0,
|
| 1387 |
+
"reachable": true
|
| 1388 |
+
},
|
| 1389 |
+
"z-line": {
|
| 1390 |
+
"support": 17,
|
| 1391 |
+
"tp": 12,
|
| 1392 |
+
"fp": 11,
|
| 1393 |
+
"fn": 5,
|
| 1394 |
+
"precision": 0.5217391304347826,
|
| 1395 |
+
"recall": 0.7058823529411765,
|
| 1396 |
+
"f1": 0.6,
|
| 1397 |
+
"ap": 0.5027485555986739,
|
| 1398 |
+
"n_predicted": 23,
|
| 1399 |
+
"reachable": true
|
| 1400 |
+
}
|
| 1401 |
+
}
|
| 1402 |
+
},
|
| 1403 |
+
"sage_calibrated": {
|
| 1404 |
+
"tau": 0.9,
|
| 1405 |
+
"n_images": 420,
|
| 1406 |
+
"macro_f1": 0.19732567058150718,
|
| 1407 |
+
"macro_f1_reachable": 0.20893306296865466,
|
| 1408 |
+
"micro_f1": 0.3227299016772701,
|
| 1409 |
+
"micro_precision": 0.2619718309859155,
|
| 1410 |
+
"micro_recall": 0.42018072289156627,
|
| 1411 |
+
"samples_exact_match": 0.014285714285714285,
|
| 1412 |
+
"map_macro": 0.23376678445060783,
|
| 1413 |
+
"map_weighted": 0.36361819336081647,
|
| 1414 |
+
"map_micro": 0.2867255849471246,
|
| 1415 |
+
"mean_labels_gold": 1.5809523809523809,
|
| 1416 |
+
"mean_labels_pred": 2.5357142857142856,
|
| 1417 |
+
"per_label": {
|
| 1418 |
+
"blood": {
|
| 1419 |
+
"support": 13,
|
| 1420 |
+
"tp": 0,
|
| 1421 |
+
"fp": 0,
|
| 1422 |
+
"fn": 13,
|
| 1423 |
+
"precision": 0.0,
|
| 1424 |
+
"recall": 0.0,
|
| 1425 |
+
"f1": 0.0,
|
| 1426 |
+
"ap": 0.10549450549450551,
|
| 1427 |
+
"n_predicted": 0,
|
| 1428 |
+
"reachable": true
|
| 1429 |
+
},
|
| 1430 |
+
"colon": {
|
| 1431 |
+
"support": 49,
|
| 1432 |
+
"tp": 42,
|
| 1433 |
+
"fp": 143,
|
| 1434 |
+
"fn": 7,
|
| 1435 |
+
"precision": 0.22702702702702704,
|
| 1436 |
+
"recall": 0.8571428571428571,
|
| 1437 |
+
"f1": 0.35897435897435903,
|
| 1438 |
+
"ap": 0.4023740999576936,
|
| 1439 |
+
"n_predicted": 185,
|
| 1440 |
+
"reachable": true
|
| 1441 |
+
},
|
| 1442 |
+
"diverticulum": {
|
| 1443 |
+
"support": 6,
|
| 1444 |
+
"tp": 0,
|
| 1445 |
+
"fp": 1,
|
| 1446 |
+
"fn": 6,
|
| 1447 |
+
"precision": 0.0,
|
| 1448 |
+
"recall": 0.0,
|
| 1449 |
+
"f1": 0.0,
|
| 1450 |
+
"ap": 0.014285714285714285,
|
| 1451 |
+
"n_predicted": 1,
|
| 1452 |
+
"reachable": true
|
| 1453 |
+
},
|
| 1454 |
+
"duodenum": {
|
| 1455 |
+
"support": 15,
|
| 1456 |
+
"tp": 0,
|
| 1457 |
+
"fp": 1,
|
| 1458 |
+
"fn": 15,
|
| 1459 |
+
"precision": 0.0,
|
| 1460 |
+
"recall": 0.0,
|
| 1461 |
+
"f1": 0.0,
|
| 1462 |
+
"ap": 0.03571428571428571,
|
| 1463 |
+
"n_predicted": 1,
|
| 1464 |
+
"reachable": true
|
| 1465 |
+
},
|
| 1466 |
+
"esophagitis": {
|
| 1467 |
+
"support": 15,
|
| 1468 |
+
"tp": 0,
|
| 1469 |
+
"fp": 1,
|
| 1470 |
+
"fn": 15,
|
| 1471 |
+
"precision": 0.0,
|
| 1472 |
+
"recall": 0.0,
|
| 1473 |
+
"f1": 0.0,
|
| 1474 |
+
"ap": 0.03571428571428571,
|
| 1475 |
+
"n_predicted": 1,
|
| 1476 |
+
"reachable": true
|
| 1477 |
+
},
|
| 1478 |
+
"esophagus": {
|
| 1479 |
+
"support": 73,
|
| 1480 |
+
"tp": 12,
|
| 1481 |
+
"fp": 0,
|
| 1482 |
+
"fn": 61,
|
| 1483 |
+
"precision": 1.0,
|
| 1484 |
+
"recall": 0.1643835616438356,
|
| 1485 |
+
"f1": 0.2823529411764706,
|
| 1486 |
+
"ap": 0.30962165688193083,
|
| 1487 |
+
"n_predicted": 12,
|
| 1488 |
+
"reachable": true
|
| 1489 |
+
},
|
| 1490 |
+
"foreign-body": {
|
| 1491 |
+
"support": 9,
|
| 1492 |
+
"tp": 0,
|
| 1493 |
+
"fp": 0,
|
| 1494 |
+
"fn": 9,
|
| 1495 |
+
"precision": 0.0,
|
| 1496 |
+
"recall": 0.0,
|
| 1497 |
+
"f1": 0.0,
|
| 1498 |
+
"ap": 0.02142857142857143,
|
| 1499 |
+
"n_predicted": 0,
|
| 1500 |
+
"reachable": false
|
| 1501 |
+
},
|
| 1502 |
+
"fundus": {
|
| 1503 |
+
"support": 16,
|
| 1504 |
+
"tp": 0,
|
| 1505 |
+
"fp": 0,
|
| 1506 |
+
"fn": 16,
|
| 1507 |
+
"precision": 0.0,
|
| 1508 |
+
"recall": 0.0,
|
| 1509 |
+
"f1": 0.0,
|
| 1510 |
+
"ap": 0.0380952380952381,
|
| 1511 |
+
"n_predicted": 0,
|
| 1512 |
+
"reachable": true
|
| 1513 |
+
},
|
| 1514 |
+
"gej": {
|
| 1515 |
+
"support": 27,
|
| 1516 |
+
"tp": 10,
|
| 1517 |
+
"fp": 13,
|
| 1518 |
+
"fn": 17,
|
| 1519 |
+
"precision": 0.43478260869565216,
|
| 1520 |
+
"recall": 0.37037037037037035,
|
| 1521 |
+
"f1": 0.39999999999999997,
|
| 1522 |
+
"ap": 0.2657651837390399,
|
| 1523 |
+
"n_predicted": 23,
|
| 1524 |
+
"reachable": true
|
| 1525 |
+
},
|
| 1526 |
+
"growth": {
|
| 1527 |
+
"support": 11,
|
| 1528 |
+
"tp": 0,
|
| 1529 |
+
"fp": 1,
|
| 1530 |
+
"fn": 11,
|
| 1531 |
+
"precision": 0.0,
|
| 1532 |
+
"recall": 0.0,
|
| 1533 |
+
"f1": 0.0,
|
| 1534 |
+
"ap": 0.02619047619047619,
|
| 1535 |
+
"n_predicted": 1,
|
| 1536 |
+
"reachable": true
|
| 1537 |
+
},
|
| 1538 |
+
"inflammation": {
|
| 1539 |
+
"support": 40,
|
| 1540 |
+
"tp": 14,
|
| 1541 |
+
"fp": 45,
|
| 1542 |
+
"fn": 26,
|
| 1543 |
+
"precision": 0.23728813559322035,
|
| 1544 |
+
"recall": 0.35,
|
| 1545 |
+
"f1": 0.2828282828282828,
|
| 1546 |
+
"ap": 0.17650123047652444,
|
| 1547 |
+
"n_predicted": 59,
|
| 1548 |
+
"reachable": true
|
| 1549 |
+
},
|
| 1550 |
+
"instrument": {
|
| 1551 |
+
"support": 79,
|
| 1552 |
+
"tp": 72,
|
| 1553 |
+
"fp": 273,
|
| 1554 |
+
"fn": 7,
|
| 1555 |
+
"precision": 0.20869565217391303,
|
| 1556 |
+
"recall": 0.9113924050632911,
|
| 1557 |
+
"f1": 0.339622641509434,
|
| 1558 |
+
"ap": 0.6566970824515012,
|
| 1559 |
+
"n_predicted": 345,
|
| 1560 |
+
"reachable": true
|
| 1561 |
+
},
|
| 1562 |
+
"polyp": {
|
| 1563 |
+
"support": 58,
|
| 1564 |
+
"tp": 54,
|
| 1565 |
+
"fp": 230,
|
| 1566 |
+
"fn": 4,
|
| 1567 |
+
"precision": 0.19014084507042253,
|
| 1568 |
+
"recall": 0.9310344827586207,
|
| 1569 |
+
"f1": 0.3157894736842105,
|
| 1570 |
+
"ap": 0.6623946504927503,
|
| 1571 |
+
"n_predicted": 284,
|
| 1572 |
+
"reachable": true
|
| 1573 |
+
},
|
| 1574 |
+
"pylorus": {
|
| 1575 |
+
"support": 84,
|
| 1576 |
+
"tp": 25,
|
| 1577 |
+
"fp": 1,
|
| 1578 |
+
"fn": 59,
|
| 1579 |
+
"precision": 0.9615384615384616,
|
| 1580 |
+
"recall": 0.2976190476190476,
|
| 1581 |
+
"f1": 0.45454545454545453,
|
| 1582 |
+
"ap": 0.4376373626373627,
|
| 1583 |
+
"n_predicted": 26,
|
| 1584 |
+
"reachable": true
|
| 1585 |
+
},
|
| 1586 |
+
"rectum": {
|
| 1587 |
+
"support": 11,
|
| 1588 |
+
"tp": 2,
|
| 1589 |
+
"fp": 8,
|
| 1590 |
+
"fn": 9,
|
| 1591 |
+
"precision": 0.2,
|
| 1592 |
+
"recall": 0.18181818181818182,
|
| 1593 |
+
"f1": 0.1904761904761905,
|
| 1594 |
+
"ap": 0.13506493506493505,
|
| 1595 |
+
"n_predicted": 10,
|
| 1596 |
+
"reachable": true
|
| 1597 |
+
},
|
| 1598 |
+
"stomach": {
|
| 1599 |
+
"support": 126,
|
| 1600 |
+
"tp": 36,
|
| 1601 |
+
"fp": 58,
|
| 1602 |
+
"fn": 90,
|
| 1603 |
+
"precision": 0.3829787234042553,
|
| 1604 |
+
"recall": 0.2857142857142857,
|
| 1605 |
+
"f1": 0.32727272727272727,
|
| 1606 |
+
"ap": 0.34636000017316637,
|
| 1607 |
+
"n_predicted": 94,
|
| 1608 |
+
"reachable": true
|
| 1609 |
+
},
|
| 1610 |
+
"ulcer": {
|
| 1611 |
+
"support": 15,
|
| 1612 |
+
"tp": 0,
|
| 1613 |
+
"fp": 0,
|
| 1614 |
+
"fn": 15,
|
| 1615 |
+
"precision": 0.0,
|
| 1616 |
+
"recall": 0.0,
|
| 1617 |
+
"f1": 0.0,
|
| 1618 |
+
"ap": 0.03571428571428571,
|
| 1619 |
+
"n_predicted": 0,
|
| 1620 |
+
"reachable": true
|
| 1621 |
+
},
|
| 1622 |
+
"z-line": {
|
| 1623 |
+
"support": 17,
|
| 1624 |
+
"tp": 12,
|
| 1625 |
+
"fp": 11,
|
| 1626 |
+
"fn": 5,
|
| 1627 |
+
"precision": 0.5217391304347826,
|
| 1628 |
+
"recall": 0.7058823529411765,
|
| 1629 |
+
"f1": 0.6,
|
| 1630 |
+
"ap": 0.5027485555986739,
|
| 1631 |
+
"n_predicted": 23,
|
| 1632 |
+
"reachable": true
|
| 1633 |
+
}
|
| 1634 |
+
}
|
| 1635 |
+
},
|
| 1636 |
+
"tau_star": 0.9,
|
| 1637 |
+
"tau_sweep_train": [
|
| 1638 |
+
{
|
| 1639 |
+
"tau": 0.0,
|
| 1640 |
+
"macro_f1": 0.1914064614414529,
|
| 1641 |
+
"macro_f1_reachable": 0.20266566505565603,
|
| 1642 |
+
"micro_f1": 0.3054347826086956,
|
| 1643 |
+
"micro_precision": 0.24509376362843435,
|
| 1644 |
+
"micro_recall": 0.40519105984138426,
|
| 1645 |
+
"mean_labels_pred": 2.605681818181818,
|
| 1646 |
+
"samples_exact_match": 0.007954545454545454
|
| 1647 |
+
},
|
| 1648 |
+
{
|
| 1649 |
+
"tau": 0.3,
|
| 1650 |
+
"macro_f1": 0.1914064614414529,
|
| 1651 |
+
"macro_f1_reachable": 0.20266566505565603,
|
| 1652 |
+
"micro_f1": 0.3054347826086956,
|
| 1653 |
+
"micro_precision": 0.24509376362843435,
|
| 1654 |
+
"micro_recall": 0.40519105984138426,
|
| 1655 |
+
"mean_labels_pred": 2.605681818181818,
|
| 1656 |
+
"samples_exact_match": 0.007954545454545454
|
| 1657 |
+
},
|
| 1658 |
+
{
|
| 1659 |
+
"tau": 0.5,
|
| 1660 |
+
"macro_f1": 0.19161384005062326,
|
| 1661 |
+
"macro_f1_reachable": 0.2028852424065423,
|
| 1662 |
+
"micro_f1": 0.30626702997275207,
|
| 1663 |
+
"micro_precision": 0.24616732369689007,
|
| 1664 |
+
"micro_recall": 0.40519105984138426,
|
| 1665 |
+
"mean_labels_pred": 2.5943181818181817,
|
| 1666 |
+
"samples_exact_match": 0.010227272727272727
|
| 1667 |
+
},
|
| 1668 |
+
{
|
| 1669 |
+
"tau": 0.6,
|
| 1670 |
+
"macro_f1": 0.19168214753496648,
|
| 1671 |
+
"macro_f1_reachable": 0.2029575679781998,
|
| 1672 |
+
"micro_f1": 0.3064736410816717,
|
| 1673 |
+
"micro_precision": 0.24670184696569922,
|
| 1674 |
+
"micro_recall": 0.40447007930785867,
|
| 1675 |
+
"mean_labels_pred": 2.584090909090909,
|
| 1676 |
+
"samples_exact_match": 0.011363636363636364
|
| 1677 |
+
},
|
| 1678 |
+
{
|
| 1679 |
+
"tau": 0.7,
|
| 1680 |
+
"macro_f1": 0.1918104733981914,
|
| 1681 |
+
"macro_f1_reachable": 0.20309344242161442,
|
| 1682 |
+
"micro_f1": 0.3069767441860465,
|
| 1683 |
+
"micro_precision": 0.24735449735449735,
|
| 1684 |
+
"micro_recall": 0.40447007930785867,
|
| 1685 |
+
"mean_labels_pred": 2.577272727272727,
|
| 1686 |
+
"samples_exact_match": 0.0125
|
| 1687 |
+
},
|
| 1688 |
+
{
|
| 1689 |
+
"tau": 0.75,
|
| 1690 |
+
"macro_f1": 0.1918320270215601,
|
| 1691 |
+
"macro_f1_reachable": 0.20311626390518128,
|
| 1692 |
+
"micro_f1": 0.3070607553366174,
|
| 1693 |
+
"micro_precision": 0.2474636082928981,
|
| 1694 |
+
"micro_recall": 0.40447007930785867,
|
| 1695 |
+
"mean_labels_pred": 2.5761363636363637,
|
| 1696 |
+
"samples_exact_match": 0.0125
|
| 1697 |
+
},
|
| 1698 |
+
{
|
| 1699 |
+
"tau": 0.8,
|
| 1700 |
+
"macro_f1": 0.19187527795912002,
|
| 1701 |
+
"macro_f1_reachable": 0.20316205901553883,
|
| 1702 |
+
"micro_f1": 0.3072289156626506,
|
| 1703 |
+
"micro_precision": 0.247682119205298,
|
| 1704 |
+
"micro_recall": 0.40447007930785867,
|
| 1705 |
+
"mean_labels_pred": 2.5738636363636362,
|
| 1706 |
+
"samples_exact_match": 0.0125
|
| 1707 |
+
},
|
| 1708 |
+
{
|
| 1709 |
+
"tau": 0.85,
|
| 1710 |
+
"macro_f1": 0.19195883943605183,
|
| 1711 |
+
"macro_f1_reachable": 0.20325053587346664,
|
| 1712 |
+
"micro_f1": 0.3075657894736842,
|
| 1713 |
+
"micro_precision": 0.24812030075187969,
|
| 1714 |
+
"micro_recall": 0.40447007930785867,
|
| 1715 |
+
"mean_labels_pred": 2.569318181818182,
|
| 1716 |
+
"samples_exact_match": 0.013636363636363636
|
| 1717 |
+
},
|
| 1718 |
+
{
|
| 1719 |
+
"tau": 0.9,
|
| 1720 |
+
"macro_f1": 0.19239727178103283,
|
| 1721 |
+
"macro_f1_reachable": 0.20371475835638772,
|
| 1722 |
+
"micro_f1": 0.30992196209587514,
|
| 1723 |
+
"micro_precision": 0.2526124488868696,
|
| 1724 |
+
"micro_recall": 0.4008651766402307,
|
| 1725 |
+
"mean_labels_pred": 2.5011363636363635,
|
| 1726 |
+
"samples_exact_match": 0.019318181818181818
|
| 1727 |
+
},
|
| 1728 |
+
{
|
| 1729 |
+
"tau": 0.95,
|
| 1730 |
+
"macro_f1": 0.1833202288791553,
|
| 1731 |
+
"macro_f1_reachable": 0.19410377175439975,
|
| 1732 |
+
"micro_f1": 0.3195876288659794,
|
| 1733 |
+
"micro_precision": 0.2888759464181712,
|
| 1734 |
+
"micro_recall": 0.357606344628695,
|
| 1735 |
+
"mean_labels_pred": 1.9511363636363637,
|
| 1736 |
+
"samples_exact_match": 0.04659090909090909
|
| 1737 |
+
},
|
| 1738 |
+
{
|
| 1739 |
+
"tau": 0.98,
|
| 1740 |
+
"macro_f1": 0.18143944689448113,
|
| 1741 |
+
"macro_f1_reachable": 0.19211235553533296,
|
| 1742 |
+
"micro_f1": 0.3333333333333333,
|
| 1743 |
+
"micro_precision": 0.3644140290846878,
|
| 1744 |
+
"micro_recall": 0.30713770728190337,
|
| 1745 |
+
"mean_labels_pred": 1.3284090909090909,
|
| 1746 |
+
"samples_exact_match": 0.10113636363636364
|
| 1747 |
+
},
|
| 1748 |
+
{
|
| 1749 |
+
"tau": 0.99,
|
| 1750 |
+
"macro_f1": 0.17938976607135357,
|
| 1751 |
+
"macro_f1_reachable": 0.18994210525202143,
|
| 1752 |
+
"micro_f1": 0.33508311461067364,
|
| 1753 |
+
"micro_precision": 0.42602892102335926,
|
| 1754 |
+
"micro_recall": 0.2761355443403028,
|
| 1755 |
+
"mean_labels_pred": 1.021590909090909,
|
| 1756 |
+
"samples_exact_match": 0.13295454545454546
|
| 1757 |
+
}
|
| 1758 |
+
],
|
| 1759 |
+
"tau_sweep_test": [
|
| 1760 |
+
{
|
| 1761 |
+
"tau": 0.0,
|
| 1762 |
+
"macro_f1": 0.2049503618207934,
|
| 1763 |
+
"macro_f1_reachable": 0.21700626545731067,
|
| 1764 |
+
"micro_f1": 0.3220433092726263,
|
| 1765 |
+
"micro_precision": 0.25505716798592787,
|
| 1766 |
+
"micro_recall": 0.4367469879518072,
|
| 1767 |
+
"mean_labels_pred": 2.7071428571428573,
|
| 1768 |
+
"samples_exact_match": 0.011904761904761904
|
| 1769 |
+
},
|
| 1770 |
+
{
|
| 1771 |
+
"tau": 0.3,
|
| 1772 |
+
"macro_f1": 0.2049503618207934,
|
| 1773 |
+
"macro_f1_reachable": 0.21700626545731067,
|
| 1774 |
+
"micro_f1": 0.3220433092726263,
|
| 1775 |
+
"micro_precision": 0.25505716798592787,
|
| 1776 |
+
"micro_recall": 0.4367469879518072,
|
| 1777 |
+
"mean_labels_pred": 2.7071428571428573,
|
| 1778 |
+
"samples_exact_match": 0.011904761904761904
|
| 1779 |
+
},
|
| 1780 |
+
{
|
| 1781 |
+
"tau": 0.5,
|
| 1782 |
+
"macro_f1": 0.20511781665226783,
|
| 1783 |
+
"macro_f1_reachable": 0.21718357057298948,
|
| 1784 |
+
"micro_f1": 0.3227601558152477,
|
| 1785 |
+
"micro_precision": 0.2559576345984113,
|
| 1786 |
+
"micro_recall": 0.4367469879518072,
|
| 1787 |
+
"mean_labels_pred": 2.697619047619048,
|
| 1788 |
+
"samples_exact_match": 0.011904761904761904
|
| 1789 |
+
},
|
| 1790 |
+
{
|
| 1791 |
+
"tau": 0.6,
|
| 1792 |
+
"macro_f1": 0.20483530850552126,
|
| 1793 |
+
"macro_f1_reachable": 0.2168844442999637,
|
| 1794 |
+
"micro_f1": 0.32142857142857145,
|
| 1795 |
+
"micro_precision": 0.2553191489361702,
|
| 1796 |
+
"micro_recall": 0.43373493975903615,
|
| 1797 |
+
"mean_labels_pred": 2.6857142857142855,
|
| 1798 |
+
"samples_exact_match": 0.011904761904761904
|
| 1799 |
+
},
|
| 1800 |
+
{
|
| 1801 |
+
"tau": 0.7,
|
| 1802 |
+
"macro_f1": 0.20513450225709598,
|
| 1803 |
+
"macro_f1_reachable": 0.217201237683984,
|
| 1804 |
+
"micro_f1": 0.32268907563025206,
|
| 1805 |
+
"micro_precision": 0.2569134701159679,
|
| 1806 |
+
"micro_recall": 0.43373493975903615,
|
| 1807 |
+
"mean_labels_pred": 2.669047619047619,
|
| 1808 |
+
"samples_exact_match": 0.011904761904761904
|
| 1809 |
+
},
|
| 1810 |
+
{
|
| 1811 |
+
"tau": 0.75,
|
| 1812 |
+
"macro_f1": 0.20522173870402438,
|
| 1813 |
+
"macro_f1_reachable": 0.21729360568661404,
|
| 1814 |
+
"micro_f1": 0.32305103757711723,
|
| 1815 |
+
"micro_precision": 0.257372654155496,
|
| 1816 |
+
"micro_recall": 0.43373493975903615,
|
| 1817 |
+
"mean_labels_pred": 2.664285714285714,
|
| 1818 |
+
"samples_exact_match": 0.011904761904761904
|
| 1819 |
+
},
|
| 1820 |
+
{
|
| 1821 |
+
"tau": 0.8,
|
| 1822 |
+
"macro_f1": 0.2046323345956508,
|
| 1823 |
+
"macro_f1_reachable": 0.21666953074833617,
|
| 1824 |
+
"micro_f1": 0.32040472175379425,
|
| 1825 |
+
"micro_precision": 0.2556053811659193,
|
| 1826 |
+
"micro_recall": 0.4292168674698795,
|
| 1827 |
+
"mean_labels_pred": 2.6547619047619047,
|
| 1828 |
+
"samples_exact_match": 0.009523809523809525
|
| 1829 |
+
},
|
| 1830 |
+
{
|
| 1831 |
+
"tau": 0.85,
|
| 1832 |
+
"macro_f1": 0.2044660584920587,
|
| 1833 |
+
"macro_f1_reachable": 0.21649347369747396,
|
| 1834 |
+
"micro_f1": 0.3198198198198199,
|
| 1835 |
+
"micro_precision": 0.25539568345323743,
|
| 1836 |
+
"micro_recall": 0.42771084337349397,
|
| 1837 |
+
"mean_labels_pred": 2.6476190476190475,
|
| 1838 |
+
"samples_exact_match": 0.009523809523809525
|
| 1839 |
+
},
|
| 1840 |
+
{
|
| 1841 |
+
"tau": 0.9,
|
| 1842 |
+
"macro_f1": 0.19732567058150718,
|
| 1843 |
+
"macro_f1_reachable": 0.20893306296865466,
|
| 1844 |
+
"micro_f1": 0.3227299016772701,
|
| 1845 |
+
"micro_precision": 0.2619718309859155,
|
| 1846 |
+
"micro_recall": 0.42018072289156627,
|
| 1847 |
+
"mean_labels_pred": 2.5357142857142856,
|
| 1848 |
+
"samples_exact_match": 0.014285714285714285
|
| 1849 |
+
},
|
| 1850 |
+
{
|
| 1851 |
+
"tau": 0.95,
|
| 1852 |
+
"macro_f1": 0.18796843697721283,
|
| 1853 |
+
"macro_f1_reachable": 0.19902540385822534,
|
| 1854 |
+
"micro_f1": 0.3333333333333333,
|
| 1855 |
+
"micro_precision": 0.2962529274004684,
|
| 1856 |
+
"micro_recall": 0.3810240963855422,
|
| 1857 |
+
"mean_labels_pred": 2.033333333333333,
|
| 1858 |
+
"samples_exact_match": 0.0380952380952381
|
| 1859 |
+
},
|
| 1860 |
+
{
|
| 1861 |
+
"tau": 0.98,
|
| 1862 |
+
"macro_f1": 0.18777188443539308,
|
| 1863 |
+
"macro_f1_reachable": 0.1988172894021809,
|
| 1864 |
+
"micro_f1": 0.3519108280254777,
|
| 1865 |
+
"micro_precision": 0.3733108108108108,
|
| 1866 |
+
"micro_recall": 0.3328313253012048,
|
| 1867 |
+
"mean_labels_pred": 1.4095238095238096,
|
| 1868 |
+
"samples_exact_match": 0.10238095238095238
|
| 1869 |
+
},
|
| 1870 |
+
{
|
| 1871 |
+
"tau": 0.99,
|
| 1872 |
+
"macro_f1": 0.1849880946052639,
|
| 1873 |
+
"macro_f1_reachable": 0.19586974722910294,
|
| 1874 |
+
"micro_f1": 0.35975066785396265,
|
| 1875 |
+
"micro_precision": 0.4400871459694989,
|
| 1876 |
+
"micro_recall": 0.3042168674698795,
|
| 1877 |
+
"mean_labels_pred": 1.0928571428571427,
|
| 1878 |
+
"samples_exact_match": 0.1261904761904762
|
| 1879 |
+
}
|
| 1880 |
+
],
|
| 1881 |
+
"parse_success_rate_test": 1.0,
|
| 1882 |
+
"uffr_test": 1.0
|
| 1883 |
+
},
|
| 1884 |
+
"QLoRA_r128": {
|
| 1885 |
+
"method": "qlora",
|
| 1886 |
+
"rank": 128,
|
| 1887 |
+
"candidates": {
|
| 1888 |
+
"step_000750": {
|
| 1889 |
+
"adapter_dir": "/work/FAC/HEC/DESI/yshresth/ai_health/checkpoints/qwen3_vl_8b_unified/QLoRA_r128/step_000750/adapter",
|
| 1890 |
+
"adapter_bytes": 698434660,
|
| 1891 |
+
"checkpoint_bytes": 2095586388,
|
| 1892 |
+
"in_domain": {
|
| 1893 |
+
"per_field_macro_f1": {
|
| 1894 |
+
"instrument_present": 1.0,
|
| 1895 |
+
"abnormality_present": 0.24328198545143345,
|
| 1896 |
+
"abnormality_type": 0.4189755956398363,
|
| 1897 |
+
"tract": 0.9756093968628029,
|
| 1898 |
+
"landmark": 0.8499147522756196,
|
| 1899 |
+
"procedure": 0.42664319248826293,
|
| 1900 |
+
"grade": 0.4291677372249282,
|
| 1901 |
+
"prep_quality": 0.6206896551724138
|
| 1902 |
+
},
|
| 1903 |
+
"mean_macro_f1": 0.6205352893894122,
|
| 1904 |
+
"schema_valid_rate": 1.0,
|
| 1905 |
+
"n": 600
|
| 1906 |
+
}
|
| 1907 |
+
},
|
| 1908 |
+
"step_001000": {
|
| 1909 |
+
"adapter_dir": "/work/FAC/HEC/DESI/yshresth/ai_health/checkpoints/qwen3_vl_8b_unified/QLoRA_r128/step_001000/adapter",
|
| 1910 |
+
"adapter_bytes": 698434660,
|
| 1911 |
+
"checkpoint_bytes": 2095586394,
|
| 1912 |
+
"in_domain": {
|
| 1913 |
+
"per_field_macro_f1": {
|
| 1914 |
+
"instrument_present": 1.0,
|
| 1915 |
+
"abnormality_present": 0.24770063986839436,
|
| 1916 |
+
"abnormality_type": 0.36406215043985946,
|
| 1917 |
+
"tract": 0.98187383929451,
|
| 1918 |
+
"landmark": 0.8560232613387853,
|
| 1919 |
+
"procedure": 0.434315100514259,
|
| 1920 |
+
"grade": 0.4387517803914659,
|
| 1921 |
+
"prep_quality": 0.6805692391899288
|
| 1922 |
+
},
|
| 1923 |
+
"mean_macro_f1": 0.6254120013796504,
|
| 1924 |
+
"schema_valid_rate": 1.0,
|
| 1925 |
+
"n": 600
|
| 1926 |
+
}
|
| 1927 |
+
},
|
| 1928 |
+
"final": {
|
| 1929 |
+
"adapter_dir": "/work/FAC/HEC/DESI/yshresth/ai_health/checkpoints/qwen3_vl_8b_unified/QLoRA_r128/final/adapter",
|
| 1930 |
+
"adapter_bytes": 698434660,
|
| 1931 |
+
"checkpoint_bytes": 2095586394,
|
| 1932 |
+
"in_domain": {
|
| 1933 |
+
"per_field_macro_f1": {
|
| 1934 |
+
"instrument_present": 1.0,
|
| 1935 |
+
"abnormality_present": 0.2388344314103594,
|
| 1936 |
+
"abnormality_type": 0.3812937824480101,
|
| 1937 |
+
"tract": 0.9818271604938272,
|
| 1938 |
+
"landmark": 0.8650335191032142,
|
| 1939 |
+
"procedure": 0.434315100514259,
|
| 1940 |
+
"grade": 0.4379413735603886,
|
| 1941 |
+
"prep_quality": 0.6705333968960221
|
| 1942 |
+
},
|
| 1943 |
+
"mean_macro_f1": 0.6262223455532601,
|
| 1944 |
+
"schema_valid_rate": 1.0,
|
| 1945 |
+
"n": 600
|
| 1946 |
+
}
|
| 1947 |
+
}
|
| 1948 |
+
},
|
| 1949 |
+
"selected": "final",
|
| 1950 |
+
"selection_criterion": "max mean per-field macro-F1 on a stratified in-domain validation subset (n=600); ties broken toward the later step",
|
| 1951 |
+
"profiling": {
|
| 1952 |
+
"adapter_bytes_on_disk": 698434660,
|
| 1953 |
+
"checkpoint_bytes_on_disk": 2095586394,
|
| 1954 |
+
"final_adapter_bytes_on_disk": 698434660,
|
| 1955 |
+
"load_seconds": 19.23515486717224,
|
| 1956 |
+
"weights_vram_bytes": 3879970816,
|
| 1957 |
+
"trainable_parameters": 349175808,
|
| 1958 |
+
"total_parameters": 5357664496,
|
| 1959 |
+
"trainable_percentage": 6.517313808296368,
|
| 1960 |
+
"peak_vram_bytes_inference": 22785372672,
|
| 1961 |
+
"peak_vram_reserved_bytes": 25390219264,
|
| 1962 |
+
"sage_test_wall_seconds": 277.12844252586365,
|
| 1963 |
+
"images_per_second": 1.5155427431841557,
|
| 1964 |
+
"latency_mean_s": 0.652144054711486,
|
| 1965 |
+
"latency_p50_s": 0.6392270387004828,
|
| 1966 |
+
"latency_p90_s": 0.647063333002734,
|
| 1967 |
+
"latency_p99_s": 0.6555076304357499,
|
| 1968 |
+
"gen_tokens_mean": 68.10952380952381,
|
| 1969 |
+
"tokens_per_second": 103.22289455125228,
|
| 1970 |
+
"weights": {
|
| 1971 |
+
"baseline_bytes": 1244659712,
|
| 1972 |
+
"resident_after_load_bytes": 10821173760,
|
| 1973 |
+
"weights_vram_bytes": 9576514048,
|
| 1974 |
+
"weights_vram_gib": 8.918823719024658,
|
| 1975 |
+
"param_bytes": 9456401344,
|
| 1976 |
+
"buffer_bytes": 584,
|
| 1977 |
+
"param_dtype_counts": {
|
| 1978 |
+
"torch.float32": 1249853680,
|
| 1979 |
+
"torch.uint8": 3758635008,
|
| 1980 |
+
"torch.bfloat16": 349175808
|
| 1981 |
+
},
|
| 1982 |
+
"load_seconds": 18.51423168182373,
|
| 1983 |
+
"adapter_bytes_on_disk": 698434660,
|
| 1984 |
+
"adapter_gib_on_disk": 0.6504679657518864,
|
| 1985 |
+
"trainable_parameters": 349175808,
|
| 1986 |
+
"total_parameters": 5357664496
|
| 1987 |
+
}
|
| 1988 |
+
},
|
| 1989 |
+
"sage_raw": {
|
| 1990 |
+
"tau": 0.0,
|
| 1991 |
+
"n_images": 420,
|
| 1992 |
+
"macro_f1": 0.25092377245219866,
|
| 1993 |
+
"macro_f1_reachable": 0.26568399436115153,
|
| 1994 |
+
"micro_f1": 0.36723910171730517,
|
| 1995 |
+
"micro_precision": 0.3270588235294118,
|
| 1996 |
+
"micro_recall": 0.4186746987951807,
|
| 1997 |
+
"samples_exact_match": 0.05952380952380952,
|
| 1998 |
+
"map_macro": 0.24705102282355648,
|
| 1999 |
+
"map_weighted": 0.37298997685943797,
|
| 2000 |
+
"map_micro": 0.30260239828381585,
|
| 2001 |
+
"mean_labels_gold": 1.5809523809523809,
|
| 2002 |
+
"mean_labels_pred": 2.0238095238095237,
|
| 2003 |
+
"per_label": {
|
| 2004 |
+
"blood": {
|
| 2005 |
+
"support": 13,
|
| 2006 |
+
"tp": 2,
|
| 2007 |
+
"fp": 4,
|
| 2008 |
+
"fn": 11,
|
| 2009 |
+
"precision": 0.3333333333333333,
|
| 2010 |
+
"recall": 0.15384615384615385,
|
| 2011 |
+
"f1": 0.21052631578947367,
|
| 2012 |
+
"ap": 0.08260073260073261,
|
| 2013 |
+
"n_predicted": 6,
|
| 2014 |
+
"reachable": true
|
| 2015 |
+
},
|
| 2016 |
+
"colon": {
|
| 2017 |
+
"support": 49,
|
| 2018 |
+
"tp": 36,
|
| 2019 |
+
"fp": 120,
|
| 2020 |
+
"fn": 13,
|
| 2021 |
+
"precision": 0.23076923076923078,
|
| 2022 |
+
"recall": 0.7346938775510204,
|
| 2023 |
+
"f1": 0.351219512195122,
|
| 2024 |
+
"ap": 0.2929509768897485,
|
| 2025 |
+
"n_predicted": 156,
|
| 2026 |
+
"reachable": true
|
| 2027 |
+
},
|
| 2028 |
+
"diverticulum": {
|
| 2029 |
+
"support": 6,
|
| 2030 |
+
"tp": 0,
|
| 2031 |
+
"fp": 0,
|
| 2032 |
+
"fn": 6,
|
| 2033 |
+
"precision": 0.0,
|
| 2034 |
+
"recall": 0.0,
|
| 2035 |
+
"f1": 0.0,
|
| 2036 |
+
"ap": 0.014285714285714285,
|
| 2037 |
+
"n_predicted": 0,
|
| 2038 |
+
"reachable": true
|
| 2039 |
+
},
|
| 2040 |
+
"duodenum": {
|
| 2041 |
+
"support": 15,
|
| 2042 |
+
"tp": 0,
|
| 2043 |
+
"fp": 1,
|
| 2044 |
+
"fn": 15,
|
| 2045 |
+
"precision": 0.0,
|
| 2046 |
+
"recall": 0.0,
|
| 2047 |
+
"f1": 0.0,
|
| 2048 |
+
"ap": 0.03571428571428571,
|
| 2049 |
+
"n_predicted": 1,
|
| 2050 |
+
"reachable": true
|
| 2051 |
+
},
|
| 2052 |
+
"esophagitis": {
|
| 2053 |
+
"support": 15,
|
| 2054 |
+
"tp": 0,
|
| 2055 |
+
"fp": 6,
|
| 2056 |
+
"fn": 15,
|
| 2057 |
+
"precision": 0.0,
|
| 2058 |
+
"recall": 0.0,
|
| 2059 |
+
"f1": 0.0,
|
| 2060 |
+
"ap": 0.03571428571428571,
|
| 2061 |
+
"n_predicted": 6,
|
| 2062 |
+
"reachable": true
|
| 2063 |
+
},
|
| 2064 |
+
"esophagus": {
|
| 2065 |
+
"support": 73,
|
| 2066 |
+
"tp": 11,
|
| 2067 |
+
"fp": 2,
|
| 2068 |
+
"fn": 62,
|
| 2069 |
+
"precision": 0.8461538461538461,
|
| 2070 |
+
"recall": 0.1506849315068493,
|
| 2071 |
+
"f1": 0.2558139534883721,
|
| 2072 |
+
"ap": 0.29358130454020864,
|
| 2073 |
+
"n_predicted": 13,
|
| 2074 |
+
"reachable": true
|
| 2075 |
+
},
|
| 2076 |
+
"foreign-body": {
|
| 2077 |
+
"support": 9,
|
| 2078 |
+
"tp": 0,
|
| 2079 |
+
"fp": 0,
|
| 2080 |
+
"fn": 9,
|
| 2081 |
+
"precision": 0.0,
|
| 2082 |
+
"recall": 0.0,
|
| 2083 |
+
"f1": 0.0,
|
| 2084 |
+
"ap": 0.02142857142857143,
|
| 2085 |
+
"n_predicted": 0,
|
| 2086 |
+
"reachable": false
|
| 2087 |
+
},
|
| 2088 |
+
"fundus": {
|
| 2089 |
+
"support": 16,
|
| 2090 |
+
"tp": 0,
|
| 2091 |
+
"fp": 0,
|
| 2092 |
+
"fn": 16,
|
| 2093 |
+
"precision": 0.0,
|
| 2094 |
+
"recall": 0.0,
|
| 2095 |
+
"f1": 0.0,
|
| 2096 |
+
"ap": 0.0380952380952381,
|
| 2097 |
+
"n_predicted": 0,
|
| 2098 |
+
"reachable": true
|
| 2099 |
+
},
|
| 2100 |
+
"gej": {
|
| 2101 |
+
"support": 27,
|
| 2102 |
+
"tp": 14,
|
| 2103 |
+
"fp": 11,
|
| 2104 |
+
"fn": 13,
|
| 2105 |
+
"precision": 0.56,
|
| 2106 |
+
"recall": 0.5185185185185185,
|
| 2107 |
+
"f1": 0.5384615384615384,
|
| 2108 |
+
"ap": 0.2633937959736258,
|
| 2109 |
+
"n_predicted": 25,
|
| 2110 |
+
"reachable": true
|
| 2111 |
+
},
|
| 2112 |
+
"growth": {
|
| 2113 |
+
"support": 11,
|
| 2114 |
+
"tp": 0,
|
| 2115 |
+
"fp": 0,
|
| 2116 |
+
"fn": 11,
|
| 2117 |
+
"precision": 0.0,
|
| 2118 |
+
"recall": 0.0,
|
| 2119 |
+
"f1": 0.0,
|
| 2120 |
+
"ap": 0.02619047619047619,
|
| 2121 |
+
"n_predicted": 0,
|
| 2122 |
+
"reachable": true
|
| 2123 |
+
},
|
| 2124 |
+
"inflammation": {
|
| 2125 |
+
"support": 40,
|
| 2126 |
+
"tp": 19,
|
| 2127 |
+
"fp": 46,
|
| 2128 |
+
"fn": 21,
|
| 2129 |
+
"precision": 0.2923076923076923,
|
| 2130 |
+
"recall": 0.475,
|
| 2131 |
+
"f1": 0.3619047619047619,
|
| 2132 |
+
"ap": 0.2736497061899073,
|
| 2133 |
+
"n_predicted": 65,
|
| 2134 |
+
"reachable": true
|
| 2135 |
+
},
|
| 2136 |
+
"instrument": {
|
| 2137 |
+
"support": 79,
|
| 2138 |
+
"tp": 79,
|
| 2139 |
+
"fp": 292,
|
| 2140 |
+
"fn": 0,
|
| 2141 |
+
"precision": 0.21293800539083557,
|
| 2142 |
+
"recall": 1.0,
|
| 2143 |
+
"f1": 0.3511111111111111,
|
| 2144 |
+
"ap": 0.6609514082043746,
|
| 2145 |
+
"n_predicted": 371,
|
| 2146 |
+
"reachable": true
|
| 2147 |
+
},
|
| 2148 |
+
"polyp": {
|
| 2149 |
+
"support": 58,
|
| 2150 |
+
"tp": 39,
|
| 2151 |
+
"fp": 34,
|
| 2152 |
+
"fn": 19,
|
| 2153 |
+
"precision": 0.5342465753424658,
|
| 2154 |
+
"recall": 0.6724137931034483,
|
| 2155 |
+
"f1": 0.5954198473282444,
|
| 2156 |
+
"ap": 0.57708655083163,
|
| 2157 |
+
"n_predicted": 73,
|
| 2158 |
+
"reachable": true
|
| 2159 |
+
},
|
| 2160 |
+
"pylorus": {
|
| 2161 |
+
"support": 84,
|
| 2162 |
+
"tp": 34,
|
| 2163 |
+
"fp": 3,
|
| 2164 |
+
"fn": 50,
|
| 2165 |
+
"precision": 0.918918918918919,
|
| 2166 |
+
"recall": 0.40476190476190477,
|
| 2167 |
+
"f1": 0.5619834710743802,
|
| 2168 |
+
"ap": 0.5150952980610097,
|
| 2169 |
+
"n_predicted": 37,
|
| 2170 |
+
"reachable": true
|
| 2171 |
+
},
|
| 2172 |
+
"rectum": {
|
| 2173 |
+
"support": 11,
|
| 2174 |
+
"tp": 6,
|
| 2175 |
+
"fp": 17,
|
| 2176 |
+
"fn": 5,
|
| 2177 |
+
"precision": 0.2608695652173913,
|
| 2178 |
+
"recall": 0.5454545454545454,
|
| 2179 |
+
"f1": 0.3529411764705882,
|
| 2180 |
+
"ap": 0.336772351393798,
|
| 2181 |
+
"n_predicted": 23,
|
| 2182 |
+
"reachable": true
|
| 2183 |
+
},
|
| 2184 |
+
"stomach": {
|
| 2185 |
+
"support": 126,
|
| 2186 |
+
"tp": 26,
|
| 2187 |
+
"fp": 20,
|
| 2188 |
+
"fn": 100,
|
| 2189 |
+
"precision": 0.5652173913043478,
|
| 2190 |
+
"recall": 0.20634920634920634,
|
| 2191 |
+
"f1": 0.3023255813953488,
|
| 2192 |
+
"ap": 0.3797398988661236,
|
| 2193 |
+
"n_predicted": 46,
|
| 2194 |
+
"reachable": true
|
| 2195 |
+
},
|
| 2196 |
+
"ulcer": {
|
| 2197 |
+
"support": 15,
|
| 2198 |
+
"tp": 1,
|
| 2199 |
+
"fp": 2,
|
| 2200 |
+
"fn": 14,
|
| 2201 |
+
"precision": 0.3333333333333333,
|
| 2202 |
+
"recall": 0.06666666666666667,
|
| 2203 |
+
"f1": 0.1111111111111111,
|
| 2204 |
+
"ap": 0.1,
|
| 2205 |
+
"n_predicted": 3,
|
| 2206 |
+
"reachable": true
|
| 2207 |
+
},
|
| 2208 |
+
"z-line": {
|
| 2209 |
+
"support": 17,
|
| 2210 |
+
"tp": 11,
|
| 2211 |
+
"fp": 14,
|
| 2212 |
+
"fn": 6,
|
| 2213 |
+
"precision": 0.44,
|
| 2214 |
+
"recall": 0.6470588235294118,
|
| 2215 |
+
"f1": 0.5238095238095238,
|
| 2216 |
+
"ap": 0.4996678158442865,
|
| 2217 |
+
"n_predicted": 25,
|
| 2218 |
+
"reachable": true
|
| 2219 |
+
}
|
| 2220 |
+
}
|
| 2221 |
+
},
|
| 2222 |
+
"sage_calibrated": {
|
| 2223 |
+
"tau": 0.85,
|
| 2224 |
+
"n_images": 420,
|
| 2225 |
+
"macro_f1": 0.25098745061414174,
|
| 2226 |
+
"macro_f1_reachable": 0.26575141829732657,
|
| 2227 |
+
"micro_f1": 0.3660477453580902,
|
| 2228 |
+
"micro_precision": 0.32701421800947866,
|
| 2229 |
+
"micro_recall": 0.41566265060240964,
|
| 2230 |
+
"samples_exact_match": 0.06190476190476191,
|
| 2231 |
+
"map_macro": 0.24705102282355648,
|
| 2232 |
+
"map_weighted": 0.37298997685943797,
|
| 2233 |
+
"map_micro": 0.30260239828381585,
|
| 2234 |
+
"mean_labels_gold": 1.5809523809523809,
|
| 2235 |
+
"mean_labels_pred": 2.0095238095238095,
|
| 2236 |
+
"per_label": {
|
| 2237 |
+
"blood": {
|
| 2238 |
+
"support": 13,
|
| 2239 |
+
"tp": 2,
|
| 2240 |
+
"fp": 4,
|
| 2241 |
+
"fn": 11,
|
| 2242 |
+
"precision": 0.3333333333333333,
|
| 2243 |
+
"recall": 0.15384615384615385,
|
| 2244 |
+
"f1": 0.21052631578947367,
|
| 2245 |
+
"ap": 0.08260073260073261,
|
| 2246 |
+
"n_predicted": 6,
|
| 2247 |
+
"reachable": true
|
| 2248 |
+
},
|
| 2249 |
+
"colon": {
|
| 2250 |
+
"support": 49,
|
| 2251 |
+
"tp": 36,
|
| 2252 |
+
"fp": 120,
|
| 2253 |
+
"fn": 13,
|
| 2254 |
+
"precision": 0.23076923076923078,
|
| 2255 |
+
"recall": 0.7346938775510204,
|
| 2256 |
+
"f1": 0.351219512195122,
|
| 2257 |
+
"ap": 0.2929509768897485,
|
| 2258 |
+
"n_predicted": 156,
|
| 2259 |
+
"reachable": true
|
| 2260 |
+
},
|
| 2261 |
+
"diverticulum": {
|
| 2262 |
+
"support": 6,
|
| 2263 |
+
"tp": 0,
|
| 2264 |
+
"fp": 0,
|
| 2265 |
+
"fn": 6,
|
| 2266 |
+
"precision": 0.0,
|
| 2267 |
+
"recall": 0.0,
|
| 2268 |
+
"f1": 0.0,
|
| 2269 |
+
"ap": 0.014285714285714285,
|
| 2270 |
+
"n_predicted": 0,
|
| 2271 |
+
"reachable": true
|
| 2272 |
+
},
|
| 2273 |
+
"duodenum": {
|
| 2274 |
+
"support": 15,
|
| 2275 |
+
"tp": 0,
|
| 2276 |
+
"fp": 1,
|
| 2277 |
+
"fn": 15,
|
| 2278 |
+
"precision": 0.0,
|
| 2279 |
+
"recall": 0.0,
|
| 2280 |
+
"f1": 0.0,
|
| 2281 |
+
"ap": 0.03571428571428571,
|
| 2282 |
+
"n_predicted": 1,
|
| 2283 |
+
"reachable": true
|
| 2284 |
+
},
|
| 2285 |
+
"esophagitis": {
|
| 2286 |
+
"support": 15,
|
| 2287 |
+
"tp": 0,
|
| 2288 |
+
"fp": 6,
|
| 2289 |
+
"fn": 15,
|
| 2290 |
+
"precision": 0.0,
|
| 2291 |
+
"recall": 0.0,
|
| 2292 |
+
"f1": 0.0,
|
| 2293 |
+
"ap": 0.03571428571428571,
|
| 2294 |
+
"n_predicted": 6,
|
| 2295 |
+
"reachable": true
|
| 2296 |
+
},
|
| 2297 |
+
"esophagus": {
|
| 2298 |
+
"support": 73,
|
| 2299 |
+
"tp": 11,
|
| 2300 |
+
"fp": 2,
|
| 2301 |
+
"fn": 62,
|
| 2302 |
+
"precision": 0.8461538461538461,
|
| 2303 |
+
"recall": 0.1506849315068493,
|
| 2304 |
+
"f1": 0.2558139534883721,
|
| 2305 |
+
"ap": 0.29358130454020864,
|
| 2306 |
+
"n_predicted": 13,
|
| 2307 |
+
"reachable": true
|
| 2308 |
+
},
|
| 2309 |
+
"foreign-body": {
|
| 2310 |
+
"support": 9,
|
| 2311 |
+
"tp": 0,
|
| 2312 |
+
"fp": 0,
|
| 2313 |
+
"fn": 9,
|
| 2314 |
+
"precision": 0.0,
|
| 2315 |
+
"recall": 0.0,
|
| 2316 |
+
"f1": 0.0,
|
| 2317 |
+
"ap": 0.02142857142857143,
|
| 2318 |
+
"n_predicted": 0,
|
| 2319 |
+
"reachable": false
|
| 2320 |
+
},
|
| 2321 |
+
"fundus": {
|
| 2322 |
+
"support": 16,
|
| 2323 |
+
"tp": 0,
|
| 2324 |
+
"fp": 0,
|
| 2325 |
+
"fn": 16,
|
| 2326 |
+
"precision": 0.0,
|
| 2327 |
+
"recall": 0.0,
|
| 2328 |
+
"f1": 0.0,
|
| 2329 |
+
"ap": 0.0380952380952381,
|
| 2330 |
+
"n_predicted": 0,
|
| 2331 |
+
"reachable": true
|
| 2332 |
+
},
|
| 2333 |
+
"gej": {
|
| 2334 |
+
"support": 27,
|
| 2335 |
+
"tp": 14,
|
| 2336 |
+
"fp": 11,
|
| 2337 |
+
"fn": 13,
|
| 2338 |
+
"precision": 0.56,
|
| 2339 |
+
"recall": 0.5185185185185185,
|
| 2340 |
+
"f1": 0.5384615384615384,
|
| 2341 |
+
"ap": 0.2633937959736258,
|
| 2342 |
+
"n_predicted": 25,
|
| 2343 |
+
"reachable": true
|
| 2344 |
+
},
|
| 2345 |
+
"growth": {
|
| 2346 |
+
"support": 11,
|
| 2347 |
+
"tp": 0,
|
| 2348 |
+
"fp": 0,
|
| 2349 |
+
"fn": 11,
|
| 2350 |
+
"precision": 0.0,
|
| 2351 |
+
"recall": 0.0,
|
| 2352 |
+
"f1": 0.0,
|
| 2353 |
+
"ap": 0.02619047619047619,
|
| 2354 |
+
"n_predicted": 0,
|
| 2355 |
+
"reachable": true
|
| 2356 |
+
},
|
| 2357 |
+
"inflammation": {
|
| 2358 |
+
"support": 40,
|
| 2359 |
+
"tp": 19,
|
| 2360 |
+
"fp": 46,
|
| 2361 |
+
"fn": 21,
|
| 2362 |
+
"precision": 0.2923076923076923,
|
| 2363 |
+
"recall": 0.475,
|
| 2364 |
+
"f1": 0.3619047619047619,
|
| 2365 |
+
"ap": 0.2736497061899073,
|
| 2366 |
+
"n_predicted": 65,
|
| 2367 |
+
"reachable": true
|
| 2368 |
+
},
|
| 2369 |
+
"instrument": {
|
| 2370 |
+
"support": 79,
|
| 2371 |
+
"tp": 79,
|
| 2372 |
+
"fp": 292,
|
| 2373 |
+
"fn": 0,
|
| 2374 |
+
"precision": 0.21293800539083557,
|
| 2375 |
+
"recall": 1.0,
|
| 2376 |
+
"f1": 0.3511111111111111,
|
| 2377 |
+
"ap": 0.6609514082043746,
|
| 2378 |
+
"n_predicted": 371,
|
| 2379 |
+
"reachable": true
|
| 2380 |
+
},
|
| 2381 |
+
"polyp": {
|
| 2382 |
+
"support": 58,
|
| 2383 |
+
"tp": 37,
|
| 2384 |
+
"fp": 32,
|
| 2385 |
+
"fn": 21,
|
| 2386 |
+
"precision": 0.5362318840579711,
|
| 2387 |
+
"recall": 0.6379310344827587,
|
| 2388 |
+
"f1": 0.5826771653543308,
|
| 2389 |
+
"ap": 0.57708655083163,
|
| 2390 |
+
"n_predicted": 69,
|
| 2391 |
+
"reachable": true
|
| 2392 |
+
},
|
| 2393 |
+
"pylorus": {
|
| 2394 |
+
"support": 84,
|
| 2395 |
+
"tp": 34,
|
| 2396 |
+
"fp": 3,
|
| 2397 |
+
"fn": 50,
|
| 2398 |
+
"precision": 0.918918918918919,
|
| 2399 |
+
"recall": 0.40476190476190477,
|
| 2400 |
+
"f1": 0.5619834710743802,
|
| 2401 |
+
"ap": 0.5150952980610097,
|
| 2402 |
+
"n_predicted": 37,
|
| 2403 |
+
"reachable": true
|
| 2404 |
+
},
|
| 2405 |
+
"rectum": {
|
| 2406 |
+
"support": 11,
|
| 2407 |
+
"tp": 6,
|
| 2408 |
+
"fp": 17,
|
| 2409 |
+
"fn": 5,
|
| 2410 |
+
"precision": 0.2608695652173913,
|
| 2411 |
+
"recall": 0.5454545454545454,
|
| 2412 |
+
"f1": 0.3529411764705882,
|
| 2413 |
+
"ap": 0.336772351393798,
|
| 2414 |
+
"n_predicted": 23,
|
| 2415 |
+
"reachable": true
|
| 2416 |
+
},
|
| 2417 |
+
"stomach": {
|
| 2418 |
+
"support": 126,
|
| 2419 |
+
"tp": 26,
|
| 2420 |
+
"fp": 20,
|
| 2421 |
+
"fn": 100,
|
| 2422 |
+
"precision": 0.5652173913043478,
|
| 2423 |
+
"recall": 0.20634920634920634,
|
| 2424 |
+
"f1": 0.3023255813953488,
|
| 2425 |
+
"ap": 0.3797398988661236,
|
| 2426 |
+
"n_predicted": 46,
|
| 2427 |
+
"reachable": true
|
| 2428 |
+
},
|
| 2429 |
+
"ulcer": {
|
| 2430 |
+
"support": 15,
|
| 2431 |
+
"tp": 1,
|
| 2432 |
+
"fp": 0,
|
| 2433 |
+
"fn": 14,
|
| 2434 |
+
"precision": 1.0,
|
| 2435 |
+
"recall": 0.06666666666666667,
|
| 2436 |
+
"f1": 0.125,
|
| 2437 |
+
"ap": 0.1,
|
| 2438 |
+
"n_predicted": 1,
|
| 2439 |
+
"reachable": true
|
| 2440 |
+
},
|
| 2441 |
+
"z-line": {
|
| 2442 |
+
"support": 17,
|
| 2443 |
+
"tp": 11,
|
| 2444 |
+
"fp": 14,
|
| 2445 |
+
"fn": 6,
|
| 2446 |
+
"precision": 0.44,
|
| 2447 |
+
"recall": 0.6470588235294118,
|
| 2448 |
+
"f1": 0.5238095238095238,
|
| 2449 |
+
"ap": 0.4996678158442865,
|
| 2450 |
+
"n_predicted": 25,
|
| 2451 |
+
"reachable": true
|
| 2452 |
+
}
|
| 2453 |
+
}
|
| 2454 |
+
},
|
| 2455 |
+
"tau_star": 0.85,
|
| 2456 |
+
"tau_sweep_train": [
|
| 2457 |
+
{
|
| 2458 |
+
"tau": 0.0,
|
| 2459 |
+
"macro_f1": 0.23207152787732938,
|
| 2460 |
+
"macro_f1_reachable": 0.24572279422305462,
|
| 2461 |
+
"micro_f1": 0.34261927633685557,
|
| 2462 |
+
"micro_precision": 0.30817972350230416,
|
| 2463 |
+
"micro_recall": 0.3857245854361932,
|
| 2464 |
+
"mean_labels_pred": 1.9727272727272727,
|
| 2465 |
+
"samples_exact_match": 0.04318181818181818
|
| 2466 |
+
},
|
| 2467 |
+
{
|
| 2468 |
+
"tau": 0.3,
|
| 2469 |
+
"macro_f1": 0.23207152787732938,
|
| 2470 |
+
"macro_f1_reachable": 0.24572279422305462,
|
| 2471 |
+
"micro_f1": 0.34261927633685557,
|
| 2472 |
+
"micro_precision": 0.30817972350230416,
|
| 2473 |
+
"micro_recall": 0.3857245854361932,
|
| 2474 |
+
"mean_labels_pred": 1.9727272727272727,
|
| 2475 |
+
"samples_exact_match": 0.04318181818181818
|
| 2476 |
+
},
|
| 2477 |
+
{
|
| 2478 |
+
"tau": 0.5,
|
| 2479 |
+
"macro_f1": 0.23207152787732938,
|
| 2480 |
+
"macro_f1_reachable": 0.24572279422305462,
|
| 2481 |
+
"micro_f1": 0.34261927633685557,
|
| 2482 |
+
"micro_precision": 0.30817972350230416,
|
| 2483 |
+
"micro_recall": 0.3857245854361932,
|
| 2484 |
+
"mean_labels_pred": 1.9727272727272727,
|
| 2485 |
+
"samples_exact_match": 0.04318181818181818
|
| 2486 |
+
},
|
| 2487 |
+
{
|
| 2488 |
+
"tau": 0.6,
|
| 2489 |
+
"macro_f1": 0.23191551914033603,
|
| 2490 |
+
"macro_f1_reachable": 0.2455576085015323,
|
| 2491 |
+
"micro_f1": 0.34177621032382177,
|
| 2492 |
+
"micro_precision": 0.30773672055427254,
|
| 2493 |
+
"micro_recall": 0.384282624369142,
|
| 2494 |
+
"mean_labels_pred": 1.9681818181818183,
|
| 2495 |
+
"samples_exact_match": 0.04318181818181818
|
| 2496 |
+
},
|
| 2497 |
+
{
|
| 2498 |
+
"tau": 0.7,
|
| 2499 |
+
"macro_f1": 0.23191551914033603,
|
| 2500 |
+
"macro_f1_reachable": 0.2455576085015323,
|
| 2501 |
+
"micro_f1": 0.34177621032382177,
|
| 2502 |
+
"micro_precision": 0.30773672055427254,
|
| 2503 |
+
"micro_recall": 0.384282624369142,
|
| 2504 |
+
"mean_labels_pred": 1.9681818181818183,
|
| 2505 |
+
"samples_exact_match": 0.04318181818181818
|
| 2506 |
+
},
|
| 2507 |
+
{
|
| 2508 |
+
"tau": 0.75,
|
| 2509 |
+
"macro_f1": 0.23191551914033603,
|
| 2510 |
+
"macro_f1_reachable": 0.2455576085015323,
|
| 2511 |
+
"micro_f1": 0.34177621032382177,
|
| 2512 |
+
"micro_precision": 0.30773672055427254,
|
| 2513 |
+
"micro_recall": 0.384282624369142,
|
| 2514 |
+
"mean_labels_pred": 1.9681818181818183,
|
| 2515 |
+
"samples_exact_match": 0.04318181818181818
|
| 2516 |
+
},
|
| 2517 |
+
{
|
| 2518 |
+
"tau": 0.8,
|
| 2519 |
+
"macro_f1": 0.2319356628371073,
|
| 2520 |
+
"macro_f1_reachable": 0.245578937121643,
|
| 2521 |
+
"micro_f1": 0.34221508828250397,
|
| 2522 |
+
"micro_precision": 0.30844907407407407,
|
| 2523 |
+
"micro_recall": 0.384282624369142,
|
| 2524 |
+
"mean_labels_pred": 1.9636363636363636,
|
| 2525 |
+
"samples_exact_match": 0.04318181818181818
|
| 2526 |
+
},
|
| 2527 |
+
{
|
| 2528 |
+
"tau": 0.85,
|
| 2529 |
+
"macro_f1": 0.2335277132628291,
|
| 2530 |
+
"macro_f1_reachable": 0.24726463757240727,
|
| 2531 |
+
"micro_f1": 0.3438709677419355,
|
| 2532 |
+
"micro_precision": 0.3111500291885581,
|
| 2533 |
+
"micro_recall": 0.384282624369142,
|
| 2534 |
+
"mean_labels_pred": 1.946590909090909,
|
| 2535 |
+
"samples_exact_match": 0.048863636363636366
|
| 2536 |
+
},
|
| 2537 |
+
{
|
| 2538 |
+
"tau": 0.9,
|
| 2539 |
+
"macro_f1": 0.23284372080345886,
|
| 2540 |
+
"macro_f1_reachable": 0.24654041026248585,
|
| 2541 |
+
"micro_f1": 0.34378093038601115,
|
| 2542 |
+
"micro_precision": 0.31690997566909973,
|
| 2543 |
+
"micro_recall": 0.3756308579668349,
|
| 2544 |
+
"mean_labels_pred": 1.8681818181818182,
|
| 2545 |
+
"samples_exact_match": 0.05909090909090909
|
| 2546 |
+
},
|
| 2547 |
+
{
|
| 2548 |
+
"tau": 0.95,
|
| 2549 |
+
"macro_f1": 0.2197804168784481,
|
| 2550 |
+
"macro_f1_reachable": 0.2327086766948274,
|
| 2551 |
+
"micro_f1": 0.34144515162860345,
|
| 2552 |
+
"micro_precision": 0.35514018691588783,
|
| 2553 |
+
"micro_recall": 0.3287671232876712,
|
| 2554 |
+
"mean_labels_pred": 1.459090909090909,
|
| 2555 |
+
"samples_exact_match": 0.09659090909090909
|
| 2556 |
+
},
|
| 2557 |
+
{
|
| 2558 |
+
"tau": 0.98,
|
| 2559 |
+
"macro_f1": 0.19817376124362462,
|
| 2560 |
+
"macro_f1_reachable": 0.20983104131677902,
|
| 2561 |
+
"micro_f1": 0.33641567591369437,
|
| 2562 |
+
"micro_precision": 0.4321266968325792,
|
| 2563 |
+
"micro_recall": 0.2754145638067772,
|
| 2564 |
+
"mean_labels_pred": 1.0045454545454546,
|
| 2565 |
+
"samples_exact_match": 0.14431818181818182
|
| 2566 |
+
},
|
| 2567 |
+
{
|
| 2568 |
+
"tau": 0.99,
|
| 2569 |
+
"macro_f1": 0.18490645750323664,
|
| 2570 |
+
"macro_f1_reachable": 0.1957833079446035,
|
| 2571 |
+
"micro_f1": 0.31750599520383693,
|
| 2572 |
+
"micro_precision": 0.47421203438395415,
|
| 2573 |
+
"micro_recall": 0.23864455659697187,
|
| 2574 |
+
"mean_labels_pred": 0.7931818181818182,
|
| 2575 |
+
"samples_exact_match": 0.15454545454545454
|
| 2576 |
+
}
|
| 2577 |
+
],
|
| 2578 |
+
"tau_sweep_test": [
|
| 2579 |
+
{
|
| 2580 |
+
"tau": 0.0,
|
| 2581 |
+
"macro_f1": 0.25092377245219866,
|
| 2582 |
+
"macro_f1_reachable": 0.26568399436115153,
|
| 2583 |
+
"micro_f1": 0.36723910171730517,
|
| 2584 |
+
"micro_precision": 0.3270588235294118,
|
| 2585 |
+
"micro_recall": 0.4186746987951807,
|
| 2586 |
+
"mean_labels_pred": 2.0238095238095237,
|
| 2587 |
+
"samples_exact_match": 0.05952380952380952
|
| 2588 |
+
},
|
| 2589 |
+
{
|
| 2590 |
+
"tau": 0.3,
|
| 2591 |
+
"macro_f1": 0.25092377245219866,
|
| 2592 |
+
"macro_f1_reachable": 0.26568399436115153,
|
| 2593 |
+
"micro_f1": 0.36723910171730517,
|
| 2594 |
+
"micro_precision": 0.3270588235294118,
|
| 2595 |
+
"micro_recall": 0.4186746987951807,
|
| 2596 |
+
"mean_labels_pred": 2.0238095238095237,
|
| 2597 |
+
"samples_exact_match": 0.05952380952380952
|
| 2598 |
+
},
|
| 2599 |
+
{
|
| 2600 |
+
"tau": 0.5,
|
| 2601 |
+
"macro_f1": 0.25092377245219866,
|
| 2602 |
+
"macro_f1_reachable": 0.26568399436115153,
|
| 2603 |
+
"micro_f1": 0.36723910171730517,
|
| 2604 |
+
"micro_precision": 0.3270588235294118,
|
| 2605 |
+
"micro_recall": 0.4186746987951807,
|
| 2606 |
+
"mean_labels_pred": 2.0238095238095237,
|
| 2607 |
+
"samples_exact_match": 0.05952380952380952
|
| 2608 |
+
},
|
| 2609 |
+
{
|
| 2610 |
+
"tau": 0.6,
|
| 2611 |
+
"macro_f1": 0.25092377245219866,
|
| 2612 |
+
"macro_f1_reachable": 0.26568399436115153,
|
| 2613 |
+
"micro_f1": 0.36723910171730517,
|
| 2614 |
+
"micro_precision": 0.3270588235294118,
|
| 2615 |
+
"micro_recall": 0.4186746987951807,
|
| 2616 |
+
"mean_labels_pred": 2.0238095238095237,
|
| 2617 |
+
"samples_exact_match": 0.05952380952380952
|
| 2618 |
+
},
|
| 2619 |
+
{
|
| 2620 |
+
"tau": 0.7,
|
| 2621 |
+
"macro_f1": 0.25092377245219866,
|
| 2622 |
+
"macro_f1_reachable": 0.26568399436115153,
|
| 2623 |
+
"micro_f1": 0.36723910171730517,
|
| 2624 |
+
"micro_precision": 0.3270588235294118,
|
| 2625 |
+
"micro_recall": 0.4186746987951807,
|
| 2626 |
+
"mean_labels_pred": 2.0238095238095237,
|
| 2627 |
+
"samples_exact_match": 0.05952380952380952
|
| 2628 |
+
},
|
| 2629 |
+
{
|
| 2630 |
+
"tau": 0.75,
|
| 2631 |
+
"macro_f1": 0.25092377245219866,
|
| 2632 |
+
"macro_f1_reachable": 0.26568399436115153,
|
| 2633 |
+
"micro_f1": 0.36723910171730517,
|
| 2634 |
+
"micro_precision": 0.3270588235294118,
|
| 2635 |
+
"micro_recall": 0.4186746987951807,
|
| 2636 |
+
"mean_labels_pred": 2.0238095238095237,
|
| 2637 |
+
"samples_exact_match": 0.05952380952380952
|
| 2638 |
+
},
|
| 2639 |
+
{
|
| 2640 |
+
"tau": 0.8,
|
| 2641 |
+
"macro_f1": 0.25092377245219866,
|
| 2642 |
+
"macro_f1_reachable": 0.26568399436115153,
|
| 2643 |
+
"micro_f1": 0.36723910171730517,
|
| 2644 |
+
"micro_precision": 0.3270588235294118,
|
| 2645 |
+
"micro_recall": 0.4186746987951807,
|
| 2646 |
+
"mean_labels_pred": 2.0238095238095237,
|
| 2647 |
+
"samples_exact_match": 0.05952380952380952
|
| 2648 |
+
},
|
| 2649 |
+
{
|
| 2650 |
+
"tau": 0.85,
|
| 2651 |
+
"macro_f1": 0.25098745061414174,
|
| 2652 |
+
"macro_f1_reachable": 0.26575141829732657,
|
| 2653 |
+
"micro_f1": 0.3660477453580902,
|
| 2654 |
+
"micro_precision": 0.32701421800947866,
|
| 2655 |
+
"micro_recall": 0.41566265060240964,
|
| 2656 |
+
"mean_labels_pred": 2.0095238095238095,
|
| 2657 |
+
"samples_exact_match": 0.06190476190476191
|
| 2658 |
+
},
|
| 2659 |
+
{
|
| 2660 |
+
"tau": 0.9,
|
| 2661 |
+
"macro_f1": 0.24450754658141108,
|
| 2662 |
+
"macro_f1_reachable": 0.25889034343914114,
|
| 2663 |
+
"micro_f1": 0.3644986449864499,
|
| 2664 |
+
"micro_precision": 0.3312807881773399,
|
| 2665 |
+
"micro_recall": 0.40512048192771083,
|
| 2666 |
+
"mean_labels_pred": 1.9333333333333333,
|
| 2667 |
+
"samples_exact_match": 0.07142857142857142
|
| 2668 |
+
},
|
| 2669 |
+
{
|
| 2670 |
+
"tau": 0.95,
|
| 2671 |
+
"macro_f1": 0.23072994617140422,
|
| 2672 |
+
"macro_f1_reachable": 0.24430229594619265,
|
| 2673 |
+
"micro_f1": 0.3590527119938885,
|
| 2674 |
+
"micro_precision": 0.3643410852713178,
|
| 2675 |
+
"micro_recall": 0.3539156626506024,
|
| 2676 |
+
"mean_labels_pred": 1.5357142857142858,
|
| 2677 |
+
"samples_exact_match": 0.10476190476190476
|
| 2678 |
+
},
|
| 2679 |
+
{
|
| 2680 |
+
"tau": 0.98,
|
| 2681 |
+
"macro_f1": 0.20542729279113517,
|
| 2682 |
+
"macro_f1_reachable": 0.21751125119061368,
|
| 2683 |
+
"micro_f1": 0.34681042228212045,
|
| 2684 |
+
"micro_precision": 0.4298440979955457,
|
| 2685 |
+
"micro_recall": 0.29066265060240964,
|
| 2686 |
+
"mean_labels_pred": 1.069047619047619,
|
| 2687 |
+
"samples_exact_match": 0.15
|
| 2688 |
+
},
|
| 2689 |
+
{
|
| 2690 |
+
"tau": 0.99,
|
| 2691 |
+
"macro_f1": 0.1914287915173006,
|
| 2692 |
+
"macro_f1_reachable": 0.2026893086653771,
|
| 2693 |
+
"micro_f1": 0.33628318584070793,
|
| 2694 |
+
"micro_precision": 0.48441926345609065,
|
| 2695 |
+
"micro_recall": 0.2575301204819277,
|
| 2696 |
+
"mean_labels_pred": 0.8404761904761905,
|
| 2697 |
+
"samples_exact_match": 0.1595238095238095
|
| 2698 |
+
}
|
| 2699 |
+
],
|
| 2700 |
+
"parse_success_rate_test": 1.0,
|
| 2701 |
+
"uffr_test": 1.0
|
| 2702 |
+
},
|
| 2703 |
+
"QLoRA_r512": {
|
| 2704 |
+
"method": "qlora",
|
| 2705 |
+
"rank": 512,
|
| 2706 |
+
"candidates": {
|
| 2707 |
+
"step_000750": {
|
| 2708 |
+
"adapter_dir": "/work/FAC/HEC/DESI/yshresth/ai_health/checkpoints/qwen3_vl_8b_unified/QLoRA_r512/step_000750/adapter",
|
| 2709 |
+
"adapter_bytes": 2793490268,
|
| 2710 |
+
"checkpoint_bytes": 8380757377,
|
| 2711 |
+
"in_domain": {
|
| 2712 |
+
"per_field_macro_f1": {
|
| 2713 |
+
"instrument_present": 1.0,
|
| 2714 |
+
"abnormality_present": 0.19743589743589746,
|
| 2715 |
+
"abnormality_type": 0.36660406204720586,
|
| 2716 |
+
"tract": 0.9756742464304602,
|
| 2717 |
+
"landmark": 0.875570765999613,
|
| 2718 |
+
"procedure": 0.5563118337295805,
|
| 2719 |
+
"grade": 0.2737924525277633,
|
| 2720 |
+
"prep_quality": 0.7095785440613027
|
| 2721 |
+
},
|
| 2722 |
+
"mean_macro_f1": 0.6193709752789779,
|
| 2723 |
+
"schema_valid_rate": 1.0,
|
| 2724 |
+
"n": 600
|
| 2725 |
+
}
|
| 2726 |
+
},
|
| 2727 |
+
"step_001000": {
|
| 2728 |
+
"adapter_dir": "/work/FAC/HEC/DESI/yshresth/ai_health/checkpoints/qwen3_vl_8b_unified/QLoRA_r512/step_001000/adapter",
|
| 2729 |
+
"adapter_bytes": 2793490268,
|
| 2730 |
+
"checkpoint_bytes": 8380757382,
|
| 2731 |
+
"in_domain": {
|
| 2732 |
+
"per_field_macro_f1": {
|
| 2733 |
+
"instrument_present": 1.0,
|
| 2734 |
+
"abnormality_present": 0.20216285401277756,
|
| 2735 |
+
"abnormality_type": 0.4228681162472868,
|
| 2736 |
+
"tract": 0.98187383929451,
|
| 2737 |
+
"landmark": 0.854727402570834,
|
| 2738 |
+
"procedure": 0.4805060584461867,
|
| 2739 |
+
"grade": 0.33848932912240404,
|
| 2740 |
+
"prep_quality": 0.8120351588911427
|
| 2741 |
+
},
|
| 2742 |
+
"mean_macro_f1": 0.6365828448231428,
|
| 2743 |
+
"schema_valid_rate": 1.0,
|
| 2744 |
+
"n": 600
|
| 2745 |
+
}
|
| 2746 |
+
},
|
| 2747 |
+
"final": {
|
| 2748 |
+
"adapter_dir": "/work/FAC/HEC/DESI/yshresth/ai_health/checkpoints/qwen3_vl_8b_unified/QLoRA_r512/final/adapter",
|
| 2749 |
+
"adapter_bytes": 2793490268,
|
| 2750 |
+
"checkpoint_bytes": 8380757380,
|
| 2751 |
+
"in_domain": {
|
| 2752 |
+
"per_field_macro_f1": {
|
| 2753 |
+
"instrument_present": 1.0,
|
| 2754 |
+
"abnormality_present": 0.20216285401277756,
|
| 2755 |
+
"abnormality_type": 0.4121423035455645,
|
| 2756 |
+
"tract": 0.9798339957914426,
|
| 2757 |
+
"landmark": 0.8543172363070092,
|
| 2758 |
+
"procedure": 0.4805060584461867,
|
| 2759 |
+
"grade": 0.3403090240254991,
|
| 2760 |
+
"prep_quality": 0.7801724137931035
|
| 2761 |
+
},
|
| 2762 |
+
"mean_macro_f1": 0.6311804857401979,
|
| 2763 |
+
"schema_valid_rate": 1.0,
|
| 2764 |
+
"n": 600
|
| 2765 |
+
}
|
| 2766 |
+
}
|
| 2767 |
+
},
|
| 2768 |
+
"selected": "step_001000",
|
| 2769 |
+
"selection_criterion": "max mean per-field macro-F1 on a stratified in-domain validation subset (n=600); ties broken toward the later step",
|
| 2770 |
+
"profiling": {
|
| 2771 |
+
"adapter_bytes_on_disk": 2793490268,
|
| 2772 |
+
"checkpoint_bytes_on_disk": 8380757382,
|
| 2773 |
+
"final_adapter_bytes_on_disk": 2793490268,
|
| 2774 |
+
"load_seconds": 28.775453329086304,
|
| 2775 |
+
"weights_vram_bytes": 3879970816,
|
| 2776 |
+
"trainable_parameters": 1396703232,
|
| 2777 |
+
"total_parameters": 6405191920,
|
| 2778 |
+
"trainable_percentage": 21.805798318686445,
|
| 2779 |
+
"peak_vram_bytes_inference": 24880427520,
|
| 2780 |
+
"peak_vram_reserved_bytes": 27130855424,
|
| 2781 |
+
"sage_test_wall_seconds": 280.976859331131,
|
| 2782 |
+
"images_per_second": 1.4947850189507257,
|
| 2783 |
+
"latency_mean_s": 0.6615707975501816,
|
| 2784 |
+
"latency_p50_s": 0.6506188219354954,
|
| 2785 |
+
"latency_p90_s": 0.6581013931863708,
|
| 2786 |
+
"latency_p99_s": 0.6583597977587488,
|
| 2787 |
+
"gen_tokens_mean": 68.6,
|
| 2788 |
+
"tokens_per_second": 102.54225230001978,
|
| 2789 |
+
"weights": {
|
| 2790 |
+
"baseline_bytes": 2489320448,
|
| 2791 |
+
"resident_after_load_bytes": 14160888320,
|
| 2792 |
+
"weights_vram_bytes": 11671567872,
|
| 2793 |
+
"weights_vram_gib": 10.869994640350342,
|
| 2794 |
+
"param_bytes": 11551456192,
|
| 2795 |
+
"buffer_bytes": 584,
|
| 2796 |
+
"param_dtype_counts": {
|
| 2797 |
+
"torch.float32": 1249853680,
|
| 2798 |
+
"torch.uint8": 3758635008,
|
| 2799 |
+
"torch.bfloat16": 1396703232
|
| 2800 |
+
},
|
| 2801 |
+
"load_seconds": 28.39726710319519,
|
| 2802 |
+
"adapter_bytes_on_disk": 2793490268,
|
| 2803 |
+
"adapter_gib_on_disk": 2.601640548557043,
|
| 2804 |
+
"trainable_parameters": 1396703232,
|
| 2805 |
+
"total_parameters": 6405191920
|
| 2806 |
+
}
|
| 2807 |
+
},
|
| 2808 |
+
"sage_raw": {
|
| 2809 |
+
"tau": 0.0,
|
| 2810 |
+
"n_images": 420,
|
| 2811 |
+
"macro_f1": 0.25090184690401895,
|
| 2812 |
+
"macro_f1_reachable": 0.2656607790748437,
|
| 2813 |
+
"micro_f1": 0.37131882202304733,
|
| 2814 |
+
"micro_precision": 0.32293986636971045,
|
| 2815 |
+
"micro_recall": 0.4367469879518072,
|
| 2816 |
+
"samples_exact_match": 0.04523809523809524,
|
| 2817 |
+
"map_macro": 0.26171034782924324,
|
| 2818 |
+
"map_weighted": 0.3893548012883451,
|
| 2819 |
+
"map_micro": 0.3171827617595868,
|
| 2820 |
+
"mean_labels_gold": 1.5809523809523809,
|
| 2821 |
+
"mean_labels_pred": 2.138095238095238,
|
| 2822 |
+
"per_label": {
|
| 2823 |
+
"blood": {
|
| 2824 |
+
"support": 13,
|
| 2825 |
+
"tp": 2,
|
| 2826 |
+
"fp": 10,
|
| 2827 |
+
"fn": 11,
|
| 2828 |
+
"precision": 0.16666666666666666,
|
| 2829 |
+
"recall": 0.15384615384615385,
|
| 2830 |
+
"f1": 0.16,
|
| 2831 |
+
"ap": 0.06721611721611721,
|
| 2832 |
+
"n_predicted": 12,
|
| 2833 |
+
"reachable": true
|
| 2834 |
+
},
|
| 2835 |
+
"colon": {
|
| 2836 |
+
"support": 49,
|
| 2837 |
+
"tp": 38,
|
| 2838 |
+
"fp": 100,
|
| 2839 |
+
"fn": 11,
|
| 2840 |
+
"precision": 0.2753623188405797,
|
| 2841 |
+
"recall": 0.7755102040816326,
|
| 2842 |
+
"f1": 0.40641711229946526,
|
| 2843 |
+
"ap": 0.36939985820287946,
|
| 2844 |
+
"n_predicted": 138,
|
| 2845 |
+
"reachable": true
|
| 2846 |
+
},
|
| 2847 |
+
"diverticulum": {
|
| 2848 |
+
"support": 6,
|
| 2849 |
+
"tp": 0,
|
| 2850 |
+
"fp": 0,
|
| 2851 |
+
"fn": 6,
|
| 2852 |
+
"precision": 0.0,
|
| 2853 |
+
"recall": 0.0,
|
| 2854 |
+
"f1": 0.0,
|
| 2855 |
+
"ap": 0.014285714285714285,
|
| 2856 |
+
"n_predicted": 0,
|
| 2857 |
+
"reachable": true
|
| 2858 |
+
},
|
| 2859 |
+
"duodenum": {
|
| 2860 |
+
"support": 15,
|
| 2861 |
+
"tp": 0,
|
| 2862 |
+
"fp": 3,
|
| 2863 |
+
"fn": 15,
|
| 2864 |
+
"precision": 0.0,
|
| 2865 |
+
"recall": 0.0,
|
| 2866 |
+
"f1": 0.0,
|
| 2867 |
+
"ap": 0.03571428571428571,
|
| 2868 |
+
"n_predicted": 3,
|
| 2869 |
+
"reachable": true
|
| 2870 |
+
},
|
| 2871 |
+
"esophagitis": {
|
| 2872 |
+
"support": 15,
|
| 2873 |
+
"tp": 1,
|
| 2874 |
+
"fp": 1,
|
| 2875 |
+
"fn": 14,
|
| 2876 |
+
"precision": 0.5,
|
| 2877 |
+
"recall": 0.06666666666666667,
|
| 2878 |
+
"f1": 0.11764705882352941,
|
| 2879 |
+
"ap": 0.1,
|
| 2880 |
+
"n_predicted": 2,
|
| 2881 |
+
"reachable": true
|
| 2882 |
+
},
|
| 2883 |
+
"esophagus": {
|
| 2884 |
+
"support": 73,
|
| 2885 |
+
"tp": 13,
|
| 2886 |
+
"fp": 0,
|
| 2887 |
+
"fn": 60,
|
| 2888 |
+
"precision": 1.0,
|
| 2889 |
+
"recall": 0.1780821917808219,
|
| 2890 |
+
"f1": 0.3023255813953488,
|
| 2891 |
+
"ap": 0.32093933463796476,
|
| 2892 |
+
"n_predicted": 13,
|
| 2893 |
+
"reachable": true
|
| 2894 |
+
},
|
| 2895 |
+
"foreign-body": {
|
| 2896 |
+
"support": 9,
|
| 2897 |
+
"tp": 0,
|
| 2898 |
+
"fp": 0,
|
| 2899 |
+
"fn": 9,
|
| 2900 |
+
"precision": 0.0,
|
| 2901 |
+
"recall": 0.0,
|
| 2902 |
+
"f1": 0.0,
|
| 2903 |
+
"ap": 0.02142857142857143,
|
| 2904 |
+
"n_predicted": 0,
|
| 2905 |
+
"reachable": false
|
| 2906 |
+
},
|
| 2907 |
+
"fundus": {
|
| 2908 |
+
"support": 16,
|
| 2909 |
+
"tp": 0,
|
| 2910 |
+
"fp": 0,
|
| 2911 |
+
"fn": 16,
|
| 2912 |
+
"precision": 0.0,
|
| 2913 |
+
"recall": 0.0,
|
| 2914 |
+
"f1": 0.0,
|
| 2915 |
+
"ap": 0.0380952380952381,
|
| 2916 |
+
"n_predicted": 0,
|
| 2917 |
+
"reachable": true
|
| 2918 |
+
},
|
| 2919 |
+
"gej": {
|
| 2920 |
+
"support": 27,
|
| 2921 |
+
"tp": 13,
|
| 2922 |
+
"fp": 15,
|
| 2923 |
+
"fn": 14,
|
| 2924 |
+
"precision": 0.4642857142857143,
|
| 2925 |
+
"recall": 0.48148148148148145,
|
| 2926 |
+
"f1": 0.4727272727272727,
|
| 2927 |
+
"ap": 0.2786054642779789,
|
| 2928 |
+
"n_predicted": 28,
|
| 2929 |
+
"reachable": true
|
| 2930 |
+
},
|
| 2931 |
+
"growth": {
|
| 2932 |
+
"support": 11,
|
| 2933 |
+
"tp": 0,
|
| 2934 |
+
"fp": 0,
|
| 2935 |
+
"fn": 11,
|
| 2936 |
+
"precision": 0.0,
|
| 2937 |
+
"recall": 0.0,
|
| 2938 |
+
"f1": 0.0,
|
| 2939 |
+
"ap": 0.02619047619047619,
|
| 2940 |
+
"n_predicted": 0,
|
| 2941 |
+
"reachable": true
|
| 2942 |
+
},
|
| 2943 |
+
"inflammation": {
|
| 2944 |
+
"support": 40,
|
| 2945 |
+
"tp": 24,
|
| 2946 |
+
"fp": 61,
|
| 2947 |
+
"fn": 16,
|
| 2948 |
+
"precision": 0.2823529411764706,
|
| 2949 |
+
"recall": 0.6,
|
| 2950 |
+
"f1": 0.384,
|
| 2951 |
+
"ap": 0.33143872754653164,
|
| 2952 |
+
"n_predicted": 85,
|
| 2953 |
+
"reachable": true
|
| 2954 |
+
},
|
| 2955 |
+
"instrument": {
|
| 2956 |
+
"support": 79,
|
| 2957 |
+
"tp": 79,
|
| 2958 |
+
"fp": 302,
|
| 2959 |
+
"fn": 0,
|
| 2960 |
+
"precision": 0.2073490813648294,
|
| 2961 |
+
"recall": 1.0,
|
| 2962 |
+
"f1": 0.34347826086956523,
|
| 2963 |
+
"ap": 0.6876621377294262,
|
| 2964 |
+
"n_predicted": 381,
|
| 2965 |
+
"reachable": true
|
| 2966 |
+
},
|
| 2967 |
+
"polyp": {
|
| 2968 |
+
"support": 58,
|
| 2969 |
+
"tp": 40,
|
| 2970 |
+
"fp": 39,
|
| 2971 |
+
"fn": 18,
|
| 2972 |
+
"precision": 0.5063291139240507,
|
| 2973 |
+
"recall": 0.6896551724137931,
|
| 2974 |
+
"f1": 0.583941605839416,
|
| 2975 |
+
"ap": 0.6078428199920347,
|
| 2976 |
+
"n_predicted": 79,
|
| 2977 |
+
"reachable": true
|
| 2978 |
+
},
|
| 2979 |
+
"pylorus": {
|
| 2980 |
+
"support": 84,
|
| 2981 |
+
"tp": 35,
|
| 2982 |
+
"fp": 5,
|
| 2983 |
+
"fn": 49,
|
| 2984 |
+
"precision": 0.875,
|
| 2985 |
+
"recall": 0.4166666666666667,
|
| 2986 |
+
"f1": 0.5645161290322581,
|
| 2987 |
+
"ap": 0.522771057491155,
|
| 2988 |
+
"n_predicted": 40,
|
| 2989 |
+
"reachable": true
|
| 2990 |
+
},
|
| 2991 |
+
"rectum": {
|
| 2992 |
+
"support": 11,
|
| 2993 |
+
"tp": 6,
|
| 2994 |
+
"fp": 16,
|
| 2995 |
+
"fn": 5,
|
| 2996 |
+
"precision": 0.2727272727272727,
|
| 2997 |
+
"recall": 0.5454545454545454,
|
| 2998 |
+
"f1": 0.3636363636363636,
|
| 2999 |
+
"ap": 0.30692640692640694,
|
| 3000 |
+
"n_predicted": 22,
|
| 3001 |
+
"reachable": true
|
| 3002 |
+
},
|
| 3003 |
+
"stomach": {
|
| 3004 |
+
"support": 126,
|
| 3005 |
+
"tp": 27,
|
| 3006 |
+
"fp": 37,
|
| 3007 |
+
"fn": 99,
|
| 3008 |
+
"precision": 0.421875,
|
| 3009 |
+
"recall": 0.21428571428571427,
|
| 3010 |
+
"f1": 0.28421052631578947,
|
| 3011 |
+
"ap": 0.35449998722411874,
|
| 3012 |
+
"n_predicted": 64,
|
| 3013 |
+
"reachable": true
|
| 3014 |
+
},
|
| 3015 |
+
"ulcer": {
|
| 3016 |
+
"support": 15,
|
| 3017 |
+
"tp": 0,
|
| 3018 |
+
"fp": 3,
|
| 3019 |
+
"fn": 15,
|
| 3020 |
+
"precision": 0.0,
|
| 3021 |
+
"recall": 0.0,
|
| 3022 |
+
"f1": 0.0,
|
| 3023 |
+
"ap": 0.03571428571428571,
|
| 3024 |
+
"n_predicted": 3,
|
| 3025 |
+
"reachable": true
|
| 3026 |
+
},
|
| 3027 |
+
"z-line": {
|
| 3028 |
+
"support": 17,
|
| 3029 |
+
"tp": 12,
|
| 3030 |
+
"fp": 16,
|
| 3031 |
+
"fn": 5,
|
| 3032 |
+
"precision": 0.42857142857142855,
|
| 3033 |
+
"recall": 0.7058823529411765,
|
| 3034 |
+
"f1": 0.5333333333333333,
|
| 3035 |
+
"ap": 0.5920557782531923,
|
| 3036 |
+
"n_predicted": 28,
|
| 3037 |
+
"reachable": true
|
| 3038 |
+
}
|
| 3039 |
+
}
|
| 3040 |
+
},
|
| 3041 |
+
"sage_calibrated": {
|
| 3042 |
+
"tau": 0.9,
|
| 3043 |
+
"n_images": 420,
|
| 3044 |
+
"macro_f1": 0.2524217240983969,
|
| 3045 |
+
"macro_f1_reachable": 0.2672700608100673,
|
| 3046 |
+
"micro_f1": 0.37433862433862436,
|
| 3047 |
+
"micro_precision": 0.33372641509433965,
|
| 3048 |
+
"micro_recall": 0.42620481927710846,
|
| 3049 |
+
"samples_exact_match": 0.06428571428571428,
|
| 3050 |
+
"map_macro": 0.26171034782924324,
|
| 3051 |
+
"map_weighted": 0.3893548012883451,
|
| 3052 |
+
"map_micro": 0.3171827617595868,
|
| 3053 |
+
"mean_labels_gold": 1.5809523809523809,
|
| 3054 |
+
"mean_labels_pred": 2.019047619047619,
|
| 3055 |
+
"per_label": {
|
| 3056 |
+
"blood": {
|
| 3057 |
+
"support": 13,
|
| 3058 |
+
"tp": 2,
|
| 3059 |
+
"fp": 7,
|
| 3060 |
+
"fn": 11,
|
| 3061 |
+
"precision": 0.2222222222222222,
|
| 3062 |
+
"recall": 0.15384615384615385,
|
| 3063 |
+
"f1": 0.18181818181818185,
|
| 3064 |
+
"ap": 0.06721611721611721,
|
| 3065 |
+
"n_predicted": 9,
|
| 3066 |
+
"reachable": true
|
| 3067 |
+
},
|
| 3068 |
+
"colon": {
|
| 3069 |
+
"support": 49,
|
| 3070 |
+
"tp": 38,
|
| 3071 |
+
"fp": 100,
|
| 3072 |
+
"fn": 11,
|
| 3073 |
+
"precision": 0.2753623188405797,
|
| 3074 |
+
"recall": 0.7755102040816326,
|
| 3075 |
+
"f1": 0.40641711229946526,
|
| 3076 |
+
"ap": 0.36939985820287946,
|
| 3077 |
+
"n_predicted": 138,
|
| 3078 |
+
"reachable": true
|
| 3079 |
+
},
|
| 3080 |
+
"diverticulum": {
|
| 3081 |
+
"support": 6,
|
| 3082 |
+
"tp": 0,
|
| 3083 |
+
"fp": 0,
|
| 3084 |
+
"fn": 6,
|
| 3085 |
+
"precision": 0.0,
|
| 3086 |
+
"recall": 0.0,
|
| 3087 |
+
"f1": 0.0,
|
| 3088 |
+
"ap": 0.014285714285714285,
|
| 3089 |
+
"n_predicted": 0,
|
| 3090 |
+
"reachable": true
|
| 3091 |
+
},
|
| 3092 |
+
"duodenum": {
|
| 3093 |
+
"support": 15,
|
| 3094 |
+
"tp": 0,
|
| 3095 |
+
"fp": 3,
|
| 3096 |
+
"fn": 15,
|
| 3097 |
+
"precision": 0.0,
|
| 3098 |
+
"recall": 0.0,
|
| 3099 |
+
"f1": 0.0,
|
| 3100 |
+
"ap": 0.03571428571428571,
|
| 3101 |
+
"n_predicted": 3,
|
| 3102 |
+
"reachable": true
|
| 3103 |
+
},
|
| 3104 |
+
"esophagitis": {
|
| 3105 |
+
"support": 15,
|
| 3106 |
+
"tp": 1,
|
| 3107 |
+
"fp": 1,
|
| 3108 |
+
"fn": 14,
|
| 3109 |
+
"precision": 0.5,
|
| 3110 |
+
"recall": 0.06666666666666667,
|
| 3111 |
+
"f1": 0.11764705882352941,
|
| 3112 |
+
"ap": 0.1,
|
| 3113 |
+
"n_predicted": 2,
|
| 3114 |
+
"reachable": true
|
| 3115 |
+
},
|
| 3116 |
+
"esophagus": {
|
| 3117 |
+
"support": 73,
|
| 3118 |
+
"tp": 13,
|
| 3119 |
+
"fp": 0,
|
| 3120 |
+
"fn": 60,
|
| 3121 |
+
"precision": 1.0,
|
| 3122 |
+
"recall": 0.1780821917808219,
|
| 3123 |
+
"f1": 0.3023255813953488,
|
| 3124 |
+
"ap": 0.32093933463796476,
|
| 3125 |
+
"n_predicted": 13,
|
| 3126 |
+
"reachable": true
|
| 3127 |
+
},
|
| 3128 |
+
"foreign-body": {
|
| 3129 |
+
"support": 9,
|
| 3130 |
+
"tp": 0,
|
| 3131 |
+
"fp": 0,
|
| 3132 |
+
"fn": 9,
|
| 3133 |
+
"precision": 0.0,
|
| 3134 |
+
"recall": 0.0,
|
| 3135 |
+
"f1": 0.0,
|
| 3136 |
+
"ap": 0.02142857142857143,
|
| 3137 |
+
"n_predicted": 0,
|
| 3138 |
+
"reachable": false
|
| 3139 |
+
},
|
| 3140 |
+
"fundus": {
|
| 3141 |
+
"support": 16,
|
| 3142 |
+
"tp": 0,
|
| 3143 |
+
"fp": 0,
|
| 3144 |
+
"fn": 16,
|
| 3145 |
+
"precision": 0.0,
|
| 3146 |
+
"recall": 0.0,
|
| 3147 |
+
"f1": 0.0,
|
| 3148 |
+
"ap": 0.0380952380952381,
|
| 3149 |
+
"n_predicted": 0,
|
| 3150 |
+
"reachable": true
|
| 3151 |
+
},
|
| 3152 |
+
"gej": {
|
| 3153 |
+
"support": 27,
|
| 3154 |
+
"tp": 13,
|
| 3155 |
+
"fp": 15,
|
| 3156 |
+
"fn": 14,
|
| 3157 |
+
"precision": 0.4642857142857143,
|
| 3158 |
+
"recall": 0.48148148148148145,
|
| 3159 |
+
"f1": 0.4727272727272727,
|
| 3160 |
+
"ap": 0.2786054642779789,
|
| 3161 |
+
"n_predicted": 28,
|
| 3162 |
+
"reachable": true
|
| 3163 |
+
},
|
| 3164 |
+
"growth": {
|
| 3165 |
+
"support": 11,
|
| 3166 |
+
"tp": 0,
|
| 3167 |
+
"fp": 0,
|
| 3168 |
+
"fn": 11,
|
| 3169 |
+
"precision": 0.0,
|
| 3170 |
+
"recall": 0.0,
|
| 3171 |
+
"f1": 0.0,
|
| 3172 |
+
"ap": 0.02619047619047619,
|
| 3173 |
+
"n_predicted": 0,
|
| 3174 |
+
"reachable": true
|
| 3175 |
+
},
|
| 3176 |
+
"inflammation": {
|
| 3177 |
+
"support": 40,
|
| 3178 |
+
"tp": 24,
|
| 3179 |
+
"fp": 60,
|
| 3180 |
+
"fn": 16,
|
| 3181 |
+
"precision": 0.2857142857142857,
|
| 3182 |
+
"recall": 0.6,
|
| 3183 |
+
"f1": 0.3870967741935483,
|
| 3184 |
+
"ap": 0.33143872754653164,
|
| 3185 |
+
"n_predicted": 84,
|
| 3186 |
+
"reachable": true
|
| 3187 |
+
},
|
| 3188 |
+
"instrument": {
|
| 3189 |
+
"support": 79,
|
| 3190 |
+
"tp": 79,
|
| 3191 |
+
"fp": 280,
|
| 3192 |
+
"fn": 0,
|
| 3193 |
+
"precision": 0.2200557103064067,
|
| 3194 |
+
"recall": 1.0,
|
| 3195 |
+
"f1": 0.36073059360730597,
|
| 3196 |
+
"ap": 0.6876621377294262,
|
| 3197 |
+
"n_predicted": 359,
|
| 3198 |
+
"reachable": true
|
| 3199 |
+
},
|
| 3200 |
+
"polyp": {
|
| 3201 |
+
"support": 58,
|
| 3202 |
+
"tp": 34,
|
| 3203 |
+
"fp": 26,
|
| 3204 |
+
"fn": 24,
|
| 3205 |
+
"precision": 0.5666666666666667,
|
| 3206 |
+
"recall": 0.5862068965517241,
|
| 3207 |
+
"f1": 0.576271186440678,
|
| 3208 |
+
"ap": 0.6078428199920347,
|
| 3209 |
+
"n_predicted": 60,
|
| 3210 |
+
"reachable": true
|
| 3211 |
+
},
|
| 3212 |
+
"pylorus": {
|
| 3213 |
+
"support": 84,
|
| 3214 |
+
"tp": 34,
|
| 3215 |
+
"fp": 4,
|
| 3216 |
+
"fn": 50,
|
| 3217 |
+
"precision": 0.8947368421052632,
|
| 3218 |
+
"recall": 0.40476190476190477,
|
| 3219 |
+
"f1": 0.5573770491803278,
|
| 3220 |
+
"ap": 0.522771057491155,
|
| 3221 |
+
"n_predicted": 38,
|
| 3222 |
+
"reachable": true
|
| 3223 |
+
},
|
| 3224 |
+
"rectum": {
|
| 3225 |
+
"support": 11,
|
| 3226 |
+
"tp": 6,
|
| 3227 |
+
"fp": 16,
|
| 3228 |
+
"fn": 5,
|
| 3229 |
+
"precision": 0.2727272727272727,
|
| 3230 |
+
"recall": 0.5454545454545454,
|
| 3231 |
+
"f1": 0.3636363636363636,
|
| 3232 |
+
"ap": 0.30692640692640694,
|
| 3233 |
+
"n_predicted": 22,
|
| 3234 |
+
"reachable": true
|
| 3235 |
+
},
|
| 3236 |
+
"stomach": {
|
| 3237 |
+
"support": 126,
|
| 3238 |
+
"tp": 27,
|
| 3239 |
+
"fp": 37,
|
| 3240 |
+
"fn": 99,
|
| 3241 |
+
"precision": 0.421875,
|
| 3242 |
+
"recall": 0.21428571428571427,
|
| 3243 |
+
"f1": 0.28421052631578947,
|
| 3244 |
+
"ap": 0.35449998722411874,
|
| 3245 |
+
"n_predicted": 64,
|
| 3246 |
+
"reachable": true
|
| 3247 |
+
},
|
| 3248 |
+
"ulcer": {
|
| 3249 |
+
"support": 15,
|
| 3250 |
+
"tp": 0,
|
| 3251 |
+
"fp": 0,
|
| 3252 |
+
"fn": 15,
|
| 3253 |
+
"precision": 0.0,
|
| 3254 |
+
"recall": 0.0,
|
| 3255 |
+
"f1": 0.0,
|
| 3256 |
+
"ap": 0.03571428571428571,
|
| 3257 |
+
"n_predicted": 0,
|
| 3258 |
+
"reachable": true
|
| 3259 |
+
},
|
| 3260 |
+
"z-line": {
|
| 3261 |
+
"support": 17,
|
| 3262 |
+
"tp": 12,
|
| 3263 |
+
"fp": 16,
|
| 3264 |
+
"fn": 5,
|
| 3265 |
+
"precision": 0.42857142857142855,
|
| 3266 |
+
"recall": 0.7058823529411765,
|
| 3267 |
+
"f1": 0.5333333333333333,
|
| 3268 |
+
"ap": 0.5920557782531923,
|
| 3269 |
+
"n_predicted": 28,
|
| 3270 |
+
"reachable": true
|
| 3271 |
+
}
|
| 3272 |
+
}
|
| 3273 |
+
},
|
| 3274 |
+
"tau_star": 0.9,
|
| 3275 |
+
"tau_sweep_train": [
|
| 3276 |
+
{
|
| 3277 |
+
"tau": 0.0,
|
| 3278 |
+
"macro_f1": 0.25031417561332414,
|
| 3279 |
+
"macro_f1_reachable": 0.26503853888469614,
|
| 3280 |
+
"micro_f1": 0.3550407013149656,
|
| 3281 |
+
"micro_precision": 0.3137797454344217,
|
| 3282 |
+
"micro_recall": 0.40879596250901223,
|
| 3283 |
+
"mean_labels_pred": 2.0534090909090907,
|
| 3284 |
+
"samples_exact_match": 0.0375
|
| 3285 |
+
},
|
| 3286 |
+
{
|
| 3287 |
+
"tau": 0.3,
|
| 3288 |
+
"macro_f1": 0.25031417561332414,
|
| 3289 |
+
"macro_f1_reachable": 0.26503853888469614,
|
| 3290 |
+
"micro_f1": 0.3550407013149656,
|
| 3291 |
+
"micro_precision": 0.3137797454344217,
|
| 3292 |
+
"micro_recall": 0.40879596250901223,
|
| 3293 |
+
"mean_labels_pred": 2.0534090909090907,
|
| 3294 |
+
"samples_exact_match": 0.0375
|
| 3295 |
+
},
|
| 3296 |
+
{
|
| 3297 |
+
"tau": 0.5,
|
| 3298 |
+
"macro_f1": 0.25031417561332414,
|
| 3299 |
+
"macro_f1_reachable": 0.26503853888469614,
|
| 3300 |
+
"micro_f1": 0.3550407013149656,
|
| 3301 |
+
"micro_precision": 0.3137797454344217,
|
| 3302 |
+
"micro_recall": 0.40879596250901223,
|
| 3303 |
+
"mean_labels_pred": 2.0534090909090907,
|
| 3304 |
+
"samples_exact_match": 0.0375
|
| 3305 |
+
},
|
| 3306 |
+
{
|
| 3307 |
+
"tau": 0.6,
|
| 3308 |
+
"macro_f1": 0.2504934356628174,
|
| 3309 |
+
"macro_f1_reachable": 0.26522834364298314,
|
| 3310 |
+
"micro_f1": 0.35604395604395606,
|
| 3311 |
+
"micro_precision": 0.3153503893214683,
|
| 3312 |
+
"micro_recall": 0.40879596250901223,
|
| 3313 |
+
"mean_labels_pred": 2.043181818181818,
|
| 3314 |
+
"samples_exact_match": 0.03977272727272727
|
| 3315 |
+
},
|
| 3316 |
+
{
|
| 3317 |
+
"tau": 0.7,
|
| 3318 |
+
"macro_f1": 0.25051764287656714,
|
| 3319 |
+
"macro_f1_reachable": 0.26525397481048285,
|
| 3320 |
+
"micro_f1": 0.3561988672120831,
|
| 3321 |
+
"micro_precision": 0.3160245672808487,
|
| 3322 |
+
"micro_recall": 0.40807498197548664,
|
| 3323 |
+
"mean_labels_pred": 2.0352272727272727,
|
| 3324 |
+
"samples_exact_match": 0.04090909090909091
|
| 3325 |
+
},
|
| 3326 |
+
{
|
| 3327 |
+
"tau": 0.75,
|
| 3328 |
+
"macro_f1": 0.25046072618836945,
|
| 3329 |
+
"macro_f1_reachable": 0.2651937100818029,
|
| 3330 |
+
"micro_f1": 0.3560176433522369,
|
| 3331 |
+
"micro_precision": 0.3161723559037493,
|
| 3332 |
+
"micro_recall": 0.40735400144196104,
|
| 3333 |
+
"mean_labels_pred": 2.0306818181818183,
|
| 3334 |
+
"samples_exact_match": 0.04090909090909091
|
| 3335 |
+
},
|
| 3336 |
+
{
|
| 3337 |
+
"tau": 0.8,
|
| 3338 |
+
"macro_f1": 0.2505013821038051,
|
| 3339 |
+
"macro_f1_reachable": 0.265236757521676,
|
| 3340 |
+
"micro_f1": 0.35646687697160884,
|
| 3341 |
+
"micro_precision": 0.31688166012338753,
|
| 3342 |
+
"micro_recall": 0.40735400144196104,
|
| 3343 |
+
"mean_labels_pred": 2.026136363636364,
|
| 3344 |
+
"samples_exact_match": 0.04090909090909091
|
| 3345 |
+
},
|
| 3346 |
+
{
|
| 3347 |
+
"tau": 0.85,
|
| 3348 |
+
"macro_f1": 0.25110126100766794,
|
| 3349 |
+
"macro_f1_reachable": 0.26587192341988375,
|
| 3350 |
+
"micro_f1": 0.35736875395319423,
|
| 3351 |
+
"micro_precision": 0.3183098591549296,
|
| 3352 |
+
"micro_recall": 0.40735400144196104,
|
| 3353 |
+
"mean_labels_pred": 2.0170454545454546,
|
| 3354 |
+
"samples_exact_match": 0.04431818181818182
|
| 3355 |
+
},
|
| 3356 |
+
{
|
| 3357 |
+
"tau": 0.9,
|
| 3358 |
+
"macro_f1": 0.2545390939018826,
|
| 3359 |
+
"macro_f1_reachable": 0.2695119817784639,
|
| 3360 |
+
"micro_f1": 0.3578606158833063,
|
| 3361 |
+
"micro_precision": 0.3250883392226148,
|
| 3362 |
+
"micro_recall": 0.3979812545061283,
|
| 3363 |
+
"mean_labels_pred": 1.9295454545454545,
|
| 3364 |
+
"samples_exact_match": 0.05568181818181818
|
| 3365 |
+
},
|
| 3366 |
+
{
|
| 3367 |
+
"tau": 0.95,
|
| 3368 |
+
"macro_f1": 0.22614781449841384,
|
| 3369 |
+
"macro_f1_reachable": 0.2394506271159676,
|
| 3370 |
+
"micro_f1": 0.35183795948987245,
|
| 3371 |
+
"micro_precision": 0.3666927286942924,
|
| 3372 |
+
"micro_recall": 0.33813987022350395,
|
| 3373 |
+
"mean_labels_pred": 1.4534090909090909,
|
| 3374 |
+
"samples_exact_match": 0.10113636363636364
|
| 3375 |
+
},
|
| 3376 |
+
{
|
| 3377 |
+
"tau": 0.98,
|
| 3378 |
+
"macro_f1": 0.2065503793147786,
|
| 3379 |
+
"macro_f1_reachable": 0.2187004016274126,
|
| 3380 |
+
"micro_f1": 0.34879571810883137,
|
| 3381 |
+
"micro_precision": 0.45730994152046783,
|
| 3382 |
+
"micro_recall": 0.28190338860850755,
|
| 3383 |
+
"mean_labels_pred": 0.9715909090909091,
|
| 3384 |
+
"samples_exact_match": 0.15454545454545454
|
| 3385 |
+
},
|
| 3386 |
+
{
|
| 3387 |
+
"tau": 0.99,
|
| 3388 |
+
"macro_f1": 0.19124218130529202,
|
| 3389 |
+
"macro_f1_reachable": 0.2024917213820739,
|
| 3390 |
+
"micro_f1": 0.3331700146986771,
|
| 3391 |
+
"micro_precision": 0.5198776758409785,
|
| 3392 |
+
"micro_recall": 0.24513338139870222,
|
| 3393 |
+
"mean_labels_pred": 0.7431818181818182,
|
| 3394 |
+
"samples_exact_match": 0.16363636363636364
|
| 3395 |
+
}
|
| 3396 |
+
],
|
| 3397 |
+
"tau_sweep_test": [
|
| 3398 |
+
{
|
| 3399 |
+
"tau": 0.0,
|
| 3400 |
+
"macro_f1": 0.25090184690401895,
|
| 3401 |
+
"macro_f1_reachable": 0.2656607790748437,
|
| 3402 |
+
"micro_f1": 0.37131882202304733,
|
| 3403 |
+
"micro_precision": 0.32293986636971045,
|
| 3404 |
+
"micro_recall": 0.4367469879518072,
|
| 3405 |
+
"mean_labels_pred": 2.138095238095238,
|
| 3406 |
+
"samples_exact_match": 0.04523809523809524
|
| 3407 |
+
},
|
| 3408 |
+
{
|
| 3409 |
+
"tau": 0.3,
|
| 3410 |
+
"macro_f1": 0.25090184690401895,
|
| 3411 |
+
"macro_f1_reachable": 0.2656607790748437,
|
| 3412 |
+
"micro_f1": 0.37131882202304733,
|
| 3413 |
+
"micro_precision": 0.32293986636971045,
|
| 3414 |
+
"micro_recall": 0.4367469879518072,
|
| 3415 |
+
"mean_labels_pred": 2.138095238095238,
|
| 3416 |
+
"samples_exact_match": 0.04523809523809524
|
| 3417 |
+
},
|
| 3418 |
+
{
|
| 3419 |
+
"tau": 0.5,
|
| 3420 |
+
"macro_f1": 0.25090184690401895,
|
| 3421 |
+
"macro_f1_reachable": 0.2656607790748437,
|
| 3422 |
+
"micro_f1": 0.37131882202304733,
|
| 3423 |
+
"micro_precision": 0.32293986636971045,
|
| 3424 |
+
"micro_recall": 0.4367469879518072,
|
| 3425 |
+
"mean_labels_pred": 2.138095238095238,
|
| 3426 |
+
"samples_exact_match": 0.04523809523809524
|
| 3427 |
+
},
|
| 3428 |
+
{
|
| 3429 |
+
"tau": 0.6,
|
| 3430 |
+
"macro_f1": 0.25111154059197355,
|
| 3431 |
+
"macro_f1_reachable": 0.26588280768561906,
|
| 3432 |
+
"micro_f1": 0.3725112395632627,
|
| 3433 |
+
"micro_precision": 0.3247480403135498,
|
| 3434 |
+
"micro_recall": 0.4367469879518072,
|
| 3435 |
+
"mean_labels_pred": 2.126190476190476,
|
| 3436 |
+
"samples_exact_match": 0.04523809523809524
|
| 3437 |
+
},
|
| 3438 |
+
{
|
| 3439 |
+
"tau": 0.7,
|
| 3440 |
+
"macro_f1": 0.2514129752684082,
|
| 3441 |
+
"macro_f1_reachable": 0.2662019738136087,
|
| 3442 |
+
"micro_f1": 0.3741935483870968,
|
| 3443 |
+
"micro_precision": 0.327313769751693,
|
| 3444 |
+
"micro_recall": 0.4367469879518072,
|
| 3445 |
+
"mean_labels_pred": 2.1095238095238096,
|
| 3446 |
+
"samples_exact_match": 0.04523809523809524
|
| 3447 |
+
},
|
| 3448 |
+
{
|
| 3449 |
+
"tau": 0.75,
|
| 3450 |
+
"macro_f1": 0.2514129752684082,
|
| 3451 |
+
"macro_f1_reachable": 0.2662019738136087,
|
| 3452 |
+
"micro_f1": 0.3741935483870968,
|
| 3453 |
+
"micro_precision": 0.327313769751693,
|
| 3454 |
+
"micro_recall": 0.4367469879518072,
|
| 3455 |
+
"mean_labels_pred": 2.1095238095238096,
|
| 3456 |
+
"samples_exact_match": 0.04523809523809524
|
| 3457 |
+
},
|
| 3458 |
+
{
|
| 3459 |
+
"tau": 0.8,
|
| 3460 |
+
"macro_f1": 0.25163411808972036,
|
| 3461 |
+
"macro_f1_reachable": 0.2664361250361745,
|
| 3462 |
+
"micro_f1": 0.3758911211924822,
|
| 3463 |
+
"micro_precision": 0.32992036405005687,
|
| 3464 |
+
"micro_recall": 0.4367469879518072,
|
| 3465 |
+
"mean_labels_pred": 2.092857142857143,
|
| 3466 |
+
"samples_exact_match": 0.047619047619047616
|
| 3467 |
+
},
|
| 3468 |
+
{
|
| 3469 |
+
"tau": 0.85,
|
| 3470 |
+
"macro_f1": 0.2521147284648968,
|
| 3471 |
+
"macro_f1_reachable": 0.26694500660989073,
|
| 3472 |
+
"micro_f1": 0.37662337662337664,
|
| 3473 |
+
"micro_precision": 0.3310502283105023,
|
| 3474 |
+
"micro_recall": 0.4367469879518072,
|
| 3475 |
+
"mean_labels_pred": 2.085714285714286,
|
| 3476 |
+
"samples_exact_match": 0.05238095238095238
|
| 3477 |
+
},
|
| 3478 |
+
{
|
| 3479 |
+
"tau": 0.9,
|
| 3480 |
+
"macro_f1": 0.2524217240983969,
|
| 3481 |
+
"macro_f1_reachable": 0.2672700608100673,
|
| 3482 |
+
"micro_f1": 0.37433862433862436,
|
| 3483 |
+
"micro_precision": 0.33372641509433965,
|
| 3484 |
+
"micro_recall": 0.42620481927710846,
|
| 3485 |
+
"mean_labels_pred": 2.019047619047619,
|
| 3486 |
+
"samples_exact_match": 0.06428571428571428
|
| 3487 |
+
},
|
| 3488 |
+
{
|
| 3489 |
+
"tau": 0.95,
|
| 3490 |
+
"macro_f1": 0.25026831647495956,
|
| 3491 |
+
"macro_f1_reachable": 0.2649899821499572,
|
| 3492 |
+
"micro_f1": 0.3877862595419847,
|
| 3493 |
+
"micro_precision": 0.3931888544891641,
|
| 3494 |
+
"micro_recall": 0.3825301204819277,
|
| 3495 |
+
"mean_labels_pred": 1.5380952380952382,
|
| 3496 |
+
"samples_exact_match": 0.10714285714285714
|
| 3497 |
+
},
|
| 3498 |
+
{
|
| 3499 |
+
"tau": 0.98,
|
| 3500 |
+
"macro_f1": 0.2277117658206897,
|
| 3501 |
+
"macro_f1_reachable": 0.24110657557484785,
|
| 3502 |
+
"micro_f1": 0.3716153127917834,
|
| 3503 |
+
"micro_precision": 0.48894348894348894,
|
| 3504 |
+
"micro_recall": 0.2996987951807229,
|
| 3505 |
+
"mean_labels_pred": 0.969047619047619,
|
| 3506 |
+
"samples_exact_match": 0.1523809523809524
|
| 3507 |
+
},
|
| 3508 |
+
{
|
| 3509 |
+
"tau": 0.99,
|
| 3510 |
+
"macro_f1": 0.19996186297959542,
|
| 3511 |
+
"macro_f1_reachable": 0.21172432550780693,
|
| 3512 |
+
"micro_f1": 0.33915724563206584,
|
| 3513 |
+
"micro_precision": 0.5339805825242718,
|
| 3514 |
+
"micro_recall": 0.24849397590361447,
|
| 3515 |
+
"mean_labels_pred": 0.7357142857142858,
|
| 3516 |
+
"samples_exact_match": 0.1619047619047619
|
| 3517 |
+
}
|
| 3518 |
+
],
|
| 3519 |
+
"parse_success_rate_test": 1.0,
|
| 3520 |
+
"uffr_test": 1.0
|
| 3521 |
+
}
|
| 3522 |
+
}
|
| 3523 |
+
}
|
endoedge_qwen3vl8b_peft_suite/reports/qwen3vl_gi_benchmarking_plan.pdf
ADDED
|
@@ -0,0 +1,212 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
%PDF-1.4
|
| 2 |
+
%���� ReportLab Generated PDF document (opensource)
|
| 3 |
+
1 0 obj
|
| 4 |
+
<<
|
| 5 |
+
/F1 2 0 R /F2 3 0 R /F3 4 0 R /F4 5 0 R /F5 7 0 R /F6 8 0 R
|
| 6 |
+
>>
|
| 7 |
+
endobj
|
| 8 |
+
2 0 obj
|
| 9 |
+
<<
|
| 10 |
+
/BaseFont /Helvetica /Encoding /WinAnsiEncoding /Name /F1 /Subtype /Type1 /Type /Font
|
| 11 |
+
>>
|
| 12 |
+
endobj
|
| 13 |
+
3 0 obj
|
| 14 |
+
<<
|
| 15 |
+
/BaseFont /Helvetica-Bold /Encoding /WinAnsiEncoding /Name /F2 /Subtype /Type1 /Type /Font
|
| 16 |
+
>>
|
| 17 |
+
endobj
|
| 18 |
+
4 0 obj
|
| 19 |
+
<<
|
| 20 |
+
/BaseFont /Helvetica-Oblique /Encoding /WinAnsiEncoding /Name /F3 /Subtype /Type1 /Type /Font
|
| 21 |
+
>>
|
| 22 |
+
endobj
|
| 23 |
+
5 0 obj
|
| 24 |
+
<<
|
| 25 |
+
/BaseFont /Courier /Encoding /WinAnsiEncoding /Name /F4 /Subtype /Type1 /Type /Font
|
| 26 |
+
>>
|
| 27 |
+
endobj
|
| 28 |
+
6 0 obj
|
| 29 |
+
<<
|
| 30 |
+
/Contents 18 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 17 0 R /Resources <<
|
| 31 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 32 |
+
>> /Rotate 0 /Trans <<
|
| 33 |
+
|
| 34 |
+
>>
|
| 35 |
+
/Type /Page
|
| 36 |
+
>>
|
| 37 |
+
endobj
|
| 38 |
+
7 0 obj
|
| 39 |
+
<<
|
| 40 |
+
/BaseFont /Helvetica-BoldOblique /Encoding /WinAnsiEncoding /Name /F5 /Subtype /Type1 /Type /Font
|
| 41 |
+
>>
|
| 42 |
+
endobj
|
| 43 |
+
8 0 obj
|
| 44 |
+
<<
|
| 45 |
+
/BaseFont /Symbol /Name /F6 /Subtype /Type1 /Type /Font
|
| 46 |
+
>>
|
| 47 |
+
endobj
|
| 48 |
+
9 0 obj
|
| 49 |
+
<<
|
| 50 |
+
/Contents 19 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 17 0 R /Resources <<
|
| 51 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 52 |
+
>> /Rotate 0 /Trans <<
|
| 53 |
+
|
| 54 |
+
>>
|
| 55 |
+
/Type /Page
|
| 56 |
+
>>
|
| 57 |
+
endobj
|
| 58 |
+
10 0 obj
|
| 59 |
+
<<
|
| 60 |
+
/Contents 20 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 17 0 R /Resources <<
|
| 61 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 62 |
+
>> /Rotate 0 /Trans <<
|
| 63 |
+
|
| 64 |
+
>>
|
| 65 |
+
/Type /Page
|
| 66 |
+
>>
|
| 67 |
+
endobj
|
| 68 |
+
11 0 obj
|
| 69 |
+
<<
|
| 70 |
+
/Contents 21 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 17 0 R /Resources <<
|
| 71 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 72 |
+
>> /Rotate 0 /Trans <<
|
| 73 |
+
|
| 74 |
+
>>
|
| 75 |
+
/Type /Page
|
| 76 |
+
>>
|
| 77 |
+
endobj
|
| 78 |
+
12 0 obj
|
| 79 |
+
<<
|
| 80 |
+
/Contents 22 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 17 0 R /Resources <<
|
| 81 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 82 |
+
>> /Rotate 0 /Trans <<
|
| 83 |
+
|
| 84 |
+
>>
|
| 85 |
+
/Type /Page
|
| 86 |
+
>>
|
| 87 |
+
endobj
|
| 88 |
+
13 0 obj
|
| 89 |
+
<<
|
| 90 |
+
/Contents 23 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 17 0 R /Resources <<
|
| 91 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 92 |
+
>> /Rotate 0 /Trans <<
|
| 93 |
+
|
| 94 |
+
>>
|
| 95 |
+
/Type /Page
|
| 96 |
+
>>
|
| 97 |
+
endobj
|
| 98 |
+
14 0 obj
|
| 99 |
+
<<
|
| 100 |
+
/Contents 24 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 17 0 R /Resources <<
|
| 101 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 102 |
+
>> /Rotate 0 /Trans <<
|
| 103 |
+
|
| 104 |
+
>>
|
| 105 |
+
/Type /Page
|
| 106 |
+
>>
|
| 107 |
+
endobj
|
| 108 |
+
15 0 obj
|
| 109 |
+
<<
|
| 110 |
+
/PageMode /UseNone /Pages 17 0 R /Type /Catalog
|
| 111 |
+
>>
|
| 112 |
+
endobj
|
| 113 |
+
16 0 obj
|
| 114 |
+
<<
|
| 115 |
+
/Author (Endoedge / qwen3vl_gi_unified) /CreationDate (D:20260906112653+02'00') /Creator (\(unspecified\)) /Keywords () /ModDate (D:20260906112653+02'00') /Producer (ReportLab PDF Library - \(opensource\))
|
| 116 |
+
/Subject (\(unspecified\)) /Title (Benchmarking the four Qwen3-VL-8B GI checkpoints) /Trapped /False
|
| 117 |
+
>>
|
| 118 |
+
endobj
|
| 119 |
+
17 0 obj
|
| 120 |
+
<<
|
| 121 |
+
/Count 7 /Kids [ 6 0 R 9 0 R 10 0 R 11 0 R 12 0 R 13 0 R 14 0 R ] /Type /Pages
|
| 122 |
+
>>
|
| 123 |
+
endobj
|
| 124 |
+
18 0 obj
|
| 125 |
+
<<
|
| 126 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 5792
|
| 127 |
+
>>
|
| 128 |
+
stream
|
| 129 |
+
Gau`X=d.T0P()#dW:7\U2++*X+6+`j,AAuMHUh,?rR)8u7A*1<NCt\(WRf)WDkG6)S0UBe:reS:2G"TZQ'IWTQNu5P3rEd?s21)+f=1,/XhbF0h/8TgCGrg'RD$.ZnbGU:io5KdRIt^Ip3bUMR-#6WCO>Pb#J/%"/`(EqP?WV#qMoGLdt.B)hdEoB>C8DdbZauEo?)R-hS!R\:4s-H*bUaK/%-3r\4_,C&8,3J,Wp]p@@e6S+sLXaVRt9/Q0u@s\"D=?T95;nHB&I#png,XYL&Za]3k/'TTs5_lanJTm^(g-^!J<RG`d+O>ILCJNp!X23=\^uk\bSr@38j(!7!FE_Q)lMcO2Sc$>eWK$u:T8">6q"Zi\]qR:`uj0^XZd3jXpjS$s_#4QNcH,E!AAqi%IsJo1(,ai8VXgYmo"l5ZQpSJ`Pq5Sa5"T6QC9$$CuVZB14Xp_l_T@3C9nJE;)BnprClfYugP4$1Q/;'\r=ar+h)LeRUobVNCe4O2k)dsY-5BccdI2c5GV0.TmPfe,KC_-s3''.fFX*nZ7u^(etX*Ho))WMms!K]u.G,-_`JN7Wo"[]U8qS%POgQAfGgEDCo?@E"*ZYOXAC(u=]&P<H)fhQDR6HH]pqLAdYBp1dSGVSB4I3ek1U+54mpqhK>c)s)Q";m*=!.!3lLpi'4hC^7\jB4!\jj$5FmkPS?sgGt[Sa$LI(FRA/A)PJ(pZM5`,6o%B8kA$TkHbn4rO,<5hp?I('cB%pXrU\:g>K.mo^bO"Yo2cI^M1n(8ZT&(2prCGTqN^1>Wn:D5Ch0t7Dp(@>:m-"^',N[^prss8+)]rLqW[/2Dgo:ngRF8mDk?$m"M*7BnG%G[GQQcKqKh`N=`sb3h#$F7I26a1&RF&%A^&plSG2\^:RqAof5IrC(XZ9^c+mYonV"TCqV8b45B)$8'3@0HcWLKo9R\[VqL=h,UW@Zq:,iad$nX%cR+]NJdUp?;q$eLSa<q!<[u%S%2C5oZI0CsA;s#N%3LgP7,cDhh]d!]^8g.B-).smcJis?#]2&e@(7@UrI*gN80;-3#4O[L2DQt$[!i$8>`+?9u7DTA[HLq3BX9@2-6X9!qh/Mu:C3Hin[5?]0]])ggnfFa?n%=NY7%=%HG3]NZBA+D4?23^Fc8=)A/HEh]iUoFn^J?(.^iThekR;j8O3ZX%Zp8gToc"o9%bgbuOFB-@AhY4#hp%hQ%gV@._@n/#)dI4F29t+;R$uX<Q%?`<-n`:<8'),]$kpBofJk\g&`R@*cN4nGp'3WaE5ZOCT!CM9$S'ek"`VT\Ah7I@&P$",c0W6c_U-qP"+n5nof,71"XE@g'XV$-RdSkCM=;ZRLng3X_pQ2=]h/o+^]@De2.1%p6jb/a$6$=)C[>s/n`TrOm2+p=Y2OZ7]jt_,R?h!6lJE%V?c(ZCL7<e7<'7^<\O7a%,L?tL8Q5af6dWp2`Oq-@.$=K;#/k*UH65?Y[S?<M:Bm0l2sAtH@hV+2o*QYl#3[:S2jU>DZb-9/(4R&FgD@*$OBSEPB#BJED`iB>7m?B%XSW_4'Te8]$osD^!;R[])0<T(;JS.tGo@/h8X"aHquKIq-\ec6r/")^4=jp\<.L[b[[V]>5[98/%8e0BA.B89_>$sT'NI+MfX396!*@<*!J\[[_nee3VRC/'5R\GSU.m\o3!7Wa=E#A**>6](IC]WP2$)2e2@*/-joIn:_[hiKZ7&JGp+)5>i7d>><tn$4&Si?jU6pG2L,kfWlHd*kpY"bZ>mKLJc"C;m_#,f,[j6^rBY*Rol^A%1(D$9O1).QZ6(FG+=+d2F@OtS::&e?6%P,*p"KRCs1++>pTERHCIDWSM:'`Xu)k7\^&'mc`fL=-(fL/S[!;1'*)318N@p:)Ki)cP7:DT>\!)Se%B.Ga'J:Yk[Vjf[->L@G*E9!qC)P6*FNn:&n*!%Y(C?`7h/cSZ@r(lV<ooV(,$1]]^2n2]Y,1LF2G!+(Pj3i8_;m0s.r&'YMjO^e`pABGF>RrNE3q_?1<eHNS<LpfY(jFF<)TB("6mBCQWt.\?ol9uF?-Vkt<r9Z`\STmbI5!^bJ$YJcFNq&l-YSjU:"C2WiTRe/c'PH6T6D6BGicI$AZ#-KC>g#l<OJ4/`\b)j4o\>1H<Zf;(:.)N*!hj8^C^l)J7u?o(]E<4]pQS)A%`/L)1"#aq%LGl;"<<5@_Pqbef3HCZ9;I>$]+4_:B"\5^R2dWk@pA>H\(X/(pd:m(5FVoha>?_$1haW`pDfJ'Z8Gm@"r.7(TRf2ai_iPV9H47SU*$0@E`%fW`o>4r5IHFT>t6]hY+3PGg7;*q"O'l>`i3&Y(*DJFDgZu[KkJ[]1lX9<dt*u[7O/8ORb6?KVpOqG8`:l(/Q.dhBa(0Z_WWC[qV6$2o&,L\MTre.b:EsD8T=U1;D!7esY[';!R@32UcKpKC2YPpeG@o<8"K:1rVRY._*FV,qDC*-racjU/W"8M"<#)='_8#4:80?h^u:5&CD/L6jS!IgEgFKR&AO>103KI,*R4(2>3WIBfMa-=/kOf<5stcid<%!eRZXPXC1_dW(r5,au4AP[QkQ`EQ8"\_<V`"9IBQ9-6I&uUROo"&4qJG0I(-`0NUs4j'U]tY`D)U&>h+**+>jG;7O`k"##3q>fnA1]H-)GUO>]_B-'5NAR:=.in>'S")h:JrP!rkW=mK6e&+;#XbE%_7q1=0XsdeJ`$$I#lclena9gpRB!3+;Uo>[J"k#=\YZt6Bdn"/0Kj>JU5RT>EUd-&8@016KR9YZ'j9720.^,nAl^FhBrGkSumA7*K*/03X]8Ab--TY[rV51:=;lSuE,k&&$";Z6-Eo?F`;$mW8]kg`R)frF.p2st]O<t/t""LR?">[rO6AoE%n^e*&Ff^&b+`M9o#9a@fHPa'&%VTTX()Uks2I0G-;5r4Z_fN)oqO=T^_H'Ach)YDZ%jWDb-it3"_[B2fQ@fQ0,ToK'-!,$GlRX\fT#B1.IEfcMHDZ!<`7P/kRqj)!Q96)!Zb6`;..0BlEUF,lkFhl5^-6C-N<1PFDL@ZJ45nE"#8lirTD+bNAi;iZQFC&$(:T'h.[4>D<08<Gdl7Hc-3K0[Hn:[b],4%)U3;DkdOjr-(TU?#A,)GKmH_9-WoJ:2IeT#=)4DG/JZlj=8tkOa?t%C2?%,4j#N@t^HM;$nhS!8nDpa_Voq&mL0!kS*j>&>h^OLLI`0UPfP%q<B'W+K4Dm1mmBq%tS*#MT](^CfsnrnZhm5Y[DC69=?F-M1AMS9OBD-miWeq05dSF3%b/MU8.ZdWW'#+VqFi.0ia'rkYmD4X/<*eH+FrCK)25$D6U"V6<mr#JF1bmJ68+9q_=;Z0+@*,Qfk^r'o>bqEDr%nM!.che[k)B)f3#=B`kS%k]1J#k1[kZF6Cq[biYPe3(I$rDq9CS5IX:1CaId00!G>T][%-1NcJ__HaNK)D`:r[sW.c?%oEEfecr#HJI\?K_\*?kIBJ8De'%at8.:o&iE%JI"i=b(NYneP"877_&bDI#Oo#jZ=5LF?1`,(QL6QcOf'9ihV-XNn_p&f<KI=dL-BUMNkaoY([?F<\5)[K,T(?W9:O;Jmb&^6D!VSk:5-[]i-Mh'V)2!r!XCIS2HKafQQ"'2tYf/lJRTJQ8FlT$IM52,1TIV!H7]T_jk+<\d.g4Lc(2XA3lIkAR#gj<RW.;GT0JhQf:>7[1cd[,Fq7napT_ef#)?kW\g$]\h5ZZ&@$BgL9s-Uea`e)$bT%G)M/RO1qG[3%;^Ab`_urp/ki0UrC<Tl(4dO=,Rkqoh=?E_\)`1GG6V'Ga8pH.`[Xg'A.fQ"%l)`."*l?bAPIt8kcZS$4a@E#=?OJ7hLLLdA4V+iJ6]mt"5ng)jcO#.]'3j!fY?3Sb9O(&K2?,-)'L[iVY5R\OOeOXHP!DVWh%o<gtK;%V7JQJ=KoCMAUii[h\1>'SoNGdBgYpq(f)@/fSa6'n!6D)LV(q[:#4:j^il;l8[PYtj.;kl2:`.5E'5FaG?L4VC&e_/E2JYErRC!`F(tLE@-:<]D%C;:XQsLZJ!J"l/K)?UC]0sYF2:q<`.1dsIO+NO\N#(c-M-CZ2$Z4K-Cr9V<PIiok,q#lB#8!#4puG[=j3Gnde)conJs!Nr,Hop9D01+l/5QdK$bNWn\4Fa^R:SCrI7MuSm?(fI;=.PMZh>_@-_=UZ7_6d:!3RCXopMpk&mh#MPQ9IFrX^k+fp?L^j*>FXcBt/HdR[boZT#@73EGB*!S,-@K;oq(.hd0W8bGoLik`,6OD-_1OYNaV-?pupGCo!Xdc2%WRae/Hf<K;M/ZI:0=c2gYf;6Egd5=Vr.S0K1=OY8Ahks*a2?*$0]0dRjW7o+'sZ9a*P/,QO*M6CO1Zr0YNu6:,cok=j-,d'SGl+<&s:gClYN,@,SU`n!?M>rjD3Hg7)7G[X,uJJaV-ofJ^M-3?f#K$A=NW1!5Y[:MH$K&SIs_FE1e10%1<o)aAfA>>"f2l9RNP86`SDCDan"=W'=&mhJ7Y#VeQKgC;m&\dgl!gP=c!i7f!A3Ym2%8.fa56Zu=r%<YHU`@6)#=k=^ojpHV5\Jnf?H:3f$^IO!Wh41JoEUYC1/-e7t=,Zrp0Y1^H62K%p<5dML*Guqs?c1p7$JC+ciGh*Tq.53>3"%uu\I&DBMAjAeX%.p3tdQD9H#>7GH(emqA7p@KK5<q6p]1"0c4AA6K`pN3UFnr6n=S[p9(q+c0Vc8'QanR-<$?]Jfh)5j"P"YY^LRYBAC$M`b:[6rl-a:3O@j7DrRuOhgHM?_Q<UPM(=-T+^.1aUL"k;YA*G_R=nJC;6.!nL/bPKb>qOL8_S8:4JZ-g%b/UX>kAuf"cpO-;\C:9sD,T+\<_9\:BEKf(Ua$a&i_f`jZQ2pRnOd&33Lj?9lh=A/237i,;f+eIL[,c/m4/SQsmU/Ca`YCQ/9YILLO\qLdNZKoHf^`_GHRAnpriBSu;Ch7_T8935C)4l)TKek=VJe5Um6"L(jLq8j5#Whr0>+:"/G#t<+1F>(3Jl?+HOE0+B;^U.bHS]\]l*3l9^IeF5"mZT:(A4/5&FFG2gg7E2_X3Ape$euIu'#CI1o"j5&jpuR9pcCo5F0HW`L&;.L\b>WWI$$\%ZR-qKH`l(G+E"&kHaY#oRYI6?d\`GSASVVqM6Y%ULbK<Y;bD*sA6q9Lf64O+DSAR(@LQ<e+B:oQGLa$`F2CB`Pak>HHUib&k3iP!-TgZBK$rC'u8+<@-Wp[be&#$.DtA<8h(ADG26=d9A]gZWWm%dN!?3A#-Nbn])J8imbuZpj/4l@p'FPokp8c-$:X?%U>0;T+_'(p(g$^]&DW$_V_-h%)Q;Z*uE>np8pY4:A0$@nFtFWCNS^dR*,Iq$nfM(J-Gd,o[3B!oA)7:cC)81#%Y]gL9gL`"qWNpIY3kW!I,[AHE#cpb*o=\Q.nhCPa$cYDA0AZP56h0N-G%1S.#9iJJJ$ehMYo[":>5-(:q6r5fQua4p>t4Fr]E#'-.W_;+hoBEp@cJ/#,Fhjpq^(%^N8/Jb&3D&$PR&Pj5JK4\9$.TC^UXpF;b\T<4hM`@/,qHb3KMGuOEgJDpWTl5HRBCofZn@oL2JA*<*r[4[`r>qC2'"C!c1(lSb#6aHWO[@C3V:;J;Gb+PF7#lnZ"Nlk$43OX'-!`)PDD[l_B^ol2g<o#Dt/Ogaf"t'n4mWf;U%(]88?Y-b$no.lVcglMk([EG?de%(tgPP;a.%h-s4_,+h_i/,a3BINGcnV8\T92`XOb:^/;Ni!bE<qQY"9mR)itVO]`l[gB>r8p1gAWCSr[c)fb?k)Sr^h,>~>endstream
|
| 130 |
+
endobj
|
| 131 |
+
19 0 obj
|
| 132 |
+
<<
|
| 133 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 6674
|
| 134 |
+
>>
|
| 135 |
+
stream
|
| 136 |
+
Gau`X>Edg]Z$t<.QqGo.6ffjB%.6rT9$&R+<h_R>[<>lbau'<W96`aQ`apU]f:VIP>Y0MMB3C'sp6$Bqh:(!?DgK3e$3,&BJ$`YNRsXkk")$CupFF6(_dW;3fXLUYIXb@YGW=V#<rKYhpjlprB"6Xj*$>/@TkUe0&[1Bj_sPh?!nVO]jhc.&i9Yp1AtO9&[HG;PRKq`Smln$j/Yf4\(8k`[k%l3iBY>#R;k-%WD'DmQ/]p!+30?jGR?fcj_n#$FB(s'Fq`c8P4aO75F99W)db>\al<S?'(@]HTh[;OS(_>7phn:d][X49_%,6eNEn>NgL:Jp!/2Y'.[tK0Tobf%(O9MZL/jBUMdgdC[-k%'MjIlf&ZL#rt*]%WY"JHjW#lXoAJBp.r//B-rrZ%asEt!6,Q>A.:jZKS9<c!u0/FM.[MPA8TZ8\c/,7M+@;QgrV:pi:JGQVu*\]*Of%]F_F(U`Yji/0-FJRLJ66F<0%-!SMik*n>iM_^=F_ebHk-YY0b=qp:Xf6;$]b#kP&r%ZNt/SK!djm:I:J,K6DNeql"FqUCOMSI#a.+sqb4A$.c]9bt^QI1pn&iBbIqp'>TqU_%8)2gFm>62\,_2R9&1>*W?SLDWCq^!lS/7ek7j-rM--;JMt)J3[:?@ZBphs\$0s80,NiZ'"IHJZPTKDd!WGR5&)dZ_mWQ8usD_1%Jc\X#5_!pj$dXNW/umNl*(=d]YZ(t^YN"2BFoJU3h<6%j6h!h#hrr01b!.!W4]UGZ9<@`Pc2fs=\MD:ipQ)2`DfYF4TB)Wb+!d.:=AQ*\+q$Y+d^=Q,X@E/mDu!UF]iFeChuS9Z%UGQ:c_[=?S1^<^t=,>smXkd=9SLrr=80VK]5J7C$9QE(kHgL0L"#8S+j:b37$BWC?0-&C@qN<^g9Oq<<MT)]PJTAp!E*g_l+gkN^L,H2a91V1=4Rr'>g_9@F$TGSJ\HB,huB,/E2N'(*s2N/Qiqd<1h$Ec#&Q6VN(BcMt_rU%cmImAILEUi[E<8MJ>nZ8B2D^2(93W&tf,))N'OLa.(6IU)1*!-4WqMuG%$dR=%TnFau8+MrR(8.^8)5Onl8.D1R,JB)^=@GX4^ElHB:H!D^0OXfO2BrT&)\2#Jd3FCUjVU8p#.J+K]Z:LJ-`@o?&lF0F[N#a3O#_4_V;>F6a>8FpF;b`gPjBYP(d-fu1*JMWY'!Zl/9licH-K,L:3UL`XuU)%`'cWaQ>CQY[N3i#g$3.%NiTuB`uY]M+fp33l;AR(k)^D%%(q"XjlM&;!J)qT+C]<1Khq2^kkt@koD:hkBp7CDpi6l?Jg;*P13:=_-PJIM']PX"qlOA_G7YoZ719C@rE>[O4MZ[7m+0\@2<0'D0^c^PPdt4kOFh8j[$p6X%gL(f<L^R0)RdiV`]$&YS,%#:ga0@BgQl80DW%u[LLjR\I5j4SHJ6k])dG#?iV/+q2;a8hT4"oUSmu$!4NX.!hQ]C>=N`#Dmc!h`<bJ#-lV^R</@"!@lrB6`**JVB\7XYXeeJ=2B3U"^EM([WbmgU(m)Gq_n!eH<ADF/k8_[Xb&;Q`h5?O6/=k6tsgo%N9+8D)\gK49:rks45IQan).>ODK]E^ga*i2TCo;M],qIWJq+in,s6r(P>3(GV`lUn=XlUkWKB))Y2UiQM$2O=TsTU3?,1:[e'b(<l0?_+7)WP:Doku5;bY0s1rkZ?(&I\fd9^oo<8\_=6oBt&PF)(@/s14BE`LG)jL`N(tM05#Y>bP[_(<!fVcb76CtecgigGMMqrFsq4mLPa0f3`5.*p'g?oAi"GalQsZhd'u;Sdm!7KmU![%e#%NqJ't3B.8SWaVs[ZMV2q\lEH3sKfoE4^4m$36_5AUn\?PT5\UX;#:S7>77>4g@."05kG:7=^Nak&B'fHOZ=EP+o`]Zq`pjkqTf=Tb33ngK&eoZ5"7Dg:<IK%jU+Wlu[-m9`_d(9:%OtC!Hh_AUh'Ip1*/4W9Ek+6QGbLUeh=9WSlrOnrtFkOqbe%+CJ4M8DDd\f8#1Abf>e#%MNqF[7P/_j$Ljp,eTe+Zg#e#(qJY!4X[3#8]"R7i*8'V\u<^5Q!QSFInCl2+?oa^p`586;"3>]:t3$*SLtIG.%YEisR2D9B>,,]2P$D>7Pt2NHjA=M\regl:shIHX/ZeS_0W]8ukM(GQ6!lSNSg$*i4*[%*.I9I4j2$X))bos@:$I>;1u49&%,\P_V@cTi.:-Z.9ciWb]uC>-S11TmLbcDujKglEO[g8,Z[jWgi/T4Pk"f=35U3;Npdp`'/*gIP\3j\fTK$3#Lh36b2XI)@QV*:Wq+!.8Pd4KgsLhjOStm16^E45`*s!Vk4SfQM`E^,6"YeK9<[blHr*!VhBO@lo<&;?,E659FRDmG%+]\*YD"I/u89^M>YCmFXBT"2ENXXLfhEmZ6'"/lS;Z"ZAT@=UA83*?.Z:O+:&!Il$GETmi[Ah']Ag)><=_':X<XN.;-CXQ]LT8f2C3TkTO?gHi.U2Wl&;p42b?D+:au<1P'0Q?gf6:\=R\1em6uTY;sgqL\ttlt)%&a$e2d!O`M6O>4RP\_'GB^L0iArFifko_U1jHad.`hk$L!SHX;lp(gL%%nP)g9p3d11pY+Z,I,%EYtcEqC;,k#\1DX4IW?sWfh*ND4JmnY>;3Tn<[CD#h6U(O:"Ybq5/VGM"uI'0<Qc]6);H<ib'>3pnGSO4%Q]G;1'?>&NWHi2N[DYsq!<7*\LEE9>XWpR5/Y`GV+\@V;n4a;:UE?8XAJ7\Ml9^W$!5G.-]JR7I6tXjUdAIed@N5$PTUj6R+dKhZL?4if;T%:'rCI%CqP?-<@a7MC2#$I!`nL[*Zq4^pde7)9R,bn6m^#W`$5!lFaDje&$#(H>Cqqa\<>V@pL2*Le&O?65huYEd+A_<h$%&ccXof'1Pk-8dcZ4m^,m11[Tf/07otq+q2)I@[W/nQQjstS16+s\\QYH!&_O265Np*D*/NJEiltl'X/qPe"34>sH>`/<+tq[hP?6S,WL>Pgh3m=%*O'uNN]jEFq0EPpTpG!adUHLi.C94E``eI4A>s*8EZDRPVI78U\XgUY;PJ"`D8ff8J\a]UL67&DU[?($Gu+Ys0KY)/W(6Z1"l::&Rs"HS"r6K>gbtk1Lt6Sk<1&5mJWEEq_;2AYY=`58lG:eL,SjBXqZ-gJL]eP`^h0%451T@qJqmjb@jMZ`kW&3D?pI4JOb#>8-6n]9GUK(qJ_D5R4&4FHffdf?LFWEJ(=FhEDV']r!SB'o)X>\X;\KX._tO&U]e.@-b+isFgk1<6@p1gfWD!BY2V%PGY&K"+Q5[2M8006!aRa8Jdrhi'#EF*"I=qFjD+.;lNkaGZ5>3#FT)D%C1FCR^#2snJ8$&X)'Z_pHV*<-iCZDo.l4Y:r^iQ`dh869;hoCd9I^I<Jeu)62qhF8q]WnmD5/qPTgtF*lq>@bHgIkX(.Y=ukX$>1nRlrt,(VlMN6>tN&mpX`PWVd`Th\qP>[1a"Aj!LQt`gi5)U"rPGR7X%5A58+i3Qf5$BNTFn@J1B;e)*8)DL)P*(X:6DHFNUE0,(Xp"k4s4\6Qp4TThH)G#_3MB1tr?o)&'>d8CD6R`Qc.Y/MVb!Q>o_[hbi:oI:6t-R6uiaK-0K-(:2[`GkIcntG#ehURA0Ok'k5@M"E)c8S",O+d@haE(LMrsNU_q+0i-7&H%,H@ij.B?Wf29!O+3G2>pX@HL<?QJ6r-DL]WI%NOn17=1K'L7ndGWheCE7Cjlm+bX\ME/5(6",@.j4)fue[KBSRKI;$^70jpSCC?Z](RQ>]Zf%;V78i&N3[+9YrEb=,DZ<4C-f`6)<cq2I]+s-VWYU<)K5U0!CV2[lkFaFi!d(+#9M(eo0kg0e6`<CM`/c>\GRgbgGbf4#b8hd-D=g$o,K+:1#Zi3;9ZdT]jFg+tDmtdFD[u7K>aAt]r='fZq\g9jn]]i?iQua#k!CJ7l!PKrEtEW*!b<d-@!bBJ$M.h&-s*9\i[C;J(eTQ7G!O!fB"m4;ET.>f;Dg?6'LO#HJaJgW(#l%EJo-]DQ1f=lE3As?elENZTFi6AK-7MGFt?j_1@=Q^+BRn@-Ec%Zjk+LJ*e7ok%b"Ig.bIQ1dn)Xfc,Z*C<-T`Xb%*`o`'j\_Q?f(`"*S<JkMc(:+NX7C,<4ch*oeES!OqG]6'=Os#$u]ld\_NPD[id0i5T@oNq&f's4X3=1^fg-W'Z)ZX'CgKLcd:(DChAJS7&"9bC7YJ;)290OVi<Eg1h=T##boTW>jK'orJX)U3&e=5+UBW%*rsN6>OkRoqjKSoIT!cD!PMQljBV$3d=[F,cl0JE>(sH!h`qI0'X,%]jGV=?2F_uFWFT&QEUpq^`5Y?h(/1n"I.2`BK]Bb8Vf(RLlucVN/cI*G_#(\'@`KSDqP^"DP'Zs;\_0iZor+qY]F/rSZu/uq+WJCW.K^koJn-)5,qgD*bJ>1@Xn3s#Ytu7RjiX-Dm_IJ*c0Rl]Y57F79<1l./e_si<1/9$jbVUblS=U+tKDG'7@sa4eI&jH$BicjlZ%o*]%/98bTYq4@X+KiYc571Dh51!'TS#Zlpb9R^Xke/0Qo*.NTl0/CV4q'+r:?k2=q;<_QI.DiZ[cQu?8Es'.h/W5,-IhZ]':5KS>eVa0!+Xi%LNQAsJCXJ:$chPnu^kTVBLRnMPP.<*m)&B4LUpg#O<Y@?4]l<F;8jFP'4q$BOgG_sG0B'Gg4;+#Js5Bg8V\dMa^8`L&:'hMGtfSsUI[_!.&f\uiM?2<u9*9uVq>\.r'.g2q%-Xj][a)'3]*8be>`-Rto>chf@TC*"\L]$h;49Ia+cI_e!h_b<$Q3<o,\"Km>3Y'4Pe7MfYFgS(h>W?'%glOH")`]#q/(Ts(p=gb%_;e9!W'Rq-3B%Zf)O]1u#%*3UhIKO.`1<\.f3JF5Sh[LnrU<Q`.h)pP;te\P?ZU)gQd&-lL_kRqS^rUEhDNsqLSel5>Y1EZq^K\dJT:S6V@+QfG($Er#!=!X[Fbon[8%L-f-_8gQh@=Pj9GJ1VYri0C=@U!4tjgMA,?+NKnF,=\Ud)TBceaf?`?k=\d&R"NA1"%/+bTKH9n6g4B.fm%2>g:qh6)k:%r3?H4as5>ELd9kR#tm,iREQG'e+R?4IdsSN7".0>NOe(0RMC40WhpBFdnq[UWr,W_*&?LPD-13XO*.:=+0\J(P(]%NOK@mD'mjgC>4_]^<KL3:BH$7WDb%B3X/]^;(/t3h6u1Maac.fRoX$Xh4EeXm-NcN&?r!8MEGi3mq6Eg3+Vf1$ak."KTnG6u5m)nU`?m7k>)/dPrlVY\Yqu-^i6nW)45:&]GF5@%6Lcejs;*Dso0T60aHHO.l&rRNL`jnNSF"3Kte_ld<pgrDL(Ae8&FZKksYb@TNQI$mdcb*Yn'V7aM^\lE5l8:>j4CKt0Qu!h5h2a$RU0#5a]/MY=/kV8s`iM)[CNYSC%OKSd\#6&f"C&:WZ"a!$W(I(%_:8e@&O-WroW9uN4M?m#8:<$Fc&&g#V/Y+Ag(HVZ:Q/*LltlnY?=a0-[:l()V*rD"%9H3n%*\.*ZdXXa[N#8j*bM&\Wf_";?V6hS!u:jE<;N?B/3I-d8+'TIZdm?3>]gf.<DP%R@mTg0G,gf,K#$s2GA<3os].[5U4GM`O"$V[Q"lF%LQ<<$aI7p0^t=X"Q?^eatVQkNdQa"=b2Z^nuk:l_!JPI&RX)o8qiZeL31rc;_cfJ/EL=I'!So,EjXWte)ZYR?<8KT&KtWToFuCkORiAA8[ohOJgcN?L3L3n,7&*RtjUPF^@8fZS(U^;cWua8]>ZFj-B8@BfQVcli84PYfKYDM#`g2cWbqWm/3^-*+9l&Gn0Yo'X,.n(>,61A_9*A\B&!$fn10GYQJQ$LAbik1OZq+#eAG(H&MQoN+BuBj/%ZPG^n=>n$bN:tUZe1!>lIUlMs&)q*8B&Vc52!-D;o)/Sp47s3&X1"]3jdZM^ANQnm@gps'oJ3pJ3E=e:,,ne@$OK?6pa28;7L;A-CBs%-N69_8fi!D/1,FG?:)Ha%<6+24(D6^3G=Kp<%1CLS;\E*e!<b<JuVMgpMh0GB1<MJkUJ3,<a2N.FU#`BgZUmRP!>!j`2-E8`6*)NDI^on;2Z%oo>7]Umafb3WRdVJgX=a5JN5Z:D.n4[R9VM30IHLp.uW%VTSS@V&II)GWe[T%0e$.E&9EKE.5b'Nq[^%_!$U/%?:R\6RN45>#YJSaF8&"`\*f*/.<bMq/S+?-brmLnrmY>YY&*Blmto3*2bKi!Jm07,fc;:O@\oe@XiGEm>)?sV47-15kG\U6!J(AiO3i8[gjreDKFRmGkRBs7D=X\M0qC1gP+:4,.k[,M,0Pl<s(r8-!2p]dl"R5+WrQ3;an39<Td-^P!HA4K8p[%#uYBb9k3m&<UTUO1[l[`+:d)^.#K@Ju5JO/r8S$ad2QBtY00@"Gp)M\u1O#D'5;iM2>#W)"+oGGnM(]*2tPLr$H;QHQaC=A`4rU6CFnC%YgIr$^#$D?5+J^Zu\-i(C;f)_S?\.P=dMWg'dNYUYKN3ZQ_R2VS]J>\\kqj*nGjc*$UWSr'n2qq;n-KM'm=AVINgEtXA1+gpb%rE>\1Z)4[iqO$(CpM5[H;3(oI`#AuiO=%qc:ThmM.ND2ce9W/W+_`K8G\i0G_)U9*T=KZJc_#jc&Q0hMpec_IbRSLZBULqunmns'+7EEp?2~>endstream
|
| 137 |
+
endobj
|
| 138 |
+
20 0 obj
|
| 139 |
+
<<
|
| 140 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 6705
|
| 141 |
+
>>
|
| 142 |
+
stream
|
| 143 |
+
Gau`XCNJ6"QMp5Yd8aDMTk?n%NAp6nXca]-UQ"TmQBKqGC29k=1eGV.^n:_MXJu0eHZ%jq&gYFEZSN=hGkLIE\ZaJk`L2S_F8bQD`RpY!G4pqPDR#Zkj,W*&S+l:/k/D6lW[AiNn-uG0D`E4(fUNg3pH?R;:M4EG/6gKu]P?5n)ID?j%^TEQ`rjV)<c%F(5pl<dkP(1u%D08^Z_a1??)LP_.lLg[179^q,5W9)$au'aJpXhG[>n]61<[&;M)h,ohFi%`/%bU5oqWhYFW`'9]Y;%d_<fJEL2Wchbj`<]ZdA5mICX`6f^.QcdWX8d%$S<;b>ui0dFct@g3YQdIdn:3;i?@ZngiTV%Ek>(R*fs6GVdMYV^Yn+_t"d+E7rJ<K.NHbRTuI+cLo@-k)bSZV+&C9+pk#@jALt?OsZ>\$-SZujdCo;R\*`OXUA^ES#+moQ"NuD(.Ro+b[ckmnP-#b9TT,<SQ3iM?(YJ1<&Yc4,8R78-:r$EXpb.CV$U)DBV(9o>I_>7]V/oje&j42%qd(u%r(`[*iBNp&S7!KAA&a*9nHfBf$q.lf9'0C>UjC0@YJrk8XQM\\rKamG')^FNt:pC/s@L'QRn]6[EN6'9u@l*9WOc*XZ$3.03"01If=`?d!rU(AH6dKLkV?MZF!.h?k]868ulF*09F?IF<MeQl]$(Pdn7m5H^X+>ck8(LI^oCIj!9iS1s=Q%%:r4+cfQF/=dg0Jm!^"kSSJ\nNW\0h*Tn`u/>,b=\A:m'oq9(pcJfm$CsRc(C[h-(,ET-6$i30F>\=XJEl6tI>\4:C<SiYDclb?CF4ShpS'F=2@CbMW^lKpeiK;6tIqGZ/BCB[!;=E[!-oH\t4>9KOP%O:*3#]-pfb45rA+hAM]$+\IAoEu;?'4+!(QmXl2/]IBM;KqDX@O,?3ud]4W#9uIk5ni+DF\5IDI8\cn;<bam,AtgP>BJf,gEUf+hLJW@-Uuc=<lJ%M[H@$##uC1k!jjB5G"Ks\@Q.!@G`_r3;U5)lM`A8lR3S5mROf'nS@hs'&=K0e+]S5,"^j2p5bhq_Ym^j?aK>cR>"Nc"r#[>7/*l9ch%Xhif8'g2IObbG5?!\NL@`%2a=be_=5W*+Q^sc0K!*=K@+h5'skQojIk_VLq926(!X#K\8-&]>^p')Y&Q2#_V3*7NUpl<A=T)?>H5s/j"@rTQQJ.C\lqBueR3lTcgXZXT6<ZiC:S)^,G;HrHu,9!qr-#c(sN4feEGJlr:2eupVnbKP:2)iNolH4LF3Tb3&l&R5\;nn?C5o/Xb`kbF:cBm[?sH%N4:Fh7LZ7jV(DKjK);H@`7oA?>C+4UQrAC;4V:V-DZ<,?HEf>$+BB3Ean@a,O&V@Ef*oJoN<%/^j_mruQUMgJB@U(e)6Of-\+BB+:B'C![#uTWQ-73!K=d7G'S@4(1B&-p_<jn:o*k(L[M#iUB@L8W*Lf]MGrlAp.U?Ro]o6Q\c-m(^Bpa-,S_'&]WX!P@EmIo_K6j,\\eOVPSW&V+^;,J=fE"S$i4YtkFsp_5<^iNKPF,l(p(0hrqVLJ`M#EULnGOP,=#r0h%hC,;<3XUW;fYA,N%P/I(TWAigcRn+Q7V5HB,$hG`<pZtYYR$DBK7Vh`NIU_Qn8=?$_D#FVcf])Jd,_.U!iU3/EkNj`q:TN9EUU,1i;V%Y*rr?N%qlKGdD#;F2mQ`)C#[N*Y<:Ub[[n]Q%9fs+R&CU#=e03?Q`fK$3[C&R/Je6^dVbq*T@\;G,@tmU--:M5'[g>BrHOY.@q[sZ16,O1m?<2@;jS5_sCddG@HnAqN0/3iE%a2OCj^?#_>YjbmMZ27^r[f^/_B);t35[R+Scce1cJ:b$+M[W0DU`%.9'+hh*u-Ej9nUXsafIPZulr(bX$-aF5WN3G=N4I]:W>1",s2.$!lC\44lU"kOS'2&9-l5-l*A6#<8fLr'bJ7/;!6/\I,e'Jh3oBX=_/Xb[p=4_'Cj/^@HjnKeim8X_s$Z+?/J6lhraX1Cf9/S@ocdsLcD[J/#/n9S)S'#AZ1X^r/9mp.u3<_bHgQ_/.B:<LFIb]=,f6`F[#U]^R9--7BOCJlf+bN3J50mk#?H]JDNCUr;3gJL1f!4]0E(+^7U$qh2Q`=0b<>b"t*@"ZmcLFgkf:mtt'>rbJ_3P5[";:L*sm:&m$+=\6?T-HP?MWZF@dZe-'8SBuq9MV8;%8)ap5,=.-&fK$d*?&bUhd<-WR?Z'K,_DXk#]r!/TOe<P[\+lU%GjVG6&*9SX%c1ZM*Cre!V)sPLZ-ekH#!-GG@52\R;"ROs(Q_(`SfO7ogY`ZL'!/Mi7]nSaO@P^!+60/!RpOD^M=R'a.'ph[(<uF>8GG1COL0B-&5=M+M+q*CPh8D>C37(Z;6KBf8tK,g04SRSb=O&RDeY;%_d&YV>J4?M)(mpE!3Shf0fr:c0o$kToM.'eot>,!HBW4,fa@C^1([IL?GJ[ded_/V*F[-k=<eGN_&C$>P@2D-eIO;6-\fl7n;dLFL@:"p&p)4jN(A!:=eI.aH7F"9V*KE7fnR9NF5eCW":9DUg'ao.8trVX#.O\8#;X+2gHc$pUu@oh.`B$0nC\SH'=%AB'&n3YD@u'D::[IS&@f4lQ_mOZWH6-7[bpSLa&JlI"hW[+hChmG6Xr=m&m3!d,VHeDX7&l#Q4>^!#K@[RZ'X)m=5I5mM]";q#an8pS]1mp$O&02NQ&^_,g<(^/7*)BQcF4ol^5[6i,/XW3>NBNmiE0X87BaG9>bCIUMjF@C;Za][oGUEN0*\L?k6:Og+]dj?Vi`OrXL(DHI$KW]_rWU;\m+8[*sHdKpXp!+=rXYAK]o_n:rOq*D19[,!2*%WTIVX*YBb)B?^%9?9[4KfDAB?@EQo>]YaDLY,&NN`<t<dh(K\;aoY4C9[;HXf`:Z\9`OP;.Sop_B*ApnhJB1"JXag3-C&ho;3iur$nVh^.'&E^'cUD-[qW%S!mSp(O?5J8V\M:Uc-FP"kp^+U81N+j]I<r]A%GO:)-I?NKSYegBQQ"9WelE/p/H11Ya6E_-<FJNh?U=9_7Oqi0>$%lPMA[f\87PG\\uXnh/E.aOeAhi;,f<%2Z&P+BYj$%:lA_qkX5oGU6W=Q#]PcD`pde.ThH$T3i!?\0[\8hSC),e(TV)Im[LYEGB@T[p6LI9\(7CGXnS0qrMRmI!DModr7u;r/;gOUp6e,e"VV6oStn^8VlFlC.:DO]s?0;M[+uHg\b29jVk#V:>8ND+De[>I:9`\!LiVMB:UChQbLFaeY`sJUZkMQ=k0'QaPf9q5+FJiXiKm=W+.ENOuGL'bSR6Bb'`3;LZ*Qb&BDXKRPd'!,OeFBRJ#FS@9>^_E6^W0=Q)+;#LbF[e)gXak>o+WAIEpA=QX,,l(<'LiSF[Z[+^!&7@]Sd4U]P1(\>=6PU*&EM][]-a`=h_Ad?mcU%W<>\MrVGL"]oaqF<lso;9Pqm;SXWKRn$Vo9<eW&%$$u$[KD9Y&=P@"kp9hkEb9p'ki61r#Z5%a75c%[!r\5r\Z%i<&%TBo3,B@%CBc2D'=1Q1=#k@?tNWo@@/'(FD,9[8TGk.$dF=EbX1pZ0sf4hW0i:4J<i7Tn*@k6-/gi4-@OYIK%7!8kc[TYP[i@K>F%J?9CL1?-LPG7HVI_dX6WG9hn\a?/<+/6VRFoQ8u4sDAupp&3)WDFCIteBP;Rp=Xhn:/*mk7;;WM]&'GYT7jqY001aU`==K4ra:<MI#0dTjPCXCCfM*`%\08OEfo1kS(R,&(F[u&IF9EeW>WcMBW&aco22>pQh2'rAld2p>uB^e-qQfU\)Ue,T(P(^)&U+F:oYgC"Ka6"]D@e"0j+%<o"=J]lrU1/3/f_Z1$'YDoGNm'7`p@EXn>AqOJ;UTI.`+JIITpG%D\LXECY675=35(QQ?^YEVA+her74?i3RO"7Z7*)hj.D_J[]uNR3_aBYAg#\QYMi[hZ,GP4oP$iQ&jS+OV)^7/eX,\m@V[4:$Is"K>@Zeb9m>ropYbGCP;QOG(P>kf8Nmbf4p-^>#Afnmq451<h&PTa9Un9iRCOe#"gT4%dE6,=*cR[U[oWX8S%4Td2o9.9cRLrVsMV4.!ea@udN?2u*`mc6(8-+'HIqlq/],q^>[Edha!]DuSXe)E8'U/d-(Y+J6co$=RGfiDrpuS!/=\:b9,tV"cpFQPc<jpbp/6u3I?]i^bdC/I?(j5tuhM#CJK;l$M1Mk@IY8P9O"`[OBLMuF,pfZ"?%W%pY['3TSBW\bT-fnBQ]@X$_6eA[s5^T.BJCUN*B?(Z!;Wpsi8?&8gWZI*XP>KQtAFs*%XYBTag"gb+P,dY`SYb4%KY^ln$?&Dj,JXPEBpGG6IHVAuZj*C:7Tbo8cMSFC`YNA:Am*8WkF[89gN:FD`f@V?98FNcO$,$?)(+&->s5JjCCudkUg5#[5i-imJ%0&1EApa9R:3r8>=EN;l_l"Egf1Z-ALO![DFiMlTOHSGb+=Y*^X:PECMS'd_2N,8bDdUOVi[r.!dAmUUu0(7:6AD^])tjh4S^[('QCs8.`(5U"BW(odD$-Nf.md<]Wb)U.B]6;i=OWeRa8I7<UMVj(`qnjJd\uacRQ0#Jpt@^EXY+@BAn:1:c40g7cqDP$tgR)14-Vh]]kG^D;L<o4uGXQ7$lU0jm0GIMm_?c'TI!#98#fGanF6P1be\FrQ<Pq@DfMK%45HD7Mi#@gqaVdq>?Fc4K-Hi&5:UA]/IjfV?6%@EhBEb<2kg0^:);Tb5HQRK`g&AC!U#h(po\8"'ns8F<]1B_q/;doMKDq5J\!?Gf^?C`tA/FF3/`ueXiNcc+GVWcg<t%\Qgokn$ju$n&EIc4#HA+ORK3n3gaIg@<oBVUVZNcNHb=Q9j[4.&*).HFr#O1m\@YF*D9H%)g85G?U#%Jb.OG5)=8aPcN*,Xb'R,fLqJ76!:ZV'T\?HTq4AXu]N^Ni^D'h:B-X?!.W7tk7p*P^(?j8CPR=Jo-2OPR_B>A_bN`KFNLk6D<>UO:#!X"^)65eVm21]mbl]/;4^<,gW]9_ORbhbf9VT#K&!D+STaYR6d"J#g*B`/YITT$\P`7VD:o/Y&DGXu2:%(0+d\IOc;9b8.IZ+9n9\2,gX#&l:TfUXG!"ZQmBZK@s^FccL%"QV=.4fNf$63*+!E-tq;&8su1VUpUXNhYsgC;=XW&.9l^a]G0JMd%hXr8i!,0)72%<M3hf%Q.!CN">f?c.[B)K/sJEE%p76!`ZK>Mt4+r))Q+)51uq&eR&VV/nT@mE9LE<dNpn9]\!"Sf563p`jUhm\R?!<U'h<n4$qGq=.'iVd2A<*m@^?"IF5F):eoOEblm48QhYI"R:AUf>*DUbPZ(h84R#G'g01P)NV@dRFeY>dFZF%@tPs1#r9[6RV73F$`$k[dm6JnN^4[G<[ZSCUMZdA@(gW<Hda2I)Wj0D9Nj%@nWC3+0?[hKhA7WkgQ1#@aBBApZCA12F?<24MDEo^cjVJA]->0&3r+KZ:IFH:^0Z\qF3Y.2;nrLi@.+^'am:Vp=nmkc.<=E%2QE4P-p>2TdN^t<4EQTkf\9bW`"C-cVnp3d,:YI'AdI&gQMmhc)s+AolDVTKZ-='s:Gu'1E=5tU7^r/b*]"pR4tmc[T"8sDPb\4]kka?-l-[Z,i+Xk7VILIl^iiAf+HoE1mT!\X,S$b07HJO=9^6,q1MHhP<('Mp5>*@-J#f,aLHU5F</SM<<TcRXi`1b%W%Y@TBr6qg]WU:Y)/O?u)_?%kW^ERsQJTeT<CXHm(.i]MQTIJs"IS#Z,a;TlS:C?`EdjjQg,K_e^,WDnaodu4C>1tCPj:BH'9dHP:N"aR$p!/IG]!$(D0bc!fMqqN^<caj'rR1@fS_tlaHH9=Q8s'shfYjC.W^`l+lKEIeIE[+Cn1$:MI&k(69]r/fE4*o+,]'j2N$h<CC_@\j6Q?g]-l'*r#;X6#HZZJs(%66h@=<p"/XJ9T+tLsf#7I3!4L#Hl'"%N@5Bmj3fW$`6CT>I?r%8<,N/4F.mNU3eSiFoP0s_eXhOZb$iJ\-IH0>s++LW:)sb6f#=/2j*CTjn<XCn-]#-mRTL+"Uq_LiW@-D#Bi^pJ1JF#!fKjo8j\+\T8]UqA\qI(KCeNiBk<ENP'5J9Ne:0Da,)ds"M<13'*%+"of^.,K)nd,^Zr-;>]qi6Ter"/N\Lp]A`BoTOL>ArMr)%o!885^03.qf$ne)eEq0`>W;B!EsHhfn_)_:.Z.Snr^J(\K'&@i]*S#N=S\L;W8X2[>m8k9l=`m`_5YpCXiHY)aF@Du#dja4[iM&/BO'=[V9B+m0C#UcI[A`V(&HE<KTC+1b[ACqPhCP&0tF&^5qAY$gkDD::T-6M)X:Wnno@65oM5I2:=$IM;-4T/JhM@.%HR*MA1Cm5m'O`6-p7.jSBr-lSi&j1r*mjS;kdmGt8FI8E"./F=pWbV>N6[RacW<0B?15Le<0.5A/)($Y%=KR1Q]=^C<M#Q9GSqIkUuW5F5r<FE56n*VE(5*]4!\af)#0%]ZFc9k:INW-74<"r:]IB2bHcij3Z-mFqo)?3`NT(.aHTg\i\"n!U8keF].eJ=C!F=O$"Ai(=1S=[,p8Eg#)lJ",%)sWD"L3=@>Bjb)lV8QW%S4J(aAjpB0RW3$6[QKZ%YsJ6-ff`LJp"B).k1L+$7*_sl^87hKDG`Q]F8JjZJ8S14dV"ofMbd5]<*K"aFPkNS1qMnJ+PMM&YQ'u?/jAUo\:QVcnUG,SQt?~>endstream
|
| 144 |
+
endobj
|
| 145 |
+
21 0 obj
|
| 146 |
+
<<
|
| 147 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 6767
|
| 148 |
+
>>
|
| 149 |
+
stream
|
| 150 |
+
GauHP?$G&EOaZu-W0\d"$j#<+TQPGOaKdBJZ+Zo'j6Z4(9+u-)YX*el"sbo6q<_D:NA$.l5XV!bA4?V$G'-mDY,Y]+O9l-jA'4h+)h9kkE;&,kdt51XR#^UMh+)^6pZhKSjW0D"ppsISXuh*jfI#gbl$JGO5Fn3N6+3NNc#RcMVL*l03+0;lS/I]5[t2ZG"&Eb#b==./"'=(cY'KejRmot%5_D'm_Y&XphkO]cgR';^=dX*8;9Tha)4%0<1X5E<K"Gr?pK*eT9:kIBSA=^hj_]-Z>0lNKKl[FRpB&[XM$NO2X&lkA&$M.._R?3YVX(ju!S><,Aqnob(;oO?)q7P-(8\$Lq>O%um$WJE<JiSJ/Xn'o_V&UWDW#1llLt<U)QAqMl]]>Tno4c>#a5F!njGn;R):gT+*YM`"XGPda">VXfWp1N&.-GQmmWJ7Eq0nO_'*1W7Ys2(R\B:mWQZp<dkHbg_nUG^C1<arE+;MZ9YO\r;X*8^SjJn8o!WUYgRZ2:H:2aM,4_f@o-d<Uk8W3VSElH/%9hTKmNKQ_9:!u*a;@&g?GlXaNo;S5RG^(VdgS/!K#cTYd,ZiY\P*4!Tg]p/ip`YoYXH+5L.bbVULERNg_Ou-qU^Q53!oM!):=E,$Na-f&B7D"Y<VC^=OU)m$OJa4]BHf:?1253F>GW;R8s:B7lpXMqm=+Nmk*><JG+#\]<o26?]01LM)ER4j._>Ak."D7Mk`:-SHE(NdUhUSC.rr&TY&I]B(Eb)s1h2PpnbdB)7ZQEcOAD/bma(sj08II/)<&+R>7iJE"/ZL]'UBF^2c(fGu$BL8IoPD:sT8l=0KR:%WkZ%q]elJ!oH'U9j?OYer'm*F-.t0FG_qm>IS7Rs.XO&QtF!0UkQG@fEa1W7r.T]+sk$bMYpL#;4:K?-TkP-3/_W!Em[%4^sN%Jqnehm+h0Q$QAR3E"#H=XW76d4"e*(O6?1d`JEKH^*>a4CTDR8"qm#U9ec&N;\mmcsa-k_MB[p4VDK^YW+"u]4Dk\N*C^huq0YYTN@:9EI'L.+(fWYoM#sMk_[VH:=I(WGN5lNHXs.JmtN/f!0*NdnCW^B8nm\UPn%up/Z"+U98Al6:kUu+N5]k7"9>%HGFP29q!)JrSECmCe?l9:LK*lj1Qj)GE-^YW\m0J(8&CI-?hb[Do[Q\8JYYjq$)d=qSmVdWCc8!5[7L/IaTV3*PJ#erK,KCTmhMXY+9$la)ALW;a._@o0HOH<o0+:?.^.T'mDmV-ia]VNepqA\*RV]4bUpr5r]OD!7aR!Y-L4a,A,\OOB>EQc1%T"3f;`)";epRT:-b0hIW:CZnPcXWOh'9oe,':YLbj5CQ7Lh!k.>fP)\U[2kefO3C-_<E)[Og>raO5m)7R(I7soW$Y.<&Z#Yod^g@Q#mO6Ef.JXN`='(%](A-)92)cUtWP..+S$C@6fn28S"[]\pL)`>,.eTU2<YeeS]W[9b8g/NgK?I?u4p%p]^oY!>nNnag5D0NgFMGZP)YPYctbR%-_iaC0!oi[T"n>_5!'X>'b9&Xcd?8Ke1@+*L%o$Y"^Bq$oqZ7=B^e(P!54NN^_TI(?Pd(r$hgj#4lLZ94r5GMT<WV%dYDUeNC\<NtuKp1WMM-@CPF\e/80p8^V6flA,S/EP[iXVcC5,b4.(3`rg.l<fcBAPu1f-?QZTGJE>5gs+^Q&lU^YOY0?MVi-CRBXcd4>7;6&=iO\CqY$9e&SG!E)Wc$I4qZ^A,2\='4)gGB=0[9;#]V6?NM%?&`h`'kjY#M:]]629cp]DjHa5\%Qf:Z[S#'\Mh9Uc@kr<[8^p0M$?D^b?b7o2T#1?=oB&'5G]Y':rnb!gft:NUh'AHFfrghs/2FgBs6ZsGJH_mLJP$-%d:*cLiU@ZD-_?aE.t_Sa#taJs0nL(=I2Mj/%oQUi7<ctqkSA=S@<L8Ddka1*m)XW*:9Te\'4>sf2O>Gc7F?K??f$UC98:/0PE[Q;Q"`MiAVCj>n[MEQpVlVE[;;>jsX&T1(FVp%McF.'1D7D;7R7E>u!@_i'mO<ME5dXkB4hMb1b$%1@rjco;.Q6p%072q1UE2IHf[Q(N/^K<mE@Ns^K*&<6mZVl>\r\l+Y/hmiK'P3rEqadBZec\KU5i9I`*-[5cF\[o!QJnB`\9Aar&>9Bj6MoO)Ism&n:>8LBqt(q`1C3#?PT/6@J`g*]E0'@)?GnDL;2Kpj!!8HbV'2c3TA?EmJlX%olLk2Z5fO2@#1*T%BoY.U,+Co"$KaFH%(%/C#gp4lhhb@7\Nl(;(>3"g$M>)Zb;@tPg-\V<jE.@hLG=]Fqc+0_[=$SlVe'nl;%nkeg>ilIB/MkRCl=Cn:B_(*Nf)LU=Tjj4$24O9EjF,66k:<+H-A54r.Jdm/Hi/C:_9_#7u.PkD(QuqbJL$l(5N+-2cDhLH%u3SE8W+.7GJdGp'&V`s!.crmOf7m*be*/XuVcX+OIjo*D#,\VsEZsL_I;#_HUA]`&,Pi[;$rKb>^r)K?WEbjf`TW_kWP4f@kfUljfO:91Ou00._F-\43OS]u?:gQHj_`"]q8t[],(CUnF;^.L9Y:<.C;*SR*c_04`[ueuQ9j)?.aVhB3%h]2mWq$nueV;)!jS9Mn7TOECDJpb5nD0L'q?:!iBn3P2j,_,o^#i7$csUg$u,*l_#alGk*>ZB!MF-B]i1^Y$Qi<#F>#FOMea,'4ejJ.Z/!^8_Mlr>Z^lRF13GdA*gZ1@B0NC#/b4W/-FV?4L=1(_tl3CrLJj7FbDl&Oi1gJ,QA$C>7YceQW":m-MiW%ZXuG_p^(T2P^:#B0oV[d"Fl\e'e9<kQTO^.53)3LIDOa+Y;:d]cgD:kNQJ`ik%O@93([11\5a9BPIji7g9RTY`WoX4aNR%)H65S1Q%BaJk/P\caIX2`N>*JjFIV.."$Q8'rs4Ok8t\a6Bhg\R"dLW`eBP)4idag7/:$363Ri(B5S&j#-rc=YuE;Pp1T+&a&)-[L(8-e!`RN+ra0'796l:VF?4TA],sN*&!a=fMa8CV.I+Ft%bCuo#4QQA]%N@M./=M0!6Y?Dh^XoGcR:3XJ?970jjjfu8iI/#2/QamKHei-*9=^`Ie2k.)&L<mpCpcd@sF&@/u0TB3I\c-'][g[@n42H`\1k,1f+nJh`%E(n;KD,a?.DRX["rMQY#S*8dcW9/AnO:\s4AZQrFc(!h\*I9;V\,P#XpAfRo.JE7qobMn8N=5bkHLP`butfT.:DCUG:Ti`t`*OX6&c06m8e9_OktGnQ+]Rj=LWWoYZ=@'Ilse"k;WgGlsQ[b!OOEFDES+m4p(3T&59Wg55.CJP64N[B%oD4mIYa0ph'oGKffZq)HB>[JBfmkEkaH;BMsFUrnLP2g7Bg86E!D7jD%=^seq<\.8k[aCBSgVL48I<iBLH,uo/bauC_'6*Xs\MsLR;d*QoNT?7h>ap@\Q7Jn20.la3OWW:dr6d_`9Q:pEi2N-rr`Ccla/C`(7LU*Si`U`_o5\k0C_l5]R3d,aAZMc3Z$fPWfBG%phog&^lT3?,m!hr?T:5*2S5X(7b6b8=#9JB1F4s%PA0MUb&^3q&W#42",\K0N9,=M6iPQ)XTp/_NH`3)=<;AC<Kk/@T%Q?t"&8ObAPn:S*mDIi?iqa<nASJE?_Im1cf>$0?K</:"<sn^Y]Vuf8KoReI^SC\X30oJdn-nn.<X>L1Y+sZ3UB*4l:m2!QeVcJD&+AJC77jZ$@b:VW@S=g"%IHND26YbKETOO8g'?;rh8?D.+f!Y0%de6_[i!Y=GN/FimMgmFH\MN=)V>h\j&oYY#Q!QE!k.;r"=u>%OJ$#X2di$jbnXC&@8ZGl?Pr6l?S#""S#+r9f*cJL*#j7Nf%Kr/c;Akq'dF&Q/VZ>Zcm(WP0@4>I(jT.6M"hS9\Woj(et;W:hfHf?s,Ms)-`ha/!7M"7DV\_@KWIjZC.Y@E9R'd_r#\'e+U?hL?.+)qE/(i'M9J1X.BOViN,uYLcurSO8[Q$196hu+DZ0LW-<!$ID-pf`R$*K0H[JqVNN=5@O:/+J-'[dc<DWfK1UfcI[2<UP4=(J:r>JQHTZF.V9bHQNLA.`UbPQ_;_]!rtjJb9C;a]q21W9odM"pj1'2^ZA%htI6([@oAWK,C@Y2j:qKak\ArH8PJ]R9H#``Vnkj!V>)hOuO)^N]SCC'p;70"">5QuCkUETYl^g.0Ze]Y#EH96]UB2N2>j>eGF\(7g>6KDtRi$6S1)8eL]^BYi.HaPWi4bB4`p0Yk`M6f?0Fdr51+i3ToEg;TD:B6EQ_mE6k[9,ZTPnIdCbWnh@C!f=M(>ptUeRb70bU(`FXT"#9%))M^`Vdobkj2Xs/p%6(dNNO.IG`pJC??Km:_;N.om/Z5U-N\Zc2m#:F;\ZC;B:M?<<tG2qG2Qc8D#['IBEnLF>YWdKW:KJK-A*qA]H:nCC3243-1/tUKkt_&Q+m0_@t6PB5?o?"NY8jMIn.5'WbErrJ@7$EoL]C8#PH=fP4;#PW-_Zo6J=fG&jbshWB+!^>%^[>WNh#hHrm*YABX:"n@,"mrc[V)BC4T@f/5'4pM\4?(Ts*KdK&%llYuIZ"4k]a.XO73b&Eh@'0Y4Zp<)67Og@?l,s!$SOmJ"9)9\sXWuon;ld/dhJqC#G#F3c(eX*//D<ML",e&S<7T<uTAA+6@L+<(o_aUkH#u-<%*2t@"&1-Y4q__"WOYKe2f66D";rGd[OX.40;:VP#bdQZ5*DBF"P)fU>\iARQR6[;61'9okZE1!*-UPK[eSoe+&]JREKUF#t*I^)K'0D4KY92,%'8D\>&4JE@*5aP/'!Yp$dNVPD5qG5lgHd=egl>94#rQS?*+]_p$%S6P_a*7`N%gh+/[@@O>3T2#/,L!PftKOhQ'PF-C6<P)UW'D]RlXG?^VbaVU?.PNPk[L4jq!t0AO<Bu?Kl]lAFC`d?]q1Q"*H$]=Cmuf('K=mV>VXkP)Tnfal92"pJs"G4%Uo1PjQA&%l7Q#)92%)BX_^>5aj,F81][HTpkXSO_\;fIMsQ0Amjlc8O_[-Z2[#D$e:3*En!apgf?3/'BnfkMA<g`g-gFA"8XZ#nj2sYjO?-8'3][9DL/JWU6=ObPc+!ZO*U9d<TETa]@K";3l,dkl,dj%KWQk6FboYD/B-C?F1?s%<][/:#1EQ*X&MU,*R#E!?D(SgY6^K6M&dCF8_Q9oB"5p<f+eT0Ppo^TVip]#pNdTQK58-VQIL=0P;G#KTp(R,gU7dp\M>nknnmRH2XD?&Vq)$4Zp\5,_OLSQ5$rn?V:G;1^_]tsON)^_PLYPB>al!DS/8ln3@/%\W)g48La=@D^:h%&pD6\NS"[#jWR-3$nrn!#`%&)qjN-=o'BMT\L@LP;#/&ZbWUT5FK&<gJ,1E)W.3MC\6]G6VoB79c)AmTq.>/3VclQC?O=:R"o5.W[`<1'32`BfZUj?&(3-\$PQ7oetbg4HtV5^m<Z7ePXD@[pX&[F#3f-6bD7U\q*&m-P!bgJKUH&:mejJ"T`;Zke^Njja*+5f)S\Ia;0=];Rt:,K!;WaO)0e<@Q[M+F,gW>]VV&AMu#7#(gSio,(YgW*1iZ->4=G_/3\FFAF[E=Ji*ICr*l)PFi,(!K&;]A"obC$uoj\-TE3[H=FW?=abVR*BnMmBB=DWX82C<KU(u?k2^&SY%aY\\nUa!\GFARA50[<"Q,,(rc<UMAYmrp/"c<X%m-/:*1++puSQ:ZF,s/$R4cOi9s2WSC$ou3R&VtY07\)Zal>1Snp#h=.)qudRGH<hI);+1LtS:0P!,VC)D4eAUa\4H^ue9J'*F`X?6P:Gtp@d4:j*6So3]?N!jui_1eee_)=ud#P=s54"5q=^-64Uq^"FOI;427;f$)U^r/ae^;PQdpoV=0dFr%?0Uffef"IJ[)tL2A"AL\"<NNOgs6s[S'^OZqN'Oekj3As,7bin2cU+&Q=7N)6!LFcdD$'6Q#)ErHl5ao[Kka@,4&n%``I1>_8^0KLK<^inM3;.2e<eqrTt^mIahN^b?<l44lK$khTRm8..?Wr1l'mk#.8*r&M\]NnJtU'A"-6Jung2d/^K#dIKEanVU0Nt*&8FqA3N6Ot87t]+G?9?<*A'n;#tSFp=S>#MV<U=_hf'FhMH:K>/XrO..`P>'VWAENp.T?W=roqW<-:_>1*O"2FmlnX1Ol'!UJE#BVDUGqS!q;GlIt7'h0]>W[Ri&0mDKW(,`<^D+@gq<U=.0P7B3kBZ7FHg9RK!m?4*t9@H&e9H6\9Me]i3)>1)T1b\Kb;on12LhCpeB(R809W=I?oh>PfgJP=R6XV[NtU"\YV#-<*_d*a-,R=ObS.u>o/T7nM(E"=p_lZ6@<Tu0*NJrVeAWKHI[ltS\#g2'n&X7_cMQ(Z<3Y_eC+hG%cL6rUTa!YmYi=*8:20F3M6[V18bDU=>Db)Rlr(j"9[k>bsNA2-mSE)K]Qq'-g*KSoYLI!2[`aD0*:h)2>DWkZl6[Q`io_";+O_QMQlI?oNLk^<4(Yj;5f*=<5T]2"QTTVfsEe\8pQ?EVj1)W'ZI9C-HZYI8ZQk]J8j\U"eS`]Ul<5r#IllQa_*F`tkJm]`^7YHuaC%@unB?JAc_E(B2a4Rj[MFASFjh:D+SQeH%E3]'K4alm6ueNT$1=#T=n;0?0<^(aiO%6dO(o<LV[<Z+.js6BPe0nV@>XpML6RqM6CrJ,f9#lF]/W,iJd%%OQd-a*9\AG<_P;=F!VI?lNJ&1\mcn?a5^?YDQW19OI3UW4cEVs;Ls7Dr[@r?S98s%sP,U`*F/)^dGacKQcI$*X==Y'2QH~>endstream
|
| 151 |
+
endobj
|
| 152 |
+
22 0 obj
|
| 153 |
+
<<
|
| 154 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 6119
|
| 155 |
+
>>
|
| 156 |
+
stream
|
| 157 |
+
Gau0H=c_<,[XRtSW0\XLN5Xj.;Xj_hgMtu=\38]3!A5:(PfT"URq0ntZ=VjIqqLR"<EphiZ.qp4FAnu;Vp>.0V:m%Qr+jCRq_98?5EW!^K,>s2Zlt1+g#UU$o((7nY><;&9>'4uB)/uL]:NjW6urc\BtNl`?KifY[eRL4^>)n+9@)"&@QO"Ki>L]T9P3bf/?ot?]ifU+af?B?n!O,$j^F;[Z63qKpq)o*?c$>HdYK7>REsnMN*&>=h-;T)eO!XB69]fETDjD+[+9;7=N<4ah=X[*33D@$f*#96jt=?D$&!Zd_lG/R7J9N?L1&3UFMi)=&ei<:Q`]mko3"IF5'[[/3SC:qGa`?KCu?_selIq[h&jG*"MSF4Yc_Iqg.HQ/Z7l]M0s^Vq'@"m`eIpLAY;)"_dB'/SN%XpPF`!;<Ah$As[=i9ULh18Mie&m>C?Z\k&t*k<k#j9m(@U+(p?`ceDAg`pY0%hg(=?*C4JQ>:9&T:l/]>DNWA&HshK6t3-)2#n*AKkafs)r-n0/qs^i_I9PjU9XVg]]XjCh,0mE,MgdgXu^hr&-K3K.D.0_L;e?%1?tc1--mYDO=dola:H$klqj=6R;AL#+)XhU["&70i<DnKULZEbBtq^?+%>*Ys>DREpIF&N"*-+'[Y/8>MthpA0lVm#MB$_JEI;0&QRjb]h"'`>O5slG2N)^g;DSjop_[4">E,DF+:k:@]De[KUW5)\2kA&?M3@9.k?!,r`pii%_<(EWuZ&1^`hod@Z\O\]BlnP:NZ/NeU$=d)c%`qh2(a`Ao/&,MS-#H=12W_KrgVM%69n^3HoIjrmCg71b@&)!qUMOM&-7rU\!,.HF3j8TCMqF&'%#gs1D)s$$110[l.=9IJs05)Gcu,-N_7NS]=Je@GfbGb`TSiL92eP4+Ia#SFY*Pti>McTbf@RU$0I(6_#g/**t400R4]aJV2kOR&0`H,t-QP5i<n:C"1^B#>[3:TE2+EboOm>6G,n\PH)_84nRYeB^,PGXXn3q-ThWhBrV#bO#kGirs+5RPAb\&2'+Jpo0Kj3ImBRM'C*iDp^+l(qb`E)L1j(=`a'_5t:T:'Pii[,S+T'*Cusq3c8f.CV"#Y4:a)WcfMjnSRj;W1s:cD]]LCIEuN:p_SB<Z%,=jKKadZ?9!'<s^O^.ISEqQ<&X/5$#("?Kj$eiC(,qS1'<YKSC*lJ![-**of4!Q7k/.B\njgRkMC/_VaT:69A3>QirCRK(WHMo)1GET`AO5PC4?EOWT^hU=7[M<Hh-E1jLr=j3C21+^gT5O0\am,X3Lp0[7?mm]lR51V0j$G6;gO'RRD#@5YjUXCH)Or5B;$t*OQ#FU18^fIY<i=AjZ:0Wd;o;ajM***F:2![Pd'kn"(B^:O\eUt$b*_fn2([SJ\Y*5<SLho`[%d'RblqR<_[)sG_df7_Wfmbk<YVA=mk<&\d)a2B=6\a*bDjB]MXo>R!3,eP@H(k(b9nGJ]t)9ct=o4N<u?+p#0:^!lm+5PX1`<0HgKf*H!@99tuDABakSsN!<.(_O,E(C$>=ugkm:(5oBqRilQA+;jj[-TbulW,V<*LG4hRI>pham.3P_0I1Ch)I%Xe[7Nal,@rAfZ6=XFt\)<T-9d5=g2uqP9;QGd`?!I!RMo]NKE9Df.q]&WC`T[^Da9MB6A]jBm%?:8jh@?dr]Y@fae3DmJ!$d1(c.1*YgW3adL3?u*'XT;4s&-\TJRCe('S9],mfoHMXY.Um/6g2L_'/V>n[QmC^gbB_XanY/V1#+r?7VE%Tl7\:dAo\YUaI"];\`_4OeNg,Gc7!dlE=_@KbO'.Jc)70K?b`500Y;V=$/'[L#?MQo%Gf)).\O.eKnXf@;U5inqFk8`*1fbWt0-Phc[VlmiQU=@mg;grMJ;)Y?>TodBHD@FUQ:Ne@t(dQh:8m+`21M-kWnZ,=%R77\,6@&ju1?!+Un872N3X"<-,K4`GY01`uP*KiU]8&8jB;A,sKO/;&miPOZ0U2,eq@;MY</)#2CJ@8m4Yq*NPpf&@D9+GerZjb@Mab\deb'@8@N=5YVfTsF5Y-67SU2_.1mBtL44hu0:3:V0G&;+Uq$q5]1"JFua[OK_'g-$U<BBEZ("%iV?&U[,-9K/0/3H4J[n09#G.o)jn<+YBVIi:9u-^Du^T\j?<eVF7m/ESp(rJ7/LrG+(m(9C3_WSIiK1T';Lsbqc+LaFbVtnY]D6>9AH3kfZpo<N0N*b_O.8DO+oD]EMt_^ltC3e;=bLYJPHZ^c@$#8Hm*Mfqn!M&3uZ3?V#fiL,Wlo!+495U1\Ue84?58dYc99M\d&&%#06TL1r#u=.KbuhRt\':]LkM.)P(Mh95.oa2'nB1oCCQ3GGambVu,fl,nTHa&M4WnWQDi&ZfQ+Q$73RI.e'2?Mh)['mRi#j![7(^ADJnYk7%R_>iQ%="bqWi5ZTu'8qbs%i5g`A,HOp#]i;[@NC/3LL(j/K8^R$Mu[KimAOL>i^#+0GIB>F$l5p\&]ST)dDX't.LgXM?dc9:k>%!!Vj66P042F6(PJ\nV@&JX5#'E@5kLP0=#Z'#=Al,@iOs[4hAI-ZjZBR!hh#`%`aTA#dXb!UfWkY=2@(dFhnX!&>p7T[$hEHR[OM55TeIqT2&[CU1C1hQjjBd1Z2mK!(k6\]%cSH,kI?=#I=!7Po%k?=W7J8aF=$0uJfnPi2/?`/Jej$lpM&m&co\qSHDXN%9UH\$G=k+m$M=J%L<M!j6(J4)m9GHc5PdGW;t9qP1'!)db>(=5'3@8f(!?sT37f2L/9I>2)E+"@qcM/I5EZfGTkGe3-uf(XO8jL+fF>rpe7N7'FAV$+!sFLHp+-4+UO.pOQ:BqdqfH+3'XB2r<<;n>Guj&]/,cC"\5b^"#QY_8oUk3E9Zg\hJKE,pImW2L'Tkjk'H&*-+MlF`E@`[C.F(i31^ZmJb$8@.6KRBdX2?L.PXkC1&-3<X$YqU+J=<B@r:Bd]_\?q#S.aHm1+lWGKtq64GB(@mE25co^[lg.G`de+<Ft_),TBTG2KYKiAK6r=7c#m9#f%7L76/O6=T\00ioMEV3j\qW85W2F^nZUE"U]WE$oVFB5G\mPd%Yuf]sTWM<g"Y*j='qXfJMbK;H5jt?=_]F)6@1MhXc*MTmE/G\9p/m6P(tBHFYUeH"g,LFuI8k9P(CMb831pDBU?MKd9QbPiX*FT,@>A3s;HdM*3mN!k&-N'@^K.qehWrR&EMjl%4&-lOQ*Bcl.=h*c8aFT7L0rTm6`&#!h@JMbS"]2?LL4Tt4f8<qbg%o8[D_28L0f+G\F)jiZ7cPsJFn_2MOj&.838Zt&V?1-_0@Hn@>1&ENXe+1jGk)?ZNfWbDo;_`_`naq*bik%`F\A&;f*bJUR9^*u:FD`\_RWI8!":uA_Jm^h\9VL.%qY0hW<j`ZuUf@<S3C[J6no")ECFLsKnF`l1,]&_$"^U_hJchlR*YAGrY<n$jL9X!!)3nG*FXftiECoD2`=BLTH`R<)TY7R\DV0CU*U%7Z6e!?aCi8^ZRdprSG2'c]3Yc$$M8qF%C.;]]^=iWr4L#=-jJ;4,78;LB7Tuq#kDZ^VkQ?Bn/k['NX(g^3kf4miR5!&#\j_1+*q1>o$O/ZZXJWPDY/:io+PC[+C&+kF"ZR7U@%253](H)e`rXP3%(_u2$hG\J7Qu8GVQ*M;SgYq2Q/q;44CeC,Y0pbos<f"rfB&`4p`9&h1;G,V,$j6LP"%GC*0b?8rBk%W%M6;m?A%)c%*Fdk*@['^s0Y&ui_(1LIR:Bp_kum9,+lZWJ!1LV!I89cSJOVXIf0p=fLGbs>S%W3Y&MMeg,(ppBlOJ"gi5Yh7Xh*"1+%gK[++o3EjMSJ[^gb1]`7:q1(9#*jYAN)_[q71%2Fo;9g3KER!!Eq\MKrG"q>PjilWU^V4QDoeICg:U!%ECV-U.)4dYEXD5Icd!Y^9L8!LV_k"6kA,l?C(5>B[dDHPYGXL!KpnPPVCI!N@PVRsUfF4XWqmF@Wf/^G/s2[DpQsT438NOn-_fTU-HJKS)d\Y+)j>h0Hg]be$%e[ZKD-Nq'TFa.&?h55hM6d.=p[]T+>Ikf&;#8Rjp(,/q(;/tK?9`6qaLq7CY#q5<aDg_RO6`2A3XdO!:1)5BVH[W95f(3Z`1!Q=tsq:Jm58Mdt7X*V*"]Ba)ue`EpbRl?8LYqq$SfhaTmfOL2o5/k/EP5rB%.],-j0h6!prU/YcNt1CoZB@pMj1$WHP_t8Q%ZT.*O#R[4jA-bJ!!f"`I1GuI>6m"*6beH2-@QCh0\e#93=dHI>N:+ro;H;74pJFEFslLPEN5cn+@6_oldZ-)&r6NRa)XqfVj1Fg[It#(Mo\CfT<oi%(-k"p<*M[kK'A;oW't,@NntQ,ViUe5lj)-A6C.<:cUG'<-$noZ$8hi%Qb@:\!cjSl_Rf1hG$0?;01?F2Z>V1Y^RH)S/E/CMRP=-i%@&Kllg)"I\`h"f]Q%%,Gn3)/<(i;JAOspj()5$Ch"bndX+""8qHi9e="6kc+GA[gK)6tOjR=Bo4p4HDNq+5rj>I-*EbFZ4=bHr@*2hHP:.TWH@4[rr3'Pg*=n)P,Y,$lJZCD*?eV5@o`9Kp]aE\7;i5W@LbEhn<KY9fT@hlaB[<Tjq-5Eh06aQ;#reoCE9o^a\ht-[k'cH>TpYkQhPiX?a1(LQjTVf>).3XHB1/%@Q&K7:][Z`0kX67)4dnBdDq%B4U9/mLq=#9l#ZhDHP+BKOV_HD`YE[!WI8td&f`uo"UWaa'\WmZr@[I:q3?#$[W74NRgh6bu*46:T`<]d=>H"BQ\8k!HEgtmpOkrEnbiVWe<Xt>"C1PRAfCPM!h\qBupW)RhBekC6L@3Rq+WN_ml@DKn]W!LQF5ojR<09dO@oL6(O?\YO<9K[U<$3!#470cT5bCUN??)`E9_qB@pB44t=P*Z7TmE$=3QQbb)Q["I0O->B2m7<e,X+qj`F[-59LOJZUZDb]#ap'o5X6;E.Is5F)Pu4+?(+cVka`TKlSZCgPh34'ZF61dWfI_''7@SR8;lXgGZJdfE*$uXU0J*Nfq3T_09_'+S**&iE<d1arq#Z0&iu_"knn_G^@j#,=$6c"(2"\Q@(jKhT$KNcV<*&)19ED2SFHk[Q;!Tp-V.NH%osm%$q=pf#-;"+))O&luIjeQ:Y-,C;7pRo$#3Im=)jYSIcD.P`2B+Q9r`Tm'*Dkri>uMpj81[M3-2q9an+)G0"5T#2qXW7=^^p7k6:*ica^-bW1j/GJM\'qYjcd_"i6j/0VVf1q7cdbH*"5!I'@\RH`l"9E&V)u!*Y^dO-_;`_q$qGMm@ak#d]8EZdH(cf7s%^lU5C-0AkA,$_?b[-CZ]JI%-,c>RMnOqCiO'&>ZH)JV[5+fEL<f@WTo\iXe+V2AMq1?_1^_q6R`,HNCQ@Z[VR`0P<]i=(2!tMlBGZ3SK6=qbBJ]7A^@*LmaBRs8TEgrKVk)C;_F1t'u&X(R4e#Ej7cus/8D;nc;tV6.Z&9K\oa.g1I\r31_s_]G>AP-"\]gk`Tc":bZ2sJ'^*G+$r>5',H7c@c3?ticP)rI!p>[IjQ'8Tm5]r-f$[#fPa5WLWbT&+kVMC/=L*augI86$.60_;4L3;Iq/U;,!hV_j_4:_rq>/Cn:?i#5NB($T_R5i-jOK&V2%(Qtl"E/7c\>5of/c*YJ+b7GBRSeFV,+9Wl;`+c#1'W]"lF.MjfR3%)**u&FT;X+#d[lK%hlV?C/Vb*N%X.dHlTI<.+P-R&2<R;_`4?k8"'$pjEF6e!mL@k^>)dM#u5FF&@)E6k?KW6?O,%VgZa_caQn03@G+@#jn7+[[!13[,SZ#$XJ$oh^k8tSIN8/:jZ$UrA,bs>V.f'HoG/H3INI1naL`IX#Qlj0\JjHWVm?H?+';;N3B6h^TV5XikIHtZ>Na@oTpMaim<M@:kG1=Q+f<,AjpH;Z=nMiP^d"%qn\%&sE"m6P2eNlI/RA+n2@@VC.S-s0?3L-sr721?H;Fr="L6%K=gfGkpkNL'8.>0V+RdiLBbml]?,q7%prL@Cr1C#kF0!a.$?_6+4<rEO=U"\+0_lLd^d2miAk;aK3.D/1DGaO84b>?l^[o7j&V#(hLdm:33+FsgXq'^;H[rX,!AWpJ'hNA-%$E"<%ue61Nr~>endstream
|
| 158 |
+
endobj
|
| 159 |
+
23 0 obj
|
| 160 |
+
<<
|
| 161 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 5406
|
| 162 |
+
>>
|
| 163 |
+
stream
|
| 164 |
+
Gb".`flGh<P4/C-I+k6+8J(W)mDIAX,\nsQOsTiBTnn^Q=X'mUT\)4LZX]`EIBj1b!=Afm>&M[+[eg&U.TGN#=c#gfT]/2)r;S;JG^B\U;[kQ(mN+VL'bg!fi8j=VYHRL/>7<KKSj-:Ma#+;8'MEL`e%r*LWB*ET0ji*?2a#'&/_(![_KhTN_-I%nRjT*mURs/.mTVY4LY7j9^8s:%P8HbCV;Z5.OQ[&[(U3I%LsKZq=>?Gn6!&2UUj=99ILUM9^ti?#,aJ<Z'DHKh]>!/pJa.X%d1KDU*8@lD"Pe],B<N!OSmI*iJ.5FS29W6I!6`6u4Or:NoATDn%8u=+R^Qu[Wo9@:;&iV!8WroR#o&8`1`J!j;EWL8@&1==77?+n0<Z'aeN=f8WZ.OiP8(o8OjZ6ua/:uNMO(Na/Ql$S!hNLCgV%YOX^o2E=Fs/k=!"H/,VJ:=TG7gje?DGHgQ&$hTW,A/n$fj)3%^Ua/P4C%V5EPc&l*f,/`R^UFeEGqMJ:`sN$aMt"jX886c+HK]aY>a;Jc!"HS7pq]d5;r\L>OVAm4s;YBB*Y\u!_q$L(LNZi72-]>\QlGgi,W65:%>&7BJ!kL>9SqK/#W*l@k@mP_T,9dfgL!+3jAao1P];Wk%hE9)>p"c!+7'$f/MkoRaUJ]7pDRt`ZU`lXBq1":>g_ud6;n47p]&Rd.h0OFRV>pi8?4;>Ba2&DQLV-d.>-B.^epg#Q:Uh9mR@)B2PB1`dnh=KGhHRM.[LsONfP"KUH4uJ3H"!gqHXF+jb%m5iOcK#6tSh,R7TmfZk6;QhJO%Q+dF]dE/5M4h$_Q<,?k$mS'7JT%cc$;Pk$4NA`#"^_^=_@>hkX30@F0.dd>]o()[Z-tlR2MAiUt[>(MQX'iHuYPC3nps@D%f6#7!9)rLck_gR2(fd`()eH`UH:;QQa_Z$&q:2DZUt"@D6*#Lr'O@7M[.;iI+n4!ASTPJUPN;U:B"h(gs<HbkhaM^0>Q'0>?g'#.Kf&'1@19,BS':K!XnN91n>1$Y^\#h<_ehPWfmY:B_'O?LiA$#lfMjQb15]e.qR/EJmZe=bOdm30K7]cjZG#L@ghfod+/6;b/m**BZbA8SACnP=hg4kTciuW6W#.bg6\fpD#Gn[ubGBhj;Vm65IHp(Y6<K.;?J8HR@dhj;PEc=lPPiHsh"pD$h+lTbBJ=ZVMqr<u:tZ5QdYF(:V3'+N4fh45U\RgIV+U)=M$K+bPP[TC#ZO,"(qm-T$8rr&TFD3a^5:NV&)r(]jHu%dDEl6`%u]/R?%+Iu`I_kcHPjE2/D2H3hsX44R$U&2'#^.U'JhE]+kd-UW#9AeA>=."N<X8.8S[8Z"-Q,r#pk@*V3j"qP5_Yo-.?9_m9MbDZ\_6NtH_/LZ&!IYQlS39O19L1j)*FS$TI`o\gVSEu\g/'mJ+G$C%fM7>OYY#4:ngui*h2p<8raJY)Dro'Qc*gVQ[r>KP6LIVu`BRD-Cpkcu,6a24JEN,f%E0mlm*@bf0&R*3epeWa-JqoXP+TVrSEl.K8)V,tKkqo9Z-LoJtYPsFZrR-j+dOgkb6BFUd/D-bFjLrVXM*]0Nnl5nUI5,D\LhpX!hA:gAMAoP"jaAk^HhB[M?OY)!;e8e^MnuilJj@B0L!@jXa%WPXMQ(/fXEfD/.rLb5X0C%W:"U?EVbdtfDS1;t(MQ^'PUe_p)"J2D?/.pT`C)7V<smXRP/O^N%'Y7M'I361>uCMA`hWG4-pcUJLIN1RahZB:3&]bI]NkW#juC/1:D]ubMBLnIK]FO>,4)=sC^%!5.:Sue\gFmS<F`ARc^1DJ"n$V%r&52WFKsUlR4<.rn;tMWX9ES32-#oU,!>*ZEkeLua']DU_BL0i5_j#9$Rlk3TEo*EVX":cV,au_N%j#o,Pl&?gqq'W8sV]mZ?*7H^aH+(,5OR:ZLUHLUB_dM+Z=2C/%X@V!3Zq8*VJ1BZ7?\?IX+a2!ZJWWCQpSqOM<c*O%A=_0G[TLj%!6-5s>sj0M-47^uu*qpc&=;Bu\"+a$%LYHA:EZd_`HWW(9Z:2]&&VTPHu.GU*c<G-73e<[NQ>lBEuaaBh>\-VN$O:X(F^^S/RMlSk6]B;q-3"ogFT3RW#Yp@NiMGB#rN[0JqVTA"q20/:<WOHE4RFY>n\h&30g#B'A5o^l)R<e=o2^csO<cbBpoQaqd_B?kl;a13BOcR9D9*E,ec7rk<Wdtl:?SqSR6h%.l4j<sR8aEaK1P+n_K5>CTh4`;4<cfd/r2]-BbCbSI*1/%T[AAg_hZ?qo:,("`j_LK2"pl:^9$[o$<E/h-bCmaUbb8(Dp*s8)")BGSVQU_"[XHg.:du['#)Y@S=o*Q$,(jGT`:W)M8nP:=r,K)Et\"Tp"=OC:3KP,[*f(it)rLqRpa6=N1_<1d<4N)mKU@o]QbhqmqU\]8,1&n90?'7(K4h)S=S6p_/mW@"T`Nab,Orqu_S%jAb?KtA`]`6?63'Ams[<mr4J"(g%POCrQ/Md!ldgu0Vh5!Hb\,,pP<1;;)5b\+Mp$nJ8>\CMp_e4(_7Ya$l6SH%8m@JF`U%1:mMM6$_V;eg]s%mH'6M)mK>YKGUXKTX-Dd/mnT_V)=l`fdq67P1J4`6gikuX1#1&E-W>.J?48NefD+)+]$:q*(V@ilGBX$9_HqTJ[cic.)<Oo9D>T0"=g'f?_5-/pl.lg6!:!K6!tlWNcM$X'UQ?AgbGF/lW!d[_4s>fHK(4Jr[e4H2g+A1`^M8]5'Z2Inf9Q:6OLP;f'b7:h>jnQ8`n4>>Xt(A>j_WbOCcgcqFqWbojOHUfFS5=1>#93KiPmu*o"U%U_c_"dL5:Qq-)XGZJrqn?,I#\:=cl/!8#?(Rm%l^,VMj`];,j-=(iEns8(;519Jj>[$Ck"YmN.u@FtLkQ?r)REhV@7:]Ve)bO<cQ;eO]G]I>j0$RVBQSf1nX%MX2S._m6,WXJ+6';,E2aYi<)[&6d?\I'WE8Zi)<i`Ta(ap:de>'$B=*b,[jn2gkp,nO'#!2,U"E*bd<.nNSeJeAi;Y'K?_TV_+/1]CT3J-jT>a5fGOag[`)K\Pf,ef5mNNtset,FI]X?2=95VXHDjoVAMGI2?e*8<hdFPgF)W(e+G;P9C'hq/d?AE5V=LoS:NIu5dmU%n^oJ.4_1!P$O1u9-0<3pZ$ZncFKGuue+rC(L*C^!U5Gf%`99sU(YaSIdFXd(K"L/Y'cl0Jj9Ff!Y0W9qtOW4-t`BnfKLYP0Ds]d]ST/j2`N%9h/&>uC0(3%qnCBS0\!"=-QP'Z6)'*BeJ<7+G:E)!ui"CdAtsE;Ob&Fn%rQGP+tgS%?TX8B5;(:Sl$iB+70jp`k-63t!O_QAoJ7Y,EfR+Uka3gm6Ph%1A!/70*u_n^O05SoI.M(skbkXW^AjBqEh;+"+t:BU#29?4.dCF&BnGAi!:\hbh0q1Al*UMRpN$e-p4un0F;iW.d#KAYjhp9$\]9_C0kM24#KcTkn2`MZ;Dh##-su<>r>$s#)"657/oH7(ZUi=h@:>gW3=XR#0dGd6j+?c5ZicA!G)Cg$1D,%sX,"/J(jL4Ad#/<HYSZ&)RnCZCr"m\c5cD/N_X43;AsMi1`.4!N$J"3JRFIPk,#`3E^pSYi_>/^Qo%n#Tj`1IjFqil.d+H<0AP!j=<DsFYMK+$a?+&>H<t=laa42>"=WZ(<6fN,>gcLMV=k$XugfNDf.Yid,Kr.['I8B(;g?UT<OGRVUUA9.RmH$Sge\\4=g)P8g-IBOY;mp&ZdtLkkQH];rZ!E,u"M,Fu0/;/99m2///ZcjZQ'NaR)dVN0hA1,kV+^$Vq)<5bn[R=uo0U?&d3J$@TVPeXA'Ml_$hk=f\MR3[[=^>R<J=2*)k\Q*=5^RX%3:'E_#'7<Ik:5!AG(7d*@4JVA8%L8%'chD>po5*eFRVtN#@pUXr!A'`Lb(OdJ4UbJRH8R2["RA>rs\c]G>6b@GB#KfLWABR]VS)oZ@#rhr_E.cI9&VIcuR^hS8:7h7#Es5LN89l,k4BIBBhA*ropA+(U?VqGqk3:$T9enF7q+[[g"5OXu44u2HLI4o()%l^O3>4]k'UA(hQ98KYK_XaQ6:aJ.00I<@$$Qk;'^a\$V'QMid`5%,)U8Yh-TVWiTg^Ms0L\1I%iGli%tq=<#i0UX'Tt<ZM!5nVQ&+.QXqJ*B,Cp!!86e!8_lkMU!R@Rs2\XdqcL5M?C8^rKfrH;&s2[eZDjl\o$lL-V5M]"VbCK"%)L5(<#(V<Se!0Y7&gb]s)WV,MnI$("YZ"@'"0$Hh/GZW'AR?ffBmJ7I!?koZO7ME`!E%]T-@")"ATi9F[?9GM/[b'^1D3.B;>H'W3t=>3kS$E)Q/_QUhYq#,3rr8WLD?ED"'<Or5fj+:(=N+<1"7G44uCd3HR=DoPjP(f,g78+S4Z6A7%lrXr=q#PJSZde\MamC"3EpY8D7C0=JD@\ek_Po.,1IQIB,"n4t)0!>+_+il-aURH:O4403bsQH@M9o0*Vl`%Ze8POY3aG<*T7,FMfXc'[7:J]:-V3k#@3_g4SrP6BA8lc)^j29(b@<2DJK7*So;kQ9I#Ds34=%\gN#pQK+adi(=m(A;4E+:#He:?h5pqV"Nj<[n@q#&AoH[."T)6Gr0"F$VQJ,"-X9k7-f+RRY3)jZ4ZDgVe@>'0gcIrFq2A[B:YL.+JP/MQ,k@X9E$ME$JO%FZc>#9XWl#4bqp0F?&)sEJa'e-k68,r-8EHq0iVX&Y=$>c4NGg>,D`\Z$BGs4!FCiUqO2(]Ca!c;`4e),k;"'p7EUC)MEh)s'O8#nY4u,4RhD0a\sdC_&>9i"k.\-/aYKD:N/u<1jVm/#8D6OSZf0b3*e/Y=!@HurE#.tceUUfeOW.-/U1n^uI4J.$i*@Z;1&Mj#/J%Cuig,H+`=V8-^s;T+3p64TmYmqYBQORZ`o/b\%RjFtSL#:0NkT8Qmok-Y7=/U\#d1,c8OCcu_V96UcdH@re&>l#]U.g%a-6,O@-_R.);>\gO)Ye/L&k$SP@VMI)`X%4ZD__p:Lqb\cPPo[2\Sq-M4`qp":X?eU'Lju.q-1p[@!o<g>.""ZDlGp3m>!d5/al\@ioc?c$_]!StTTl5XG\DPrnnh'&cDi#3YdQj)6c-M,0FY15159K0(!Uhp@ZbKT/dU"ak,/ds6K,^.6kRMBU.t%ot-JR*gT3d>"9$YS-#R^^'Z$cO*PkF!$Hr1#.XCJiFTBAg0SjQf1clT9k;DYl8GC\"ZPlj>B0B@eqI`Lo;jT)ne[=0Sak:Y2BABGp79E?p]-Xk'0.;bF]?^G:]Vcfm*ki2_maH%0`g)*isC)@5OEU[AP@F]C?&+=p;3P:2E2]G/cr9ncMc\(e&BT#M4M'!Fhe[^[BRglj0BU'"Ij^8`3m0AlVUA9aj(s]R\05oCDiAp_u_M^>pfd&7ZXcGkGu+1W<J~>endstream
|
| 165 |
+
endobj
|
| 166 |
+
24 0 obj
|
| 167 |
+
<<
|
| 168 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 549
|
| 169 |
+
>>
|
| 170 |
+
stream
|
| 171 |
+
Gaqcr:QLu!&B4*cMK`U3in29'VT4sF="EYa/a=c_j9:aoJ>%]GmC08*q,^^.jRLI,a);f.3:-Pp45dZblBQp?'K)7#!lYCNMWf8+H'.]N,5dTO6>;Q;OGkV;</;`r*.BiuZchhp-W4SVJ7kR9Bni?L]KTJb-9j^-rJ\40P^?UUL;%ZVL]j@$Q2Al%6fW>,>2qrPm(8s*D$<\F9PC"oq1R`DMD)<"#JEe6*R3^GH38_EW$dH-Y96GPab+Smmr&e0EJiQ-E%2-)REEl"bJLKRb'U;1O(]QT>\/QQd\ScF3mC)9\q"9Lb)FV:4"s!dP$*h)"ARrNo1V*q#^c_\_D@YH&9>p6)1Wo[GE_^F[,5j%NR_fjXcKTbH<]e'[PF$am5/^?X0ssC,8mNXdW?.ZZ/K.8''gi[3+%ce9OJOK>c2bcG%t4PC"mLXRW30/VDM6#]9Timn#(0s'SZdKe)"R#O1r!blgrC#=\R^3MRqI]]c@]2I:"!f>@#iIB,pHuHM\G"n!='p[uL'BX#rDp^ZbO:[cCkZlYmF6""5%to)~>endstream
|
| 172 |
+
endobj
|
| 173 |
+
xref
|
| 174 |
+
0 25
|
| 175 |
+
0000000000 65535 f
|
| 176 |
+
0000000061 00000 n
|
| 177 |
+
0000000142 00000 n
|
| 178 |
+
0000000249 00000 n
|
| 179 |
+
0000000361 00000 n
|
| 180 |
+
0000000476 00000 n
|
| 181 |
+
0000000581 00000 n
|
| 182 |
+
0000000786 00000 n
|
| 183 |
+
0000000905 00000 n
|
| 184 |
+
0000000982 00000 n
|
| 185 |
+
0000001187 00000 n
|
| 186 |
+
0000001393 00000 n
|
| 187 |
+
0000001599 00000 n
|
| 188 |
+
0000001805 00000 n
|
| 189 |
+
0000002011 00000 n
|
| 190 |
+
0000002217 00000 n
|
| 191 |
+
0000002287 00000 n
|
| 192 |
+
0000002619 00000 n
|
| 193 |
+
0000002720 00000 n
|
| 194 |
+
0000008604 00000 n
|
| 195 |
+
0000015370 00000 n
|
| 196 |
+
0000022167 00000 n
|
| 197 |
+
0000029026 00000 n
|
| 198 |
+
0000035237 00000 n
|
| 199 |
+
0000040735 00000 n
|
| 200 |
+
trailer
|
| 201 |
+
<<
|
| 202 |
+
/ID
|
| 203 |
+
[<69822d9e7f5f2b4188beb23668cf8292><69822d9e7f5f2b4188beb23668cf8292>]
|
| 204 |
+
% ReportLab generated PDF document -- digest (opensource)
|
| 205 |
+
|
| 206 |
+
/Info 16 0 R
|
| 207 |
+
/Root 15 0 R
|
| 208 |
+
/Size 25
|
| 209 |
+
>>
|
| 210 |
+
startxref
|
| 211 |
+
41375
|
| 212 |
+
%%EOF
|
endoedge_qwen3vl8b_peft_suite/reports/qwen3vl_gi_sage_benchmark_results.pdf
ADDED
|
@@ -0,0 +1,187 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
%PDF-1.4
|
| 2 |
+
%���� ReportLab Generated PDF document (opensource)
|
| 3 |
+
1 0 obj
|
| 4 |
+
<<
|
| 5 |
+
/F1 2 0 R /F2 3 0 R /F3 4 0 R /F4 5 0 R /F5 6 0 R
|
| 6 |
+
>>
|
| 7 |
+
endobj
|
| 8 |
+
2 0 obj
|
| 9 |
+
<<
|
| 10 |
+
/BaseFont /Helvetica /Encoding /WinAnsiEncoding /Name /F1 /Subtype /Type1 /Type /Font
|
| 11 |
+
>>
|
| 12 |
+
endobj
|
| 13 |
+
3 0 obj
|
| 14 |
+
<<
|
| 15 |
+
/BaseFont /Helvetica-Bold /Encoding /WinAnsiEncoding /Name /F2 /Subtype /Type1 /Type /Font
|
| 16 |
+
>>
|
| 17 |
+
endobj
|
| 18 |
+
4 0 obj
|
| 19 |
+
<<
|
| 20 |
+
/BaseFont /Helvetica-Oblique /Encoding /WinAnsiEncoding /Name /F3 /Subtype /Type1 /Type /Font
|
| 21 |
+
>>
|
| 22 |
+
endobj
|
| 23 |
+
5 0 obj
|
| 24 |
+
<<
|
| 25 |
+
/BaseFont /Symbol /Name /F4 /Subtype /Type1 /Type /Font
|
| 26 |
+
>>
|
| 27 |
+
endobj
|
| 28 |
+
6 0 obj
|
| 29 |
+
<<
|
| 30 |
+
/BaseFont /Courier /Encoding /WinAnsiEncoding /Name /F5 /Subtype /Type1 /Type /Font
|
| 31 |
+
>>
|
| 32 |
+
endobj
|
| 33 |
+
7 0 obj
|
| 34 |
+
<<
|
| 35 |
+
/Contents 16 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 15 0 R /Resources <<
|
| 36 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 37 |
+
>> /Rotate 0 /Trans <<
|
| 38 |
+
|
| 39 |
+
>>
|
| 40 |
+
/Type /Page
|
| 41 |
+
>>
|
| 42 |
+
endobj
|
| 43 |
+
8 0 obj
|
| 44 |
+
<<
|
| 45 |
+
/Contents 17 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 15 0 R /Resources <<
|
| 46 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 47 |
+
>> /Rotate 0 /Trans <<
|
| 48 |
+
|
| 49 |
+
>>
|
| 50 |
+
/Type /Page
|
| 51 |
+
>>
|
| 52 |
+
endobj
|
| 53 |
+
9 0 obj
|
| 54 |
+
<<
|
| 55 |
+
/Contents 18 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 15 0 R /Resources <<
|
| 56 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 57 |
+
>> /Rotate 0 /Trans <<
|
| 58 |
+
|
| 59 |
+
>>
|
| 60 |
+
/Type /Page
|
| 61 |
+
>>
|
| 62 |
+
endobj
|
| 63 |
+
10 0 obj
|
| 64 |
+
<<
|
| 65 |
+
/Contents 19 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 15 0 R /Resources <<
|
| 66 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 67 |
+
>> /Rotate 0 /Trans <<
|
| 68 |
+
|
| 69 |
+
>>
|
| 70 |
+
/Type /Page
|
| 71 |
+
>>
|
| 72 |
+
endobj
|
| 73 |
+
11 0 obj
|
| 74 |
+
<<
|
| 75 |
+
/Contents 20 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 15 0 R /Resources <<
|
| 76 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 77 |
+
>> /Rotate 0 /Trans <<
|
| 78 |
+
|
| 79 |
+
>>
|
| 80 |
+
/Type /Page
|
| 81 |
+
>>
|
| 82 |
+
endobj
|
| 83 |
+
12 0 obj
|
| 84 |
+
<<
|
| 85 |
+
/Contents 21 0 R /MediaBox [ 0 0 595.2756 841.8898 ] /Parent 15 0 R /Resources <<
|
| 86 |
+
/Font 1 0 R /ProcSet [ /PDF /Text /ImageB /ImageC /ImageI ]
|
| 87 |
+
>> /Rotate 0 /Trans <<
|
| 88 |
+
|
| 89 |
+
>>
|
| 90 |
+
/Type /Page
|
| 91 |
+
>>
|
| 92 |
+
endobj
|
| 93 |
+
13 0 obj
|
| 94 |
+
<<
|
| 95 |
+
/PageMode /UseNone /Pages 15 0 R /Type /Catalog
|
| 96 |
+
>>
|
| 97 |
+
endobj
|
| 98 |
+
14 0 obj
|
| 99 |
+
<<
|
| 100 |
+
/Author (Endoedge / qwen3vl_gi_unified) /CreationDate (D:20260906153334+02'00') /Creator (\(unspecified\)) /Keywords () /ModDate (D:20260906153334+02'00') /Producer (ReportLab PDF Library - \(opensource\))
|
| 101 |
+
/Subject (\(unspecified\)) /Title (SAGE benchmark results - four Qwen3-VL-8B PEFT checkpoints) /Trapped /False
|
| 102 |
+
>>
|
| 103 |
+
endobj
|
| 104 |
+
15 0 obj
|
| 105 |
+
<<
|
| 106 |
+
/Count 6 /Kids [ 7 0 R 8 0 R 9 0 R 10 0 R 11 0 R 12 0 R ] /Type /Pages
|
| 107 |
+
>>
|
| 108 |
+
endobj
|
| 109 |
+
16 0 obj
|
| 110 |
+
<<
|
| 111 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 5069
|
| 112 |
+
>>
|
| 113 |
+
stream
|
| 114 |
+
Gb!Sp=d'f6&Ur?8kdSnS3<Co/3_kt$k]2'mg,O@SPm^6:bE7N8e/V,"IXN-%S(p"0E[+Yeo('R-IA"4"ps9!EK)_eG]A*J#\;"Y"-r:-"CS6u%_=\?.o(pJk-Y82\)dJ#\h]%mI=XF<iVQOF>phKVX6#nKJVe,%gD`F=_/7:A"7m.42>F<*Rrq[qrLhO?Po&LH0,0e"VKa"R<4Fq^'&XeR7ITUhJi0Te6Y$njQb>5`0Lt"6(Ge4>MYl[C^ZQT7!3+'Mp8%AP%En-n$>=d4Q:7(\"!8;bUE#J3UL?j'o6QnSep%9!9K`.+5@G\@"6>b>//_Dt)jqFZg/qisphP$5bZ:MCuQ#$7$0msG;>:>Wb)J>r.Kb:<,B<N.K=6eA0K_c0nPaO_1%N)'1:rfN_?BoqHaRk*gX(7a.[+CK<>n>8?[!4Kr00)?ge:76C8"(KX0oDa-AZMoN1R+G,.V1CUMqJg!p+Z@ihW5p,JiHr0Rp_e<\Dq##^4:G;5K(<#?R1k]oCB"Xfc8l!?NZ?ieOOEWr)L0;T_.e=cEdsB:BMZSlaJ"2<Lb]%h*#9mbpoEDjFS;QlOi,+Nm_2MA96B.pg`"/3Y+U1-1OL1P[)H64%Y%f<dpCSb;c!o$@lW*YF+"#D4KD)`\lK1>T"kacnP8I&#(mZIGXHmKL$k]f]>&#OD_;9,1tjj[c//gRi/nl<1BXm3UK,,`:rb*K3C1I_q3%GC<&cD<j(c=/m\2X[Y"[Z3[3k$_m-&W^p8T!AhPW<m,ciqa<e6l;E3aD0R5[1:_&_D%MN[SX[qV?4kQJ6"H/B!L_,jq:K,YZi2/8L*BAV.=!I#"\.WgkpI@QYgii3'N@)c6)*BM1*aeGC-5)Qo>C7(XYiJY$"\ToRp[<V2$..m[Gr?d#L+"X9hsb0a7nXm<H6RnbTmuq+mGHebLGtHZ!VVq\a8U;E">S'u6iomF5</0QE_i)EpV69I3O7[7f?cMF]'QW>I`2Q9'![@Y/:CRF-dQ[!,SCiMe)(nnfjBZ(,`dgAIk+iaO(fSf`OmG`"NJ4=VfN,_9#;F4@PlksA?cV4\AG`mXb.@O&h7^`!>a^gEnqn2V0XWh-&M(Y`0&uf#5'P*3DL9/Eknn3UOFhl=XW`?L&@5hjXdeHdSC([.-CV5#Ih8?>p+W]`UIpcJB37rL<=2l^ls6QG?<!3NklR?XG:D@n+$F=4in)<<VAa5=-3ds[1/bd>J!F+A:nI$)t6eVJ9-+=!C'QnN3sVo;q6EiI&d94($SOjHJqt<4``da!;-c4-YJTPJU+5#-V[:K+&8<(!H/*J.EsB4PlnBTbX@>V4$^t1c]Dth1u',^BorT;Q=Y?%,A2.+Aj_7g]!AU.Kkc&MIfq2]%GJX!n.[GVp)BU>L@99em:X0G&THCF8I2U)o*R;m1ocmf'(5t#4&)la'`pI3Va>Nq!S8`CR:,q="cgpI8ID)2*b>@ul)Kr)(aecI6<.'L8T&G6$ed?P;DYHQ9qn`dbrn,a5ONb7,g*`+F.C/-hh"h)F\:\oCH5^t!bU+LQ3j0'M/8@]Ja-#b*c_!M.QZ8^?D'V'Z-0:b?-WcaP-3"B,^W'^lIG+\<nEfXH]I[aNFZ6WO!um!_;7hmYH!72j]g-S3ni8WC;eVsLg4NV(^^*j&kFauiP=8@2Gt\*7UVL^'XH0EK_3R\W&3Tc^%9d[Wr%Bf8iiU52m0VTha;D7?U*fLLE[n+n^?c"#X,q[M8L@AU87G!m/oMtdebj7gKp"j+'0/ZDdSakJ[mm2QXQ,`9O,29O=hg`o/t?c(:SnKQ7nGHJYlThAAu`dqqNoA4u9-OqA3.''PE2"iKR?[J<@@u_jO$267;L]]2A#uOo?W3Kh\S_?rkUt50W:LdYG$GNMb[.BC`4tE@B#3'sttt7%9,]42At>Zj:,;l<(G7FBeY05[Vu+Zrk:OF9]N]@X'N)K<]QtOUoZZlKEQ@"tQ3Zi$gBcgDWW6**8KS^Z/!8UesrXcaJ^cNCUA`D)0.4iV<%UX3arATiII$43oAr`uhOCB(>o_!lZPfd;'B^ChDHL[-8Rb"EWpnD*hU[#<$#&VK\V+=I)#TMYX!/@MH,YOBH8G3ALtSRAYfII;L'pL"#gkSlqG>9nKDM).gjI8lYS0#ne>#J.%$ubk.g#_^Lo&CCWSArUHN;_:.i+k:)oXT1l,2R+r]$$.YD=oS$'D?Z,X5-l-e:hP6JmPEBck)jL.ONk4Hb%=<`Ekmb7!ff?r6$3EEVYYV,[54$37-P*i'nAiFAh1K-KC^Aka__/ubrS9otI2&<%e8_*SI=0giq0)>=lO/2)mZ-[Xa5%VTGC&DUTBYcRJFDNYqNi5p7iZT:R^soTkHtn4r)>u*Y1mj0:K<&-ZlAL5eaUNXmllOs$L/,Cfo))!\F*us8@`<d%p'Q,&rJ/XB[<t9:[PlC%1ZZ]AMec1*d5H:YYYD\.9HDW!_4R!RIL.po&uC_rJG32*-g%0#$%9AQ!)]/cq_KfUd<t)/YsXiYjEo2YZq%"JE!E18PEB_p%?%E]pCp<)mSIL.Nle4?W)^>&oH_J<sX*jbM=TNI!;8l#s"oQ3*\&$4:H*?-.X)4!Zkna8BeYM]?D6#;CJurn<$[@^+p99S,_-j>(7qD--UN\p^B-8_'cKia2pZ^.7*0H(q:GkPI.bbVLj?"MBLI;8@;q_@g;j(K)'bb2MEDc2-8dRik865"2:i!Q4c.F?fEmG1+mG83WN;U^XRn;=[*hX/9.OsV+q\==XVk`rUN!-p4op2P4Z1,gVj&;eW_a]XdF0$RQ^p_9GcN*3_=Qq(ND";D9)!6UU5Gq;&,a*Wt"$:-$ZS'l]OXb25k)S:8rkW&nE2K@8.L`eKJGMII)2r[2e3,9/rCs':m&4m:rq.gDMI^b4r<F\'#TDkDjtSi%.XYMiJL:&]lO@/#uUK/ai<:8,^dh=,nX/_i)+-k8D3\***M['>b5^lTTU2:<5]e).,Bc9j6(%qsH4O.,O1:#igT!`tn(AEKVK`ngZ;-ag1+go`l+Xg",@'iFpH^mN6pl40Dr47L[>E=Q=h#f)EIX:S(/m\0c,t(n'@'L46&2hu!*2RtegO7Gbj3qo@V`6b_C1n)\1!QJ=*n>acS0ak&-8SS"G@Yn<n8(7@NbWD@#m;el&Vi05fr-9J'<ChY5>^CrrU5\XTeRbC`$?.3plG>2rFbXI,t>=Uj*`u\I!fkp3P9muibqH_Q"kqgAb]$AuHmWZr4%'8idpa&)F3QJt653$rJIEL%enp-[NC(n+mS>e0sZoM'ss's)[cKU@g:]<+jVEXrObaE)\eld(V-p0KKPuHg=D&Q?Do#jaqg7k,nA*O\P+I@5@e,AhFc^3A6?Y$at[k4`8EY<QpB>CnsjImCAQKki4E,F&DYHPAdZq5>G^08?F'%9Es,d@=ZBdO5ZA\g0uq+W=o=bqH)TIc/Q`Hqal"fpX5R]6O?T_s$MIHqG"#9JV->EIi?Q_HO#,f/M/Ua!rl6-:/k#t`_`b4*,->pabs3X*n9-e99(]!bb3=Nco?5SY+hH*iaY+dF!Lqi)4H-SCkI;b9e+D3NkT"f[`)GG.8*i",5Walb#pG%j`dI)pplr^?li29N'3@<H#O+BjQ24QE\ur?acZHP,%NWY4_8hE1i72Q>RdJ?I1cdW2+WHp)X<\&*pU!ds`8jSK`m9W]s=CU5EaE/^RHR);TKaOWkj#AS*uTX):(i$!4>paFnMoJ!X-k1(E;j]"b*<iJF[OlMkUZ7m9&Me_3ZY1aQY(fq6tG+HmCNIk?:?ZFW<e/-r\.E,WVgWG/<5A/Q,T2B,V](DJ>.WKLBSO;5T"l$GY?B@;@go9?VToc@.G<UI!g$mF3$=#<%3^`4saX9EQO.AX52kA,lK671!WMX`&l##bYqITU+T!F$<ZEWc_Iff%[HmJH6mjF<A=Bj,uakP8TX'EB?XTKP+ITbE-nBnD0RK/@A4c=^)[,mo$HS/?geq"S`)pZE52lVPf4AOi15@),^gE/%BA#@d[_Ok2GA/=?p>PH+pb'eXTab\huQCLi5J6R<IR8DKU6P<_d6)[OEIuK:QcuQ,`-GR75pTHP/ppWPP`(>Y.fG+HEMh:j$j0KG$bDX!Yr#u!2\Bb;L6G-V0bCG?OeF;FtWr27_cftN(;Q7N8VK^)Z(71c:CM=.+Q2IJH]!=Sp!/`Jkd7VoBX5ur;994oFR)/6:*itC#bonZ@Q.h@SET.MCbc\t;e^PcjhIC'gY:R[(?Wi@%\,3.Z!-p6Ie;qI%AtXcM3U#!`MpBS`*+f&L:g_O?]N6l\R)bj^qGbMr).*mGodl):W$JJ(^%^$<F];1di7/;*/b8"g!nB_,l@aYWBD%+2;Yl\WGLad0/gR=%HKe?r2_^1@7%]Vl2$;/Ln>s,#_.$pbrt.i(JAdQ<cH<:[r(l.F+E+C7m]u^fb@-K-OLY$58_4+/""%Ee8i.TDF0MV8+!nG&JPTaA("KPr-sQdK+\QhVOgmjC\jN(@(fZDtE"p(M,`mH..1B"(]-B5bW'cmc\H5aO*9\,>N^!bl"h)(*`k7IK+tDd`Z]-utpnF8Fr;!Lk6&CB#UnQ<)]>bB1#aMgmc)!6Co\9s\_sA9nCn[B0[.6'2aWbd.?7JlOecsb<n)\A3'?`snV(Q1*/kEf3ZLjWl3'WQ!Wbqg<Frcl2OhCmIa:psoBV,n'i\XIY4"oRgTZ4ZXqouh.4/e<sidN(Sra-JV=#\\68]<5Y<gTCg)g#4(`f]Hip+aTgBW@R];%)T/;h/tRH%ngPs3D"I&,SGbppas`QR%FQ@#Wgi7\Yc=2*/A5[N76c@(&OPl[Pi8jq5N(m>IuM6O-s,YeCG(Tt:6G6F7&dSj>'1eFamU!N\`!V;E'\A\5qR-ejRjrPaGb;h[:<-XOgO^j5p*`3]gj#\EfZO-mXtEdsBn[q\bo5&M/MO\?iUIIM-.'3gV'b<4#Gn!^83:ELe"(.Pr/[MHs7C$6X%I0g!u1[%k-rRl-QG1on*`m1,kSnGj6X#s^FB[X+j.$E414.Wg!]/[Il?SXJ@FrAD<Dd9U4Lh*')*N%h=_dP$$2]S^SF[MRS7nU/>pZ+0(nrU7'[>-.0"Y)M&`W~>endstream
|
| 115 |
+
endobj
|
| 116 |
+
17 0 obj
|
| 117 |
+
<<
|
| 118 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 3701
|
| 119 |
+
>>
|
| 120 |
+
stream
|
| 121 |
+
Gb"/*>E@Ms(4Ml_ESf7u`Z!Yd)t]g-P+Y7k9q'a@/.fUY-/)BDM%1iV`;0(Q86ND>9;6,r[L\9=,>4hWmYBsM.0F\iB8F<"#4Tf!gq>GX0]@H_L99-Js#[m-^\MnkCiO`QVjYTgRdKpZAUrn[Sni[t[0,4f[cRIIj5<t2\\=in?olrdn-unR@.E4=\$'47nn=ADln^=n<,#LN&iR++nG\R2f(*1_0E#89h<R#o&FE$\Gu'W/oSI7i:JqgXWLN<R&!jg("5JBXq]@h"4kbpU1k!gndb\bIpA/QrM0ss<\\;jR&3g$fp-uCHnL!^l[qnbt*7'0E*!Z]VFLQU__M=WTW256M@9K%5qA+>N6am+9[>W:5+Oi3[TX&Tcai344?h4^kJ>H\I6=BEFNFqBDi1bft.khDK1s=EHj[Td;]eR>l7YOS7elJp4_/V@,8:#;!U\+^VF1@+!O1\$$2+`-uHU!bI_!\qs?]ub8___hC`'3oM/4rg)O>e.1LTSl?E]q[u;=i[@#H"\??Jo'gm0Ym>RXpM@Wu8?u^[O;V).VB50Og'dlf-SGX&$c=OFlnEiAN-K@bsnFa]L_2SZasj0q;8`_j5;':mZ-N81CUZV/&6P>135TXE56(7[G!16Eo$Wb!_g,k#l>d9jKqPU9_r(X`c;T$q&ldVPPcmL,+p.oAuF\LO$cde$60seGVkFTG;=r0Q&gl$&asY@C2L_S2(DX\:aU`24WoSQ5_ZOYaf,O>HZ+YR:&sjnC/Q9Z\(tX\13IDRlB$NA<Y==85iNc/bpZ#Xm67'HKQ5?<N^8`1s(T-Z*%Uf$.44>s.;bQEmkUX\W.CaQJl\km*l46A:nan)t:"EYcN9UhDG`Zq7R!FCDsE:mks#DD\t"s38<:(fC,?qS6$1%E-R]*6AO#1FG(eX[ZIRIc)/e)!-F5TcOnH1C[dA3P"'Q+`,4Ipj1:]2-[nY/BcoIC'e;%o:p:r$f0_05h;`,<)BU#Z*:VpmB"/n5L(UMtG6A&"??Nt1=d\8A^-+B]Y:ZF0kS>Y$[UHm=OS[?m(G<R`5]J2EP!N6Ur3h';j@.1jW(^mr`*[s?#D@S6.]i;#pk*`<H!0K*P\cNH8-DJt`V:_f)8Wd24RU'!]'=X)Og(c$ZB,d9`=Q;7m@*CYLBN1:2K!4_FB<bI(37])-,<WMU4D*$;fJ1jLO/mucjE*-aC,S>l^k<n[NXpu0+X`(OuuE82)-[,\kfgKH%/<#(d]WI=".jQ&$TJIlX:iEO$1IU%X\:dPN4Il/0HKojog/1n;fe;[F4^qX=0ugkBk[0NN95F&G,a>m3Z_*1%&`;^oNO]l[8QT>#ao'Xe\OKpZO#DIsnJjU=1+6"On??a/#f;1SGTT22o]M^dfs^TGJERm@]]_K`.H'@"beIU:Rm&ha4iu.EfRb.1`IB_tW_BpolmIaXq=3(ukdHlrRODd;n!1"+qa@1&C_50q:!=V&<"nq"lFZPuhZ,=?3.m&"LV-]3<@EOofZ]@9&QN3_bLfP_gDR2.slRU2cAY-LIj/A'5.7&%@XS?WT75>a=q;abubm(R7cSj`2H_0i%p\)=?q),roCBSV>!<0\cufD,WH%LTHRM]u+;/q-%=WP,9X,?32KH(fU[bKK1m")a5kq#X`TqX@_pT;gps"Nr(ZR2f4(W`;%189[qps<Cp:^M\=SX(Spj$_^h>,Wa%6:/kC;CiQ`Mm;-@OPK'E:8@Qb&*;MtD&9DfC(0GW0eEcn%;ZZ,_jJJ2PW!00$Foj*/@0benBO@ih"PuE<2=dYj)Pu,V/&T5^jUT3_/k:oO^)HTcfs+X$+?9am%?%+DrWC]l'pL(^G;P(!c!b])UD0#9&-n2Z-gnD5TLa([V^;/PI7&NMVFF@J((5Nf5@QVOei4TT7G+M%5+s(eq0g%Wq@c>1P&*LV-hbEB[n^l+Ui/o;>*VZYIH;K(P*Muf9.W.ZG9bR'eP#/0Y04B]j0uC7A0<3U^3oQ8qXV%]BS0(<@s/c:hEs,;sHjV+"i-lI3DQ&L'Q=E72]l<*4_"B(\%aB!"jO6l-R!b2Mb-=@>gkK(q%j=Sj3o_"9@rZj'If"NHl_K%FJlf[[@5qG`,9YsS%Eo.R2G^MNgc(4qM'M[3`I/-2N+&Kk+5j90kpbJ()kQ&k*fJLOa`4EuR%3Sp(rgBSbB%LLi1W>()@'?29f0B;nRu]Y:gNPAAUIc7jWt)Ehh>Cd`ndRdGDm^nh;6OMn8Qo!UW;ELFdosSrZ*iOp,jECH@uIb0>k=Mm?KY6;@9"Um(@qGI`O%Q?AYSrCNT(K<_58X@Rp8Ccq@XY-X8@nd1lVb>N(s&GH[RP/cK2tM4+i^ZH(CV^Pq7-i^t"\rlUAHWSCe/2"E,#A(X)#n[^%kpp,=eirVRk:($N<]O5O*C'R$H2E*^bL6&o(g["G^jYahV6m^H+%@\B_B^=>sghaM'cp"]XBNSm0oiKl[1edLUHW(;/"jI^NIHolAZ_2S4lCIZu>[ZggK_hN<'#s:FeNm-Y*,($o':TH%0'4UA:Q4O+J]3b`Y0),11+]BToT>rMXGU['8k:^5:/qok:_b6I$)0cYbn^*;K7n0gP>W.4o2UKPUh"S2P-:pS/Z`!1H!6)pA/;\HWYf`0P>@49=BFa5?A<_lUW?UMRZt[W?.9dV@W"-i`"@g30uOJ,R>p<R?]l0mIA?^2iYH.7\n(M>`rqjcN5'bdHBs3m<$#P!90TJl9l@^N^3@bWgqq8fNst4m'B4t7"7!+7SqmNjS<t\"AnriCBg'M'3JDc6L@%?/f%?XuZ`sqr>lrj++YGO0*b*QQO@en;>qj'96/1<.+Ih6h2UC\Ji*D6A#LLk@LRW6'qKoLSf/>bIKY&3<b&"qSW,35E=pSu9.6M=tIfG5](%?nPC]So)<u?K;H-joWm$GL&G+3%B(V&Ine6`tm=NV;sSu.:VKJ)C9N)"S\'F*Lc>iqq[Kq&4#k;#7ri?CZ;L(;DfJZQ*,QTO)L!PD(r9c@VH34Xus&^%/:?+Q2nF:F`f.?ZaI'5LPmP<c263)<EXFguYH!EsWA-U[#/\0pe8.`QF9AJ/"BKMa@PHnCa&JpglBNf>buE*e^M@d3r4bNNI31AGdY;As&`Y>W(Mqi]l5:jN_pLCm9!gX.91$hf"0Rf.7l)!9S+qcT%P"H;F(l'6t7(ap$%*ljG"S:qfpX,P1%(,AA%;F[n**gj;>#`RZL8BVoZ0Rhb7r?$V@6."*'*eg6kQ7S4I5n2/Sns5RFm@gQVBZ[T%<>(BmG9s`0cu@T,Ut>P49,`m9%eVCE]#7qiO/geFSV-hCnU\WZ1te+<R=V>sL=FD)c50i"=o#%%gu$)jr[J</2OPta)VNUVS>Bap0/<=/eRHW>9RRLV8gsA\ijhnKfLgQp>#$X1Fm3NV(WF9>'$9<gKnftkj?Ll`X3S=)R2_c@F_c<^\"8j:ms;=C%KGPqpi3b$7s#qEMu'[@)Jd&HA-[+EHB"12`!NLCHih-nT5&UU.4q0Ybnm7[HLeOhfEc^B4.K3fZ(C"'T5bBcOLgJ'mC5.M\6o92agup25^ZPEVa\I(q!)pKr.nl]5^a?]@X*78!I,p?*i4h"geS27&=Vr)\`=%WnPJhVUBRcc`%f1T[BM(S2\3rtT0#Ji\u\'o>O4]p2$Qr^Cf=917<+:dfr$L4c,n!!NQ$b7rA(R5j8LeSq]>qh@ip2F>Z'98a_$'4oNoOfS,WP6Lm0=~>endstream
|
| 122 |
+
endobj
|
| 123 |
+
18 0 obj
|
| 124 |
+
<<
|
| 125 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 6934
|
| 126 |
+
>>
|
| 127 |
+
stream
|
| 128 |
+
Gb!Sqh6Wk7Z@AL]6>pkL`rq50_5-X`lt3]k<bcP.3Hq*mC5RXTRg]K+n2WN)lYj9-'#kb"b\YfVQ2'"Kl;i,pVs]l#VSn.;WVh6j,36d7o'JM2-mOe"6>aUeO$Ai#*oHncVJ:+UJK(]egp">%>Efs7jfZkeeb2^,Z3*9dX3N<SE';7K$$5#bl;@+s,+IJ=pubH68L39b'P*h,-Lsf7jCCpWkp7Rh^50_]rqkl\pETLqVg"1I4GrXW3K4[I9UMEs;(QmDREXKUrml2+-BGp*a)@%iKskIn9olhjg1Q%?b4>gM^c+!Xla[E.iK<m7Ht-:>j\=/YDqTk:*U]"&E?+2d2r426R/H[?=--<uaP8Q\B)+>U(RbeJqAt$!:tpQ9i70\NJ<ddCI"AA`Yh)F[l'"r]/c.9a7pRR5`5h><DKN2kK-X0c0Smhl&77h#?D?FM_Dj#0%+D!`8O9.EN^7!0As9#9O4+/0Ot#De[51eIR"fHU(W][QlnCj;#FVSOq=Yi0H)ntN2K=iFcita%L&9,!!]n&c^*?WNoA*.1Pbct]Lniu&A+=j\2njSPV_lSWBsc&*8<=f8&JdYR"V4#^l1l/96kFiq%^IJsnA%taAYLUD)mg)XYe*?^`hV]jS3R!mOaQi:EC5EZ"98<`@"6C_"pcFFi"N=Ul578"39C%ciju,i>Hb,go>^'55N";L2eI?30THM3;/`;JV!drPRHr?Y/Y=o(W'U`]4pplXATn\5ZmDrW3%#dbN+XNT.$)e%-cIega=2NQn<Y8CQt?D!ZQfL`-Dd8e0WC[NAc").JjH_YAshnQL=OR'?NO'u"X]+kUC!7?MK)9<TFTY)K@?"[/rU3L`k[`HX#hn1_/+@"qQu[HGIgWtm$@88]&-3lckhSuWCF^i4NCZgi[HjZ6/k<o9[l!1drX=[M.T$Sjq,J_,FnmsGP'g]pX$0Ra15f[`h2]1iqJL`!@U^i^dMAX*,g?1q&B-FH_3n^EmEUtG7i^RTS%#n%Vt2U+=E9l:rP,`MO3rs,#2!47*1!BV6C4nYSc<"`9-\iS1b$Pnm#]/U*fe4!7T*T$d1qE&9rU`7aUb5aN=Zr([Z242N($E4Ge<-h@c13+4LE^!E<^r4r/Wsb_u*-KZA(d9r?VXAOQ[M[_F*"90TL:I9J&GYB"Xb=")dW0kc.Q_4PG)SmFu$S-2/,B^@_l0BB0sSS]S[d*Yp=j::MJ;Rs\cS;&5P$YTB"@@Blefongk`b@1\C4-.sn8]4&"enqGF(Co>-TMjW5_S?Ge/f2=30Ah(E:d\b`%>0i66l*1-gGKfk5.dk$H1,#nZeKj+If<cmMKCbITRjQV%Y0P3&mHS:lfBXT8kDZs82[O56KR)UTg!PG=6"0l3Y-'7"DlL80k+R*@4N?jt9G1!ZGR'raW#X+\4jSj#UT1I9X4f<b1GfE<k34l0D9Hi9%)'dT:tgJEhY>QP6GBYXX$R,SngN]-le=@NL8hEs?$X]4BpuDoTaUQ-'P/cAV%@53]R&[>BF?>K3eiR-I3M;&amfd^$,@M-Uf0!&m2gMl0-$JVVgW`!#Wo`WXr89jgq7Pjdp-a6tq/pN<7uFW9H>\rlgE3(1Ka)o7qC6PM!hL0R.e$6L5/@!(Ei]^bc85CgTLXlosGm%XcoTPo]jJ]ARY,F!aSA"V+.rWB?(TOYk^9MYjR>o0cQ";r4s&>#[2PmDCAaT\8m?V-dMq('[i3"F6EGY@m^RIn3=%"8iKS:gQiDH[?si.L-jm.HV2"9e!UJmm([b0bdP7/7E6:GR[AVni.X#FIi^XIQfS^.]Lr)S,*Ypu_jP5D/lP,&Iup^QJgn()&2R6]`WK"<:7L0Dc9SXRnd)(Be'd5)=:T4O#*UU+gTq;ebJB(Gbstl4MX!+?;_U%AH-1<9u=FP^U!^+Rir_Qlln[mPd,tTThj'rp)b(@[LlLi4Nq:_PDpcAmm"i0WYak?mTfmKU<1*2m,I'QhdY$g5b@Q2FbqfgGLDTiGclV!ANScAAO2(p(*Y80^ZHTWqT68A1Of$aS3XNnF_%!m4bR$%.4;Q/cuGQS;m?%acZ:9I-4VO9FXndkLAgAP?ip6)IVE1gi:pj#D/fga:QU@LEUl/V;$4$k$Zq\n#oK`A!f/ed\Lb_O^G7`@&0+U!Gokae9mamW50W^0dJc2fj]!ZpFD7[!V&tTeAgfY8qE@4'-#4'XsQLHk])sl[1&f\)0Xd'`!^?8,UL67>,Vl.dM5U-guF1+g;uA:X7BcKCOY-@r$]g<IU#ut*LDi>(k[\4:tO='YoeElbR7+pE[sml7!(BifXIrN0HV9Y8<jr!`TOBe`i?!J=IW;03;#t/WcPZ2'KG%MTMR3F*(H9D+\j37iMOJ+eDZYL2+Ph[F*4$.:-!:YZMBHFcHNcFl-Su/IQ[dhWDW2UJ^a.ZP=$7tV?!>VpNM.')^Z(S]eQ:i^dE0F%Bjj*0&;hJAagCZ`@X(D;9L<S0emhTi"M9A_b6P3O$t7!'8`XqgX#-]+$O;$H/m);-4*eu.;p>:@iC=&/IZi-LR0bjiX?VM[pF6>\Ac\C=ure'Mj!ML*Pd7B@<'nM1DL:^eiTjoQ&%56]2OPFX3FhdD9M%)M:YCY^<Ra_.gBX3[]4AEEHnV42g1NlWmi&lg:G]lN;dV?L;?Q\?/rJubUr&8Y&JReLd;WA6.T?mH1d;.B\$_0[NX_:)j_EiG!"$^NAiUjaI>A>3g>W!V^@6aHCBjS)a-'8pX'Z0NnNWq47XG=1'P7eU?>^uRH)ZIkd_IK/bIQEq%\4eo?gLofWWZNZ=frqC:(\=aBbR=Y0=)rPA?qk-3MH<F)9`E#X*[.iI#CgkeedXf!F=6PB\05?,[bM$D4mSn%kp&iI%dtSFQFE\JB1SHLp)o?ftM[afX7cWGh-)&8'7451cNGRFZ3Le<ThEI%!_F4uF3[#bR%%F-?-o7q*e6r(geb9'F6n2'4k\o6UB2aS?qM414a0*OP_8EH<GYFP2&o>Us?WmrW:Or!G8h%(`,-"Yk)H;$X^S4MYiq3<3G8%IgM\W5(I7'\MtD$9*5I4J:V_Y5,a5$Lj[..q"?"@7D<!RE1G']\A0,*'Im(KSdutE-P&tOl/N$h"$f0!fAOb&sAmIW0jkhCr9WRkMI`&G8=:n?Z#;Bo"EjgJ5I+6XJL-A;qs>'(qm0X;4TZahLn/E?(YA$mN$Bf^1lbVLL?0YhhOX^qp(X>!n=YqO4HsODjS)jhHsps,e1gpiQW?f>*!]VdK[[&8b2R=[nRn#,D5mKY$l@k)Zib!3sKmKIoSMON<OBBVn:^??aq]6cp#/t`"I1B@nGA>mPOYunk9.%D:LWQ,Yd10ion(uOj`"i.Td$0\uPH#L2!(*U(p$s)kQ.?&+tcC:G2DIY!6\$TRMseR/[U<q8X&.OPWs1Y_4g5hMU->Dik2VXh:'=pm0r``jY@pa8!rrcsb-)H)M(X[;"QVjku;%H[:.]X&n#0YudDS!sJ+1Y3,8BioYAeLN-@e4CFn!S#dnHmTW>udlNGTqP*/-j-lj6P$sAscp;@d7`Y2CgYA>p^4sK>7rPD3P5!)M\>QNVDD9CTep';Ue1/2]2N2SN6O3$^%=K0X_J?_T*3Zecm0VX)PIl[>$;RsBo\m`Y%4BlJHZ2<"29@ij:@u[&i5AT9"V]i_?hD#<`Rs5Xe\K:QjI*&dMb\qhouPn3A96]t?hI\a@>;@R9S=)XU%dN!]9D2a4LI9S-W@Iq.Ql**d_caER>iTJ`;AtZ6d=;/U//LY-a&m@RtrHgU@7&tlV=)!24gm?T(2W$Z6"8sY@kHpqPq<M'+O\(J*7<0*2h(.r!`ZqU#0]nE/e`@:o63#\hr"-:NU=.J.lP@LQhDX7!4NeU<._dNc!#GPLZU9eo]NB_34Ir'6gm#U94,1P-FaQZ6GB,B,jJA9/fdcbAB-NDEgCggRBWEk#,dA$l/p,qjlK5c,Iph[lqp!R=)%2?B]`6f+!!';qZCe'2i,=Y.e:$(IdFt9)nadgg)A0iLJk&=d4US+tr4CTXc3Bk]"X3:+gh"0nUcmb+"fcV`;h[=?ItP"^Y$MlbXVG<p"[m20L`p::$\]3^9JpjlOs[mIH9cpWhk.4F_a?`Hd(+Id9!W?Xij#2Es\.U8m![O:V$[PRZ3o3Pci]04:ob+N(QI8M6ngO\N?iC&+?Hf5P]plfR'WND2!-K*cdZP3jkjetetf9<h4cod<n(I#='hat4,6R2@PpdB`">#&W#*4jUBd9/Y$U>3!?0QNBiDihb8leo6(`b)7C)QY?+jZGZRAeYQL?VoZ_'(Cu[AYS$Yf]U8R9jUk,X8V@+J"R*P5r!O#n[qW+J(P1;TaBcJaTK7t9^='5<g;7LH2V^m9H$Gf`YI]l[S-Ns'iR="_G+5:/HetEQLBl&(@W#sZI!Se/mWqZFpnZ)j/6FgK!$7ueE[&[>1lFr7Z+l*a+;<X=>pL&p7\sO%@1/IeCJq&M?+/mO7TUMa`YmMJGKb7nh5QWXlH&4M?tr?bmsI60QuQDHJ;?W'E)q4#H)BP@jihJKFkH?Ya#G6kd[6C[(!?&AXEq3<4]J=;C*f^3`\sp-`]3TPT+FlF\.1:I3\8mRD&o6kOH"Br;d!WOj/Ij.Z!$,<U#5\@XI=.]ICaFNo:b2cNj5huD'D-tkZjo(ZOP`Qfb7'>1BR":Zb2JR6VRq^[Z&PADRP;)Q<eU8#S,M+IqeCj@C"p"nBX3&TPpHuA<hfs8e?paj&s,,s&gA$e]K&)+0cf_1gu?-YT+7n`j/'GqcOZb5;X+AEepl/#aQ9aUE?@i%+UiYFipHj;8]`,A1',YQ6nAQ2O_!<`Ea.5K4li<Ah^"eDUAS1MEdG5\!.7<B*71j[jCj'!*nS1%a+(-deB%<TOE7Mf*,/ESmrt=/-u[D0@Ec>MY?8,'I'7%LG%$[q^?6Z9o/P3`J2lURq8><YT9@I]V@pLf-3][8Pjs(@u*>O)+[7tjl(^&ZcO:*N3`I5KcYo$/@ZG1UBf.6#%;]K<XpuY,>>VcBq!/2qfGSSOk6L?pK@?Z87\lW`6en7&n3nu^euM!=hQfI"m5r/*!Q^;oMV+u)<&CuPM8u?5@(Se/E"@M!3e$DPsnIbAFcFq[ouee;A'gT#_NOmV%V(i.i<(6I]<gWZmM43^mLIEk@c6+&@4=$K"A<ZXA&@$]FpliAc?]_`kV\\0<98qZ#[gf@r[mBa=pe)<.6!C0;)$L&[.kOU;35]<K*SJQ*]QdHkNa/j"B'S74,PoT.)A\6ffBJ\b5Ns#D,VcZ:&u#QM'pTK\.`0o+,1I6r$j[[mbJeEkD6iT6e4.QjnEf,p;/B=EUeiGp1I8%N8"f!)[8Ql]oSMA1(q0MfSMa$904i2l`ZWXVFtG/]k8&=]1JQe$'?:V#tgDgVB"46qN!-#ii]=Mmj+hWr<G*A`kn^PF6,tNTmL3RDD;RmA+D[M.q2UGGlgUq5oa(9H9SDSn.rNq"8Ja6E(9U`e,fPQOA$LO3X&K[[AT9Q=X2ZGc%G1>_+B)F&7BtP-+js-2K0X"mG6Y,209.OR7,'Q'QFrc<\87O@aJNHDj/eY91JJJs@*^hl%9#*[]5t3(75^q&/]g;5?m?Q=_&WISfhq@g\YTJ[1e>@)&C/_dR_2>YUI;@r%=fKA:m!Cl/!MC?(A5S3)833)OCD%aE<E?t/jCn&UDP'KEuTm-XJOZGF@fU)ZM50Ek&I+u4e`96$Dkj7H=eE^uKr(Fmdi3'G@bHueJeCc9#,bdL`^cgWs$h5b+f=qB_`=k5HpM+o[c\>j_^LU@In0hi,.-Z1])!.9=],mn]('pcpMJnSN^5nte@UhX]!Q3IKL#+<27<PM/^d]go:21,YjGm#fNQ]V?!&7D!qpJZ2&FK3eCXusc7nr(StnpE.tU^3^R3lET`Q8<'%>1ZIe2nrZJe.REF<?<'pUG^3:!h1*ti#sA^SJ'(>d6[$R=aW@-bdh'N)87kr]lX#IbbJMqYM8Y>?$'F[^V]!hl]FT9EI=tH6Hq/r[-fi<kVW$$2%+NF]N'YN4i;B4AlBM(I]4.EPdWb;g]Ehaj/]Hf?.fZGO33^l[GaRlBnM&tH_6@aGEZ0\WGQ/:\u]#`XTQpos&*!6)fAmuFU^HDZ6grD[Y-SDiQY.1F:Y#5iDVUAijcV*,"o.L;j/Z,1%C#oe>o]Dl](e<=Lm'heV9J"Nip\IFX]hP3\<9E[S6ItW\>+_o'O"^h@GJ]G?Q?^XkZ?X=<'e./:R!M?=E@;`-&\3/Cl/`I'?8I6!iZeH+.?%FS/5cadBM[X)dd:dkH`aqNR\m1jP^tqY;h4IVHANEba(B)r8_S/jj^gA2FaJ34VGp2WM/67C.'e]%]3#LeEEG*U`a4M0BkniGXRoI:b52-M;9:0])%m2_i"IaPBatAL_OU')(]6p0=]1s%=aL<bW5W_CF<4NE,hNYtfgF)jp9#C4\9:_e>l@]/t@V2Ke`EE2?>I.rR9>$nIt8c*T(?J@.f#$;g;m5[!'251s_a@`jD<M0QF=b[%mP\qOcDiRJPclf+2k\?k]tTDB:/=j$]30t\Dh&2Ai>]BEC.720(fb@qs)[-:]`e0h:3WuN/D1^p.F2W_n!Q9ODA*nH[T>6EGKFPW@8[7%ih*NUPs?LD38;d[M[d\hQ]@+"4h21A#-&?meO:*`cR8t3hC4Qt#_Z1LU@74Wf/bL#NIe#h"iS*j9=kfetjQY:Uu>V-Q]Ek#9so&Xhe:V@PT\s))fr7KX5>ZF!qIJ4O#)oU/OZQ-7B8TtciRuLPHPa<QE8p%bWLo!gi+_!%Nn7'=>,4+EI[7'*!&PJbm'#[rZ=Ef3S\V7),d#-/q[qepNnM[=e/(<Bi\V!rK9O9c&nht0h$<XRd@("-rh9#K()QVG@.SolrSZ,Gn(/e#k=">UBeQP5W1f@E/`34-;q;*Mp9f`@CG(/<!<IP_8l22s4e,CW\B0J/C880KES!2/rh],=8QC>J^Ii/.PmJ~>endstream
|
| 129 |
+
endobj
|
| 130 |
+
19 0 obj
|
| 131 |
+
<<
|
| 132 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 5609
|
| 133 |
+
>>
|
| 134 |
+
stream
|
| 135 |
+
Gb"/l?Z4[g(<,2&.JW*BCR4RaHu+A2^nOpfXg(Y*$HJGGVm>BKm1$Y!IRgh;F!t8,pWbLM1doa&as]<g+a#mehX_[d<:M&Qs51/`UA3]Cq!P76PV,]`$=uk7SGZXiGk0u]Dg!^]gCQujqt&6jg)<tU:'GQ'r+VWm(RkripT*,*S#5hcX)+J8I%RE=EH5&!rV$1c58N](X0[jgVjfo/c/Rl'H$`I0(DlDL:%@ZC@V(T"rUY%-6h/?\Dbl7sO,L>/YLf,AqtHV_YHBOFMt98:g)jD@ETOqa:-KC?hemekdrmWaf%R%Uf4AB;mk9<Rr@Z7NCTlbaeA\UU]dZ\Gq9A30o>[)]EkrJlKlce%R`[kofs:D?c+>r-H\^sY0.YN(34cB*D!m'+r=K9M[J`bL'Mc3EWLPK!Q&6ea>^ZFG<0_3G*+<\&XaEta?c=bW%InX\FV4Yr_b$i>PLXfN:r\`K-[tQK<-KXemH7b<n^0kMe+\c3Dqs1qa5!%;<42Hsc$0[Yf@3NBccLHPFE;YS^#%PQI5jukpU[/Z0=@sf_k?;#nuc`>FM1hI5P?I=g[@olAJ>O)re/_SXue#G4EdUZYh'[sfi#kqHc<_3-25BgdVbPjI5/n![P.[GpZ8Yg^G"H1?>F@Yilc!Kp#@?>G'S/>?9NH\H,Es\9YAYdV4`7b.Xm%gg2e"@FLphQgrF-pIYV/J6W7DHAF7Re1nd!@lEN9>bC4AuE::]sF&p7Q[Y_cJ*d[F+moiIiG.i`Y9cX\X<&T4*lhE:/C%['RCYe^^WUB0Q;X\+qqgULGMPH+&Ao[WTFo6]:r`=*sam\)Tp2*=7+5O%WMpo"nVsft1hnL>EpL@!&NFt^sGXuiD[tELC;,&uWBu9t<(/*si3o>#qF7je>,Rjte=Y:_!W[d?cp](/Aqi38`=Y31STaJ9CRWFXo%]X[!WiW5]7/%UlGL2kT%PDiZOb%i,GebrNno89hBVXsYnnI+bJ!A,XnJ?fF%D>e*5O>fFM\eu7U$C%Eh<Oq+L1"1o$/NPW]QJF%Q%(oo8]q.dP&"^BQ<ZK"[Dj!M>Y?Uf^E[&dB)at@%F<d0c<8H%XdnncfN-:r")LU_5I<"@dqu.cUpfr)nVQ1,im/]kQ4A;gP&!PmW#O?'S)2,KZlCbOZ1d*+CoC_"cF$KkJZ@MY(/!8#D+f>PLULcR@G@)QI:uin<d`ZE)>2LfXRghoP04AP97'1;Xh#+Ven4mVp>a?9,utl.[1qB)jO39l9<kBuEogiKUUW*3O=kmS-.X(R<lHnsS28sp.j^TqjUCijQIYKl.VHh$[o,Doh+Fh60Is!`Aef'[=^A0_QD[ecVmj?NeE8DVX>@(3>HobQ/tL:p]OfEr`7!mo=HgM;X_E?>/U=eR]%6(8]Q5\#8KQ0_N7(t_P)BiVb6dSGF+uf"/Q4a>CWY+^;ljBKY2t;k[;Kk@G?9^QmE;(I<Z--_B\8n&Qeq_qD,b_'BTq>*]r'se9<=\5K`h,lXYh]@Y`%ClDJH.t7\-nKmoh`hh4*G=l5X_T>&r;iBkctFVNl5HWG+6+YtZb3+rco8@&bMS+.-*m/cE=m>0]c8l[$8BlhY2-&do-Gb11=CP"V^%V*i5q/$X9_=3bga8hQY1<I_STo;eD?meN,VqNY</c`\hAorFTm*r)#&fm]3-OU_62n0_@ZompKGi5pFZS_1.F>-9fKVhSZ;JRd5rm9"Dn_>:cQh\D$F;o:BW]0c<JbEgLY])j"Wj0$)=O*BehNN]mAPr%'l?UYW;qc1q'Vgda7B)@iuIGe28VCuKu/+osfip?C,l=IR?/**nGbGA.LlBbQ`m7K"%\;$ik7dF)ah8'0&VRf64=.fX*bh87dG&MQcfF...a#n;kDqT#nF/i0JdLH42Tj3#UKN/nq>A5=)X..l:e`dt10qh]9`sXZP[e#IWi^2)c]O/dg#E/#1m8mc]_%JSM[a?!/8@Z->7l2d-E,m2'.S[Sgh-$'A/FT^PqhAlhEq,i7WJ81QSo_1BQK8h8ZK19Qb;,T6/8=M:dG=A0Z(Y.2KB?6q4hm.Qk81j.<VJ[WffNeL7p`@ab2+MJHCqY0IG1-6=R@MbnOd'UrkILTj_@*N.ZdX:8k5d0*1a*GFK2(_EGp5/URJJp'P14Zo:H?+9&,snI$]GeYeN;oqIfa#dkd\AmI!pA;:4TEd_-*cDdRBLmOpG3Pr-IH?'D:OVYIH6MR/OR9758Je9/ML^1nTRkVpF]D*t\M?:0+j2E9<,E3<u\[bhX'[11.J)rdp,5pqGkHUj\Lr55d((I[)>FuVV:mflk:G$T/Z'egY.i9<1f\o\s9?uRQKmA8<smNGH-+"jCJU163^3e"O*IVps=5HfS8rf<%;](fROMe-u+\[^Lt5:t0hj`g_QDALFj^Ph\)V4gVX`fj6Udj0rkDAUoS<0cbI&qAp<YWDisS\L>t$$uJ6'$j9c\oPm^\-YDp'K6'G,m6.-fq2Me_Q3>u^eMW<-&\7Cm"tmb'7bK4E>+Esb3()oce5h`KN_VHrdMCaT+bI4X>%<=1AlJN\TVlI,ss^Hn:D;8Y7-8AV,."ma36QefpS2.nK'4k"b*:5eu0*W033&L-'o^n?7L9'J-t9Co!A"P&pTNh$kk;llL>;MZlE#p^4/;.at`#;K?%B\DfKDpEolpRQt7(qB8q.*bs7"9TS,GnW)MlZ"Z9%X=5';qe+&@;1ZX<k:AkF$00,@8Q][nIrcbWX]f`o2;Mq%+63@YHj(1[!:l2%?B3fQBbf=]G@<QW;9%\3e/*A2@5EO&KC;:KCYrq02S6UO<9MWu6Hch0qb0TP-kDL(s[_sA?+p,;u[Vs9a1OTWVbkE]oE,Hgbc<8FOY+5"d(g#"]",ol*T2SEk`MM[SS+ZHpdgqeSQP>7I=9mbiEp[]3P"TG6(J'q^?"2btn&dZ6q;.Amh>m#e)0LIRalRTVbD6PNGMYd*Iu76\X9??X]j,oGNToR!W>/9>D<[5V'@?Mo9_/QWI+BHfEgceg%mJ=OA?5>_j#neL(F3Os7X\*O?Ln8I)=k[so0/9&`Id]LaZ_N67l@cDaZdPRChBto<+dQT$a)?Cfql%%RE<aZXdR;VZE:<cafZ*Q7M<ZfB1$+IVnp9=m,VR#CG=E^gU;&pFqY"e"_=o3C^\<pVlt]s9_MOj\K@<#%VE#QfBlF/G4*cpMTIK>Ac\=dJlrkLaY&ul_3jSSVOQ,[A1,^1>f3.IJI(B0NF:+,G4IFR1m=JWGDKb7CD44\Kk%D-a*0*TP<FA!fWGBfZE$72)p_4O"'8I=A.JuqG#Tf8br%'aPMPk\pQ!C,-dV>P9_N3n-@="@V[#!1/K\[1A$UG?1YImaG,+gU+;C$14QSgaffe)n5YQ@h*YLFZHiKH2pe5l"fm\WbZKnArq\>.5mciu.RE83-J*01Z6&9R+hF-?rB<jJ?RmJBaS\7l:NleFCrZ2\3-G+Eu4X=u?G/iRZRE84'46;\$5_sIOA0[ScT'Fm3[fYf7bHcXhG5f'7%`tkgbr.'lP.aXm*Z`A*$lo[0,M>Y3eaV2G6"G)T?G6IIdqdM*OmIpD9g3#KOhG@Fd=igNRu6Z:3$Pt+0=6jum$87OR>L:6;YE:Seb`<7mh:BeB-R4P(%5'(&Z&P$eI^C[AYW2#%nEdT_@kNBo/7.\jPJceDfd1M`F!&/'tAUI97]dZ&U*91&_WY,L;&)hJ]I)0LVA2i22-^>^4"Zlq1OU=IG$KgKSmKlfeqH9MnXU"KAg/H%0,r[IlFlN479_?cKu*miN9+@E]aC3s6bFH^V-T-AGD)+e`l[QoSs6mV%cue'7OQ1%jiGU'E77<b05N'34#$@n;$0k1DBb5=8k98iB;[%$A<#(5PIMOPP;qG1Z@#o)&*a5]:@+&LC;.UO1,Vsq`Yu5?7UIR.#nU@easlMB-oa?*)sK5R.,i9%glg`CN_ullCdCXl;rMQ)o]6<*#(RR_'Xb).(m@,?r2+(0W]&E_UGDgJd6m73Y\1c88s=#k?6CFKr8,+%#$)*edR8)U%$AGf*m?T^Rekg_S>A6f9Zu$-Vo/&./]mt2+-=KhY$P,i<;YQ-n%3'bo.%F-U/]'6fH^&\"]Pb<EWQ*#)GMm]Mj4H!^bkpW;Xe6Ghk&k(hY8p%##clG_X(2=s6*tiApM8)%(lG[:Ui"F;?o)iAn>(6fD1VobBdO*WJSA"\<:48n#m?K[8jAH9;nuH+n.ST^Y]6I+uM(iLM)RNJ,0tX!VF,r2WN!^2PJ_H_NAbiNqlcL;K.uC50ThB3Llkdm?@ZaYZ+:'V9]9L5*Qd>mgplDqJK5*#.66IVC8A$?&%V$We/Z?3g=9r="BEE(-U"puLtkW).`IBn;rHr@dZM:jDON%hF@qlmr\T$Elir/Kba6:em((_L),/r!\:/H&`X7AJ$%3]OBP08sm8KQApQac77dHG\>Y?5TCHo#<i8%a+SXGT<Sf7_E5cW4#7PA@T`RLUrHu_dsV>BKK%C`%[m]"hLcTiK^Z*mO3N?e(&sj:a+SYgHU8P_hC1KtH"OolSegn[=!0sn\SaR"#qt,R)%;5^dK"hpGgB,dj.Pneo%aWXKf>%,XW\)[D[_&;2+-=oIV&=ZmXPl5oPI19:j>^+k2\ng;\fOb1IX8<hKegDpGaY8(*H;%<;;>8_89(.l\]L]1DToNZA)m)G"aAJ3RS>5_Xf!8+=]MLmMAWPQZ0EQ2=I-O!@s0;Y9_UL<5j4Tqe;qE:J`u2<W$fHa1tU3frQ*V:Kbjo(PSur>CfMbQE7IT]+f#!MI9=<'n3$s6`BME"$:Judr20bLQ)O:iLSC7<;;s;`Ut<QV0Z\T:OFg>8)W\"!LW@q"GbY!gPbD5f^OsDQgr_t5YVq3*n_hB)]m\)>W2M\ogQZNa7^g;%?Kk5"0pg9I0-\4OZgj"_^!L\\86D8<fkIY8#6A8Cj8o_YdYq1l_ao-iUEee*d^2$r0SZl/?&CQ7AGVA7<EcZ=AX9/`YfO-m'"gM?<E9pLIYnZ"`3t(0NWj\2p')-U`stYHB,`tZs6`00^eBC(t=-8'G)&t%"\Em&/Q1j'd&YD$Ods2O:=i((uuk!`B)[?pm`a8?GniO8!Xg.*a:Qb/=<o`Nlqb:'$e"gTHn]5b6giScEOAmLBK9V$IV60W2-)ZEZletQ<1UNG%`Ki-C@rU%a%5G3QejrTYR^,.7'A-iDP7?]7Qj^3=KJE8s"aV7qDi-Ng18&lT:DE4'#+2/>q'6CgD-ZOBZK($juPG$PsMAe6:g_JkGQa=0S>?Vq+H]'P'Jd;,KU[o,SP\'Hl:!aZ2Dh%NH3oh[tGMfM<4s<0B6W/h3edc#tXC<)?K7%Z:Z4"qUManai!r:7rufFq'IX(IsOl8aeZRZb/^Z:qVg:gGlVo3)7Pk]]8")!_:/I#pjeT\2^2CXq;Esj:L20EC)/5>opJtk.BfpbjrCr-Y&J&<Fb@W-OKCsm^OC5^oVK@6A\k(JqOcCJcuH`>^(1LOG7l_`<[bhGHpc_S5Zb4'iDM&p8oN2R(P!LpIQ!$cc0AOP(^7ZljO(k'&(,+28GB.3md15`(<9FbT2roj?mLUgGNW4=k-J5k"J`I3oQ<<g:_O(S5@&qaWW@nBfX&61iKk7+7n?]=7d?ddmNg?_^jUA+'eD,i;~>endstream
|
| 136 |
+
endobj
|
| 137 |
+
20 0 obj
|
| 138 |
+
<<
|
| 139 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 7137
|
| 140 |
+
>>
|
| 141 |
+
stream
|
| 142 |
+
Gb!l$D3O!<ErNef!ai)S?Ue9%,XBe\<,-jO3gJ@3?$j_d[`ZRO+Gh.se</6U`ZOd+dfA8*;NsG&H[36(]3,FST*DmsT[DQu0ll6f=T8?_LsWVlkj<_U0L:a]KRLm2O$B<+*oHn_:"-sI6f='gHcHX`ho!O/3+.18J,RG7W7[$oEH?1SE`bk<*t\k3i=Md),?k':mecJ"'@/Rl@pD-kJsYZ-.a]1%noK@G^@9?Ns8'Vor"a_UmenBa*;J[lPUDm3As4<48]nMu\:h!?B^N+/d,XTYn]sNO"e5@=)%rfVT,^7al^`QVgrKe(a9Zl36pH2$`pqF!S#dF_o,SXrJ>+9_'Q+\sXT'nA^V'@JUGV7Vi4=s776ZY_1cpg>*rQTX<X(dG,"+/.,*u37`Y\m_mJd%'_(L`b$o%2qJf/Skk/*3=,Q.6u61C(A-XipR:'q\e*"DPj)r]'PYdiNZ_OXbBr5;NFe37V1N]\\.6cPFF"9YGV$7!(CEJmlZq/jc;WYJsE2if6$*chSn(EEVu3\I1F/((?SgKkl%D(JH?3<0gG.SenU^Q[gM6SFAO0G9)L^-c;h^76V?NCEB9j,<&27I`)'>>]iI7Hkc2U+k^`65Ggh4p!m#]t%sB1<Hk/,40uE804.C#[FU,8-Hg^8CT*r,`:&g<j22IYri^icuU#2@D\NWMLnT/\/.VM)%.)]P'n-HQj_I`_*V01o1h#MXecU6n=gIrhSDBLr"/kmm#8-SEtGd3]CNR*0o,L+-.so1O2nb.N+n`DX`6l7jr&=Fm(9rK[$GFo[>+sD$7"7kLU;if>,HSr)B+F%&_Cf[M6A[^h_<<T$NW&"$J][c6GStV!]Q'PYN3Lh8Ut#oF@!1-f<a$fac6#PfEl6<)7Socf2[Z(Bq-NeH\OX,*q;=60@UD)Bq/d!HZU'[T(M(2H&Al+D.@D#!diKJX5\Nf=`p4?XAK1l'h#Agb8qQ`XrH=8g'b0#:J0(mBj"s3;cr:l+_fU3;m;k=TC?*[3]DK11i(o'gl^p2CUH'EqsPn(b8tgp>&H$\[-m1b8m9*3k*+@Z7Q)A@hj[>Dp?2V,@UWqD>*R^'egXC%:Ug/B)IU?^1n;flp<^C3V,F.`O(Ad&e!8op)Ud/&^n*8V[VW>_0Fhal=S>?.dM;.ZAYsQ\%mKQhUA8nRc]II774im<Hh8Ie\`S"q;ersj:%R@LhBjdhL]Lp56Y]4qp<Yj/WV]O[_Qnn;n-5FV=S@0o]Gt\Ojg9EC:ksI/U29VI^;!%L$3N>UYO39ESZdD\biYsQL4$d<N6^Q9Hh7>G;;rJbQ06om<P^WEq08C3X:YYYL%/ujZA7#qMNHM5AIkoJ"uBhMQE@6.D'MV(>qOQ7A"%5darY`5)%=0gCirOGFge#.S]t40W-YZcAFmJbHh:_L9A,!U@OpHkZ;k&ha*;[89iomW":R$krJn%:13^.'Btgmnf(hp8V^YtU6P!Yo_-H_L+^iV5\0\51J>9[SQ+`?9N9-8V0mA!6+_),NcXs8*L0S@B@^.#^7isK%oo0gs'3iI;V]/stjst4tTmK4@]3"^Q!BA.t+*pti=D=.7.skg=aE(!T$fQDQpO^u+"0^!po@n674W;n^8rIk^ERd4)X`Kb%W;W;2f==LB2ruN9oDr%(*])t/>H7O0SL,45i2VL0.[X"3$Z-$afoD=LnmLUC\UN'q\?kp\eg#Up2UE@blr-?ZH"nds$=#K]VA>(lH1M]$f&4Gr<CC_feA&j"I\/%`,udqC\gRtUO`+H_$_Kh4n(!.8:`J=kgAl>l1r-#tJPrn,d]UF\eHYfu2L(hI!2%sL0O1FT5.(i-<D!@@&e.bsEaf0'CBO'GTKa$%PVp`[.'fgl^3i43^bE>DBYu#Wd['+5.RonRF=J)acp8b2I$_WhZ(G8RH?:&T-.i=K$3Wn!hcF2We(ULuXrW;e;ptUrp&Z80+6&/jRo^;:>>uW#r4G7ac5$1D^m^9G0$a^YU-+&dNb"i1`QJUZij(sD<Ut8+J=bb8F$Q*UTRFZPp@SG4>Fnj:-;IEYN;'tQ]=^CKRar5D`AoH>akh1Ek6qdVXPd?NSP?p\F3&Gp@ip+WYJk%SU@gUOTZ<8pAJFR1V&A^@_na``gXQ`\a8Obuk7at;]M?)gEW'9JGsIKC$udF%QrSm$j]dhIQV+l#//86hpYA97,-HQ$&9JZV<:PgQVQhsT=?e\5"f7'7V7D[1>@*c>=;kR<'&c:B%i2YH6IJD'jj-%.R#cF0QrAh(GaL*5;^<PNS\G.[WH1aK*/h_#*?K1368@P\."\+!e67+qK(8]sL*D;WW([586@uo%V)d[BSt\'&qhIl;.u_ZuYB'@((d)RSYQ7,kOT57H[fZ=$R7X!Y`W-O8!HYU`6_$s\(b0COUhgM.M^TV>=pk!$*a<QOVI'.[Mb9PE,83iZ:$YO&7(X;E:JA$+,k;AK.5St]8^n[5,9dWU\!5"MWTq:l[Rmd3n$a[E.K.iE6&C$)[AJl#BFjE]Dqi_`p-VfZd0XVUJ_'#sb\,8f2U5D.fA!CTGh75!p>M*)hQk-<o+mb=>Lq^Wh?mldQ@6f/]G8]RXi7OCE&MVdL<\N,]Od'cjt2'8DqXl3aBNHjDqW#<Gq62Y/SjtZDin28FZV';`EOG/*A2,h!HDP'c6k5[n,[M`"l#9OloV@G?tM]0MdcM&cJFN@SftOr_e"fj,d,M1F,A)ShZMkY]fF#B&$$?[#m(LoZ:5os>gY+^\s'Ts*%kHS&T&s3bJpos&8O!.ellhZiq]CX'_Hcclb<J3UTDEOC\AOk]%?Zgej=a!@N3$baNlW9/#+*As+E5`72[H$CbuL&VqGbIWG/f_'\:5CR$.B)\hk?l5Or;je9S25T'Qt&g?!U&.Zu=.E;'DgnRVIWbaU-.Q9$51V(c%<q_(K&b:^,?_?fEX*(WfhLaItsE6A+5cb,L1Z::K"`<G^oDFoRlZq3]ljAb1Z?C%Okiefsn4G1gf6oD.*ROU=<oP#Uunb,+_%<#6aMW@a%Dbi.+aF@u%SC;7pBd_d&doR$*4E/)@([%lbi@&8q9=.F99jDN1p1omlW/QcbEFMpGFXHI4DQfYkP)I0noPspoR5-l>r,\$n9BFYRH,m3_dM*FD`s\JUq"@!'VVp"8aPbX/J:9"V1SUrC;"D&g?'&.\:KQEl,T-L$2bYn\R%S2O0nbVM8Obf_Ybn!J1RG0[\UN_08Oi*EEh46s6'@$\[3a(G'r5O]`R?KJ/P?\/%+oQ>aJ,!i)WU/ZQ9*Y/U8^0h/5dn7V+Zi135:;*f(/hi0&iXl(KFWlpc#oS"$aFQKQ%aoYn5XuiJGV$kguHarRd)Qg^FkI'd(D/RW!]W[d'k]^l51]1'7G!@6sC,'cM6ZK_?-Z?l6QOXNF4&-K7eC*!B$T[,gL@>6PN`Ea'&cT$6^_5#k</Yn5$.+i8-_#j%K4]4]Y=@4\)#^/4$D8+,3)>CHS?S;k1n1N4YEB0Wp4&/S$jE(XXFXs:b]PKO>&nqenZ\JY)hIcoTf7@[oY;p,"5V-Pc]C->G]JJXT._O)"O;s^,Q^-bn,`I2>t^LBYFnd;;P:*BbRMl8B*P"E_$%+nM^Sg[TSb8J->dJ(bllE3Lb@%*Fa,nR&%&hn6%!r[^b,.8QqE%YR3gMV%#AYH;gJTejdX"G\!g]nV33>/\=BeKL,QlgJt'oXm>UPc64:NN*j^2Pqlgt<ie2t[3ug8>hTSr&!rLkVB,,-aYbWa,D_Bst=e(KMNemAdJ_?jHJ)%UF"[8f1mtQt6nbL)^<(i`U8[[0/jW)+e5Y1%o*2i#'cHYSG20-%YMGN*((Y]bWkm1a&oW'?5EZAG#S0P-H)1SRgY_Cdg,Q,60n<9]Rfqm7$Mu_D6H71s8u/^p&I/0I!%fYgb*YUU=:epSMV9dJTT(H:<hm*;+J3@k@\X+rX7i:4RnDl0ZqN@m:#>:PR)_j"8G*-34r5[:1##$'t*lQEihm:W?^kANUiGr.-3t>>I#lPIVQ,^VMU^AE""<)0(7hPp9ch^sJ,C3+h9m=HC72HK08iQ&]5f&qE$]DPq$IJq]^3lN(,/LU$:I68"3KrkO-eHO@$/#P3F%F66!fHKNHGalQ%2)"M3DkQjOM."Nm$-`T<)+8FUOg3i)bBNKj1*tJMk=e-hmQf8PRT8<!1P#kZ+9;g%gO?TeRMEcMH8iEB8hYTi-BpQJjq\7d_k),$^3pZl1SZD9TA]-UNR`pnQ4enpbi,H#4rgB*_4S^[8>]gRWM<ER-,jJ(N-a,P*AOV/TG=?o?;B.9r[<<RW$54%dY'<kkTB1Xs-/.M%,a1g11.QgUa'"]*+e(ajf+RK1!i7Yna,A7tDWk28+fdt85>p+1,*Vu9J<;t_pUmTM-@rVIb=_]r5Ja>_KpBDGS&b5k[,:-^BaUu\6[^/JG<m$@QZVa`N+V[hf6sb)mBu9!_g<MKs)a);+"(T]mu_p@Sj3\IFRd(k#"-)of4%E'[#\!2WQeibDhP*`ju7R:%XGW#hsA9kL?JrXIYK!unm`'Wk<AKYFZNU=Q(&c)nkY=cR?%n$:mP0jFE*2Hr"s'N#Q9h`_,1U_:MKeXZ_-gV6CLd>V=(h5!g0u/rSHW"q3YG-q9>au(\uW79KjMt'/)6d6+e:4Njd%>beHPA]R&O!6c'S$$.P%/^FI1<(/n2NfeXI,b`!p`M9dK7;m/:t8bQC"1<d5]K(Iuk\t;bEoV7"fe4C:HNUCf3#<gsK5;UGZSY,*Z]^V+A0)"epcHb1VBu2,1.(L`=QuMl#8rbV%7@iJ1cJJ7gLP&#;`Jkl0Qi))cMkl$ZqiXp63e;^.8sAfgm&eBI:S123bN=,/5,]F:P5$1bS^X$2b!WIM*mp6XO?E.-/hbf8+7b+`FXM(Ml%O]K?^?o*Mac.!&:pd$fV*Ke7]R'Ud"%\S\R8G5KWo^RGE^$XRHtPpV:*HNVhkBG(!QO35K@=:VGNrSj0C0*?fdbf^@!@DK=$6$Mg3>QFHds#+b"L>^EUl/*TKkVYMWgprUjEGAX1^A7^j;S,IC[neKnm+XtdN=TW3Nq^(YqBpLH#!S'F2dJMZj,4>98i+MQD'AS@]?;di+K(h9eZWVs,'%BU4UQ"9i9(PXM^jKL3a)?q9<E4^o+GQoj=?qIA=FZ'V#q6[0HWhJV<6"K)t1GXP`FOIqZi_g#m>]=nRIZ"*JbFa$eVXD@O/5k%.Y?>_R:A3K^O*bXT[pQd6HcKCY@t7!f!c8C>Su^[$lE/NM[tY,XQpnM`1,rqa2O]%cS^r03ma.T^5?B64_R#C5X^HaqQs+CB>/45l0FkG>@LYP&M]4(">MiCQIn'5h;aju#mT.Kt"4W<q6Bq)'9pK/sIpoKf`ls]';;$!9>Zk#Z[h"?SeP#(8bgD>+HmBER7o'(]*f[$j(9RCa?M`aS<P=L!?H1hu47oa(k2ug>hF7>dl:uil)rYk,W8VnPHt'o5WrZFDQ8SRDc6@<hX3])EWM'c00;O?Wa[0Jp\B:3fVJ<>i^Rtf(]i-l?cmLO0Wo:hW?i`FG:8f#qU"tUMd=X=S,ut@>F&p/%WaXlNE&7"]A[V#O<l09__Yq55r/HB>gULV)J5&L+/>G8Qj*)T6n?dEmjmY<e3JllZ2I&Hdo$^qf;2fZQlnAk-4C(V^LS5pf[?q*\I/0-t^RM`[Dndc/bDK*1AV9d%$%dscM(&u3oXdX!W2,I-lYk#80,a(aoWGj=AKodsB_S$oO@_oLqQupL4r,OP*#s36;2IEFKf2QD7$C/Y^Q9gr\`6P:=^-Hr6:N5aXPS:Lg&@TKVK6B`a*tca\M]N_>Af9Yo=*R,_@6cL?Q5fR(K"t;ZuUM,EU[\\3bZji%]SaJVX8X`CgVH!pH!J1\]38H4+4f*;cmr3Xb<V'Vh2An#7JgD2J9]6*nhT6c=Jr@3IBt`bpeF^(u!bSf]n=2L,N\'4k&Q-?t@*lP)Qm@[k(+!'t'GUfg?:W8SBg0Oqtt/P]q`t>*:c:.a,"4dMIk%Ql)!+0]JrQZ+5U"%m;`pDtYrr*-Q"1`18&S@p_0j0,`S#YpA@Kb"YM9juQK8cpM[HZRKTCCsSZc\63>!YbWogT/&0t`KmrGXrT**7f')L7V9$[_D[mECnWL$O\pMnIqQ.TU=>CS1*"^pUicD6l8iaU[Knf^VM#YAk;=;fY1=JI692Rg7;n=D(!=:q6^'el\Qu.<^_k!sn>!CaRCWhG=8E>KhZ$EHr1s]9T^n<oe[PlUPT#f8j.AcN>5X!3-H[IfFjO+oeb+Jq'[qqC\IWDe&[dN@^/r#/+s\=lEN(I%P7jEZ^,r6uG"NMg[b#E,HoXTC50>T/;]a+#aCHYj(UkfI5,&/WCL-%;n[C^'jT%4mATacXqWgFL1!/#$r$Zl9I.oq1klXfB%%U1u=6tu\Go6JYeCC:qlWQ+^*Oo6ZKIR>[g+lD@Vj-!?R1'H"0OZYOb8'_Zf0SlcUjrIp+.>0)>bRM^S8Qa:+A:<Od#t0jI!jqmQ$lLK:Skc=G``dZS/`c4B).clJF1[AO\NNX+t:_,oUDjIGu,/rF?.-(rZV\6`?@K#p=ls8U5m:K'@m)dXt>D]CWo4]/DojiApEmqS]B(RJ^r.UX2";'ZR&E5eCJK%GTqWV"YZlIp&a+5OI'5A%hc'U&Tmb-:6TNn>^CiKH1fP2>Jl?UTM:PJ]FYnGP5gX:F$Na<HS%oAmRk22VMME$-!I/!bF]+'<8U8G:Y`O3\JrBIrA9+]ACWCOgcj$f@s5`/Lq2qWnoiLNCKoK]]"HMgrD3J!:>`Y3W'*Jterkrfi?[@nW:($lH5(MiTWW*P36&r/\ifLWZ:d*S3bNJAl!N!tH:uS$,nd[MX_"XJ@mq^U7B@uHgbggE>%UU"/Ds$RA:LQNgCe_._WIf&p;];M_eK[9.XEH,qrJI?c*(n;YKQfpV?>YgTR4VMpJ8^q8G:a5.Gq-QX3%E<N9:W#@9@6.j)ClTi.f!-4eU+@qCe0,[M2fS#%^f)2q>G=p&;dc]^[5XC>I4A8=q+HTM@t@`_S_aB1]p8Gu9-Ei\]!TiYe<AG%'3bD%Z6[?GN[NVl//7E?Y5qLZ0-mZ%Pc%8qmP46[+ES"I=+C45W_3n\aWj5J814ePZ6):=9FX)*.Y[3LUU75Bh"XaD.]7]_L9-m,BubeRo\jgI>7]EK-Ob8SMpp*khA&o4=BA~>endstream
|
| 143 |
+
endobj
|
| 144 |
+
21 0 obj
|
| 145 |
+
<<
|
| 146 |
+
/Filter [ /ASCII85Decode /FlateDecode ] /Length 3130
|
| 147 |
+
>>
|
| 148 |
+
stream
|
| 149 |
+
Gatm>lYkN;'*"Q<@Y"@8mR=F[Qf[qF5i0Uh]%8cQE<cV#(n%h#8>7;#G29q4L9r72I`SO5Z/+,]R.HdpB8.^?iI=8q*QA*B:XHd%5\tZ`!HCgMT'kS&l/_eR\`0ZDSnTk@9t(qK%KY$'4l>YcVq\[saMqsZ=W[#'9gA+u(MjWVOat5G%%YGFRk&_l8N;Q@p')Cu7?gG!?mLU<*bHsCN:6L1E"66XY+Hi,Yja4Z4OJLB&Z7a#6a//s2ls`%q&ePZ'qTkQW7GX/0%(/E^J6jJ@=>oDZOo-`4[8FQA0QQ-2^bI)Z]eo'hJl8JGWcRHn2rh7Du$HE#Tcb_:eFqCqgB0Eds"[#\8:lHGj6A!X@3$.,"U?2T%US8%h(d$-8>;``5IqTO#"^rCuU*3p_HJM.HKp)%DHO0e.PaGWdm@l2G<=p#Ed.CM!6E=D4fVB;AO(CE"=h'K>=ja^=2s`8P[24GRcMZ@7$/$l?k75a$C#pT`;LL8%[j"Jk!OF,8TD\`:<bSJ8.!!lesf#XQtTtlR!`#:eT.%Ksc2$k;3(Q@mh'Z(D_R4\NHr/hnpOOC3:`SS`B;)2.@j[ki<B]Yo"[a&W\+BCs'%D]WjIZla:Z_f3`MH)=h>9r8A?c!&^=p)5N[F7DWu+!1,rZ_T*<7@j-gUka%l'OdI"8c>omBMNh[/a0S$Xr$VE1hV#Sc2[,<s(UbT"a;JJ:TZo`Lp&uj*;oV^tjVTj)GfcF!nrES.q7Hc]32[&C-";BUZ'=3S8KQ,BN:cQsi#O_sSqDo:cuWOtg7<PU80q`"V?=>5+I#R^1hX+G:LCV`s%2g=fG2=:jVc5kN^B0eG<sHO/@,4\lsS$gmGq?Nnm5Io+]B;R\SrG84IdD"9>!3lX`>kR-DOf_@8,-LX.jiq\=B48Gll=#gXCg;hC6*nI"HrK)f^"VK$i^/!V`?HSAK%r*4$J^%*C%M:[3l_3ZdShLO?+s5Vt^,ClJ>dO`!W#*JTtU6$Xo"@.0O2%,$F_$\M]*VjSqW1i>%MPhCn-QjMfAI*tKGcNO5hiDU@JarFQ5@sDB6:i:R(1@5lfp,_sdnRQd&nsUa0[@'hD+;AKM>jh4"BA<%P\KOaFMD5`2$k5+-#Godre`Io_'hMqu.c3F+Cr[2UV`0q#G!QOZJR43,Og#q<''[7UfCjomajE_5Z*!R4pf.jOWDXR1.@IagV[WR4Y^0"$0L?mK+h?$or)?g"Lg+4gNkmGQ6jc&OdX,#fTa8%K,ca[@2Ne=uRt=-0fUM54"UQ3H-SudfBS46($-'6g\-h::]c:?8=il0!;cq<$I/137`%-"iiBG/HMfM-s5tfZ^=)p@'=E86-O"e9qi>cdc0o"tI!`[<81TFo71,XsQ0s7eJ'NLp1D_635qNNP#Wo/[l7ejCon/qH*l^n%+p2g@p3%^YW=/i/?X,Qf2U@0:5CQ!LD/il-0ce>*7Q]!,f+03FsEF225&GHY8Ib<!]('eE>mT+&umL=X&m&fjRQ>*1$-C)M-]k'dsBak_b_H2K.Hru&]Ts6rB+TcSaP/))G.hMV`kcCuQ02`Q!#2\@*^D*5MUXU*f`'Z]/3(c$N>KL/=)/iC3X^]L=((g_9J]4]"fp"tF.^k\mR#fh<c^ihVg-j/k9OtQ1J(@)&fsS'p7=9bpWJHt9SCX!K]WKFdT$!WhkjR4=dQ,=S%?t;@dp.&NmmPK2",Y;e:`Pnf]XH3AlJu`=bD;Y9I.DW.%nq[BUSnRLXp_QcL/2U6(j,&5Pl\LeW.NDhr9o=H@4HK"T/G[)Uc*c>Lm#Udd7R;-Bd';[lF*W:M_I@Ml3I*M[BWHH?UMfi\paBK!d!W.b9ssJpeZW4>fONGbf'-jNKM&_!AR-#UQVS`"i[KM7)NSuV5Kuh!aSsMDKT3.lX9<aD?+DId&BFhAQYPoYcc9*p?E:/S$^JD.YHI8*j\7II@)`!C'K^0s'>4-*J8f`Ca3&Rb=r2-g$V$6\heo9YKni4[oXC%bH&[qmT`L`k4tfGq-_'QK\rqqTboK-nlM@(DWU=m=^ZuQbuZCKH**Dr*S7aO,Oo,V!>+EZD7I><Z"DaMfi!/0>D\/G'(r.Gmis6>,Osq@CJu:_Vm$?^2Y#cQ:$B]M*3B6)QJW==_AMV/(/2(^[)I]R(=gW^AK>VSCt,1kC/84F4Jip\Bf1DOqT!'C@>Ito#*fr-6Ye/U$kW's7L"1TYme9Q[)2n=1<3;[0FP#Im*L<=C1q"kmiBTg9]83p]et@Hp=!fqmeOn4:Pq-fhp/4*[jJ=(qKS!cUJgt6h3LQnQlX3'R_lMdA'N@+hJnS[Y:`rq:0:1#1XMT5('@[bq2Gg88)Lpe0l-m(p%d@JG8c$rUG(DB=q#Kh^WiU%/G_TGhd,*0_(Do1RJ89pKVE/D]!$?<=og_1DUg0Z:9E?GL/gUY-FG-><_LB2/`Er!Y4QLXN.//Ge/B=CWo_[pXY8V2lG_8A/cMd#id'htSl[MRmeR!FWm6T&le=DLJmDmD?K8cF4DF6'\7F.TfY,*FoaJLp,@=7c<I^]]"L8GZn<K9pdCk97Oa$:IFt3'*)V1X^BDTOm!?0T!e@f-FE!&NEM5/>Z@_qI_m(1U8T8:CWjscgS'<FVN4Q?)giXK[k8:Nj*n"2Gs2uo6HNQgrjbUF(RO6RhG/:jiD.Ecbl/4kM@//lC#..R\78PTr/\H>hCa\\dS(t+pHQCH((.Zb\L[Vc/krl_2]D;RZ-Z&.e8n2O3W.N-<QdR,VY*4tsE'UkjXmc_Bae4ncf%qcI$3QkgXo0Fc]LWRUG7<_=,Fq[%UYIYc2VXG4j3u8]Pr]fH5$o%F%ra<02M2,g9!L44Optd['jBQ5*eB70-J`"aMcMsJ6ag3!#HjmRN_i/gGQcL]L:;ID[j:=\[pk!,tUW=Mj$CCW]geaDOik'ZYfg4Zdiq#<\^3;g!?CiX33Qk@9L^404ZiAhX]?f@eFra]!fSF>Rk@02.GKD-u:!!hrs.gf18lN.PkfC0_]QTWW[aiQTl@gVN%BSpkI,*lQ?2YG"Bf$[u<L8Igj$=U2`(Yr]D9fQEe=0!tM-P]X!nC]\p4J'QIW6;5Q$:>Ki(4b#lEOQ3?aOFpK<3cq,Gm&"^VHQ;dTd^$0W$\d6hLFPEQ;=)\LB6mq*3hfY8@~>endstream
|
| 150 |
+
endobj
|
| 151 |
+
xref
|
| 152 |
+
0 22
|
| 153 |
+
0000000000 65535 f
|
| 154 |
+
0000000061 00000 n
|
| 155 |
+
0000000132 00000 n
|
| 156 |
+
0000000239 00000 n
|
| 157 |
+
0000000351 00000 n
|
| 158 |
+
0000000466 00000 n
|
| 159 |
+
0000000543 00000 n
|
| 160 |
+
0000000648 00000 n
|
| 161 |
+
0000000853 00000 n
|
| 162 |
+
0000001058 00000 n
|
| 163 |
+
0000001263 00000 n
|
| 164 |
+
0000001469 00000 n
|
| 165 |
+
0000001675 00000 n
|
| 166 |
+
0000001881 00000 n
|
| 167 |
+
0000001951 00000 n
|
| 168 |
+
0000002293 00000 n
|
| 169 |
+
0000002386 00000 n
|
| 170 |
+
0000007547 00000 n
|
| 171 |
+
0000011340 00000 n
|
| 172 |
+
0000018366 00000 n
|
| 173 |
+
0000024067 00000 n
|
| 174 |
+
0000031296 00000 n
|
| 175 |
+
trailer
|
| 176 |
+
<<
|
| 177 |
+
/ID
|
| 178 |
+
[<baf479c3746c3d70b80d1e43c034930a><baf479c3746c3d70b80d1e43c034930a>]
|
| 179 |
+
% ReportLab generated PDF document -- digest (opensource)
|
| 180 |
+
|
| 181 |
+
/Info 14 0 R
|
| 182 |
+
/Root 13 0 R
|
| 183 |
+
/Size 22
|
| 184 |
+
>>
|
| 185 |
+
startxref
|
| 186 |
+
34518
|
| 187 |
+
%%EOF
|