Dineth Perera commited on
Commit ·
0969bf1
1
Parent(s): a95dbce
Publish ChangeMamba LEVIR val-as-test checkpoint
Browse files
README.md
CHANGED
|
@@ -179,7 +179,7 @@ Every dataset below is a real YAML file under `configs/datasets/`. The harness e
|
|
| 179 |
|
| 180 |
## Results and released checkpoints
|
| 181 |
|
| 182 |
-
Only completed `metrics_test.json` evaluations are eligible. Rankings are computed per dataset by test-set F1 (descending), and the canonical `best_model.pth` checkpoint for every ranked model is released.
|
| 183 |
|
| 184 |
All accuracy values are fractions. GPU memory is the PyTorch peak reserved memory for inference, with peak allocated memory used only when reserved memory is absent. FPS is model-only throughput. A dash means the evaluator did not record that metric; values are never estimated.
|
| 185 |
|
|
@@ -257,6 +257,14 @@ The current evaluator records BF1 but not boundary mean IoU (BmIoU), so BmIoU re
|
|
| 257 |
| 7 | FC-Siam-conc | 0.7789 | 0.8062 | 0.9756 | 0.8907 | 0.6920 | 0.4733 | — | 5.33 | 1.03 | 397.86 | 1.55 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_conc/whu_cd/checkpoints/best_model.pth?download=true) |
|
| 258 |
| 8 | FC-Siam-diff | 0.7135 | 0.7580 | 0.9631 | 0.9540 | 0.5699 | 0.2148 | — | 4.73 | 1.09 | 567.87 | 1.35 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_diff/whu_cd/checkpoints/best_model.pth?download=true) |
|
| 259 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 260 |
### Datasets without a released checkpoint
|
| 261 |
|
| 262 |
WildFire-S2, KATE-CD-256, the standard LEVIR-CD+ configuration, and Custom-CD currently have no eligible completed test result. Their validation-only or incomplete checkpoints are intentionally not uploaded.
|
|
|
|
| 179 |
|
| 180 |
## Results and released checkpoints
|
| 181 |
|
| 182 |
+
Only completed `metrics_test.json` evaluations are eligible for rankings. Rankings are computed per dataset by test-set F1 (descending), and the canonical `best_model.pth` checkpoint for every ranked model is released. Separately requested checkpoint-only artifacts are listed below without fabricated metrics or a rank.
|
| 183 |
|
| 184 |
All accuracy values are fractions. GPU memory is the PyTorch peak reserved memory for inference, with peak allocated memory used only when reserved memory is absent. FPS is model-only throughput. A dash means the evaluator did not record that metric; values are never estimated.
|
| 185 |
|
|
|
|
| 257 |
| 7 | FC-Siam-conc | 0.7789 | 0.8062 | 0.9756 | 0.8907 | 0.6920 | 0.4733 | — | 5.33 | 1.03 | 397.86 | 1.55 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_conc/whu_cd/checkpoints/best_model.pth?download=true) |
|
| 258 |
| 8 | FC-Siam-diff | 0.7135 | 0.7580 | 0.9631 | 0.9540 | 0.5699 | 0.2148 | — | 4.73 | 1.09 | 567.87 | 1.35 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_diff/whu_cd/checkpoints/best_model.pth?download=true) |
|
| 259 |
|
| 260 |
+
### Additional checkpoint without completed test metrics
|
| 261 |
+
|
| 262 |
+
This trained checkpoint is published on request, but it is not included in the F1 rankings because its `metrics_test.json` evaluation has not completed. The protocol is LEVIR-CD+ validation-as-test, not the test-as-validation benchmark above.
|
| 263 |
+
|
| 264 |
+
| Dataset | Model | Evaluation status | Download | Size |
|
| 265 |
+
| --- | --- | --- | --- | --- |
|
| 266 |
+
| LEVIR-CD+ (val-as-test protocol) | ChangeMamba | Metrics pending | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/changemamba/levir_val_as_test/checkpoints/best_model.pth?download=true) | 619.4 MiB |
|
| 267 |
+
|
| 268 |
### Datasets without a released checkpoint
|
| 269 |
|
| 270 |
WildFire-S2, KATE-CD-256, the standard LEVIR-CD+ configuration, and Custom-CD currently have no eligible completed test result. Their validation-only or incomplete checkpoints are intentionally not uploaded.
|
results/changemamba/levir_val_as_test/checkpoints/best_model.pth
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fc5ad6c62b1a056081d686129916a8e3b0d259c3108fdc2aa1dc7ad88a2c8a8d
|
| 3 |
+
size 649519586
|
tools/generate_hf_model_card.py
CHANGED
|
@@ -113,7 +113,7 @@ def build_results() -> tuple[str, list[Path]]:
|
|
| 113 |
lines = [
|
| 114 |
"## Results and released checkpoints",
|
| 115 |
"",
|
| 116 |
-
"Only completed `metrics_test.json` evaluations are eligible. Rankings are computed per dataset by test-set F1 (descending), and the canonical `best_model.pth` checkpoint for every ranked model is released.
|
| 117 |
"",
|
| 118 |
"All accuracy values are fractions. GPU memory is the PyTorch peak reserved memory for inference, with peak allocated memory used only when reserved memory is absent. FPS is model-only throughput. A dash means the evaluator did not record that metric; values are never estimated.",
|
| 119 |
"",
|
|
@@ -189,6 +189,29 @@ def build_results() -> tuple[str, list[Path]]:
|
|
| 189 |
else:
|
| 190 |
lines.append("No completed test-set result is available, so no checkpoint is published.")
|
| 191 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 192 |
lines.extend(
|
| 193 |
[
|
| 194 |
"",
|
|
|
|
| 113 |
lines = [
|
| 114 |
"## Results and released checkpoints",
|
| 115 |
"",
|
| 116 |
+
"Only completed `metrics_test.json` evaluations are eligible for rankings. Rankings are computed per dataset by test-set F1 (descending), and the canonical `best_model.pth` checkpoint for every ranked model is released. Separately requested checkpoint-only artifacts are listed below without fabricated metrics or a rank.",
|
| 117 |
"",
|
| 118 |
"All accuracy values are fractions. GPU memory is the PyTorch peak reserved memory for inference, with peak allocated memory used only when reserved memory is absent. FPS is model-only throughput. A dash means the evaluator did not record that metric; values are never estimated.",
|
| 119 |
"",
|
|
|
|
| 189 |
else:
|
| 190 |
lines.append("No completed test-set result is available, so no checkpoint is published.")
|
| 191 |
|
| 192 |
+
pending_checkpoint = RESULTS / "changemamba" / "levir_val_as_test" / "checkpoints" / "best_model.pth"
|
| 193 |
+
if pending_checkpoint.is_file():
|
| 194 |
+
checkpoints.append(pending_checkpoint)
|
| 195 |
+
lines.extend(
|
| 196 |
+
[
|
| 197 |
+
"",
|
| 198 |
+
"### Additional checkpoint without completed test metrics",
|
| 199 |
+
"",
|
| 200 |
+
"This trained checkpoint is published on request, but it is not included in the F1 rankings because its `metrics_test.json` evaluation has not completed. The protocol is LEVIR-CD+ validation-as-test, not the test-as-validation benchmark above.",
|
| 201 |
+
"",
|
| 202 |
+
*markdown_table(
|
| 203 |
+
["Dataset", "Model", "Evaluation status", "Download", "Size"],
|
| 204 |
+
[[
|
| 205 |
+
"LEVIR-CD+ (val-as-test protocol)",
|
| 206 |
+
"ChangeMamba",
|
| 207 |
+
"Metrics pending",
|
| 208 |
+
f"[Download]({download_url(pending_checkpoint)})",
|
| 209 |
+
f"{pending_checkpoint.stat().st_size / (1024 ** 2):.1f} MiB",
|
| 210 |
+
]],
|
| 211 |
+
),
|
| 212 |
+
]
|
| 213 |
+
)
|
| 214 |
+
|
| 215 |
lines.extend(
|
| 216 |
[
|
| 217 |
"",
|