Dineth Perera commited on
Commit
0969bf1
·
1 Parent(s): a95dbce

Publish ChangeMamba LEVIR val-as-test checkpoint

Browse files
README.md CHANGED
@@ -179,7 +179,7 @@ Every dataset below is a real YAML file under `configs/datasets/`. The harness e
179
 
180
  ## Results and released checkpoints
181
 
182
- Only completed `metrics_test.json` evaluations are eligible. Rankings are computed per dataset by test-set F1 (descending), and the canonical `best_model.pth` checkpoint for every ranked model is released. Validation-only, incomplete, and checkpoint-only runs are excluded.
183
 
184
  All accuracy values are fractions. GPU memory is the PyTorch peak reserved memory for inference, with peak allocated memory used only when reserved memory is absent. FPS is model-only throughput. A dash means the evaluator did not record that metric; values are never estimated.
185
 
@@ -257,6 +257,14 @@ The current evaluator records BF1 but not boundary mean IoU (BmIoU), so BmIoU re
257
  | 7 | FC-Siam-conc | 0.7789 | 0.8062 | 0.9756 | 0.8907 | 0.6920 | 0.4733 | — | 5.33 | 1.03 | 397.86 | 1.55 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_conc/whu_cd/checkpoints/best_model.pth?download=true) |
258
  | 8 | FC-Siam-diff | 0.7135 | 0.7580 | 0.9631 | 0.9540 | 0.5699 | 0.2148 | — | 4.73 | 1.09 | 567.87 | 1.35 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_diff/whu_cd/checkpoints/best_model.pth?download=true) |
259
 
 
 
 
 
 
 
 
 
260
  ### Datasets without a released checkpoint
261
 
262
  WildFire-S2, KATE-CD-256, the standard LEVIR-CD+ configuration, and Custom-CD currently have no eligible completed test result. Their validation-only or incomplete checkpoints are intentionally not uploaded.
 
179
 
180
  ## Results and released checkpoints
181
 
182
+ Only completed `metrics_test.json` evaluations are eligible for rankings. Rankings are computed per dataset by test-set F1 (descending), and the canonical `best_model.pth` checkpoint for every ranked model is released. Separately requested checkpoint-only artifacts are listed below without fabricated metrics or a rank.
183
 
184
  All accuracy values are fractions. GPU memory is the PyTorch peak reserved memory for inference, with peak allocated memory used only when reserved memory is absent. FPS is model-only throughput. A dash means the evaluator did not record that metric; values are never estimated.
185
 
 
257
  | 7 | FC-Siam-conc | 0.7789 | 0.8062 | 0.9756 | 0.8907 | 0.6920 | 0.4733 | — | 5.33 | 1.03 | 397.86 | 1.55 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_conc/whu_cd/checkpoints/best_model.pth?download=true) |
258
  | 8 | FC-Siam-diff | 0.7135 | 0.7580 | 0.9631 | 0.9540 | 0.5699 | 0.2148 | — | 4.73 | 1.09 | 567.87 | 1.35 | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/fc_siam_diff/whu_cd/checkpoints/best_model.pth?download=true) |
259
 
260
+ ### Additional checkpoint without completed test metrics
261
+
262
+ This trained checkpoint is published on request, but it is not included in the F1 rankings because its `metrics_test.json` evaluation has not completed. The protocol is LEVIR-CD+ validation-as-test, not the test-as-validation benchmark above.
263
+
264
+ | Dataset | Model | Evaluation status | Download | Size |
265
+ | --- | --- | --- | --- | --- |
266
+ | LEVIR-CD+ (val-as-test protocol) | ChangeMamba | Metrics pending | [Download](https://huggingface.co/dineth18/CD-Models/resolve/main/results/changemamba/levir_val_as_test/checkpoints/best_model.pth?download=true) | 619.4 MiB |
267
+
268
  ### Datasets without a released checkpoint
269
 
270
  WildFire-S2, KATE-CD-256, the standard LEVIR-CD+ configuration, and Custom-CD currently have no eligible completed test result. Their validation-only or incomplete checkpoints are intentionally not uploaded.
results/changemamba/levir_val_as_test/checkpoints/best_model.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc5ad6c62b1a056081d686129916a8e3b0d259c3108fdc2aa1dc7ad88a2c8a8d
3
+ size 649519586
tools/generate_hf_model_card.py CHANGED
@@ -113,7 +113,7 @@ def build_results() -> tuple[str, list[Path]]:
113
  lines = [
114
  "## Results and released checkpoints",
115
  "",
116
- "Only completed `metrics_test.json` evaluations are eligible. Rankings are computed per dataset by test-set F1 (descending), and the canonical `best_model.pth` checkpoint for every ranked model is released. Validation-only, incomplete, and checkpoint-only runs are excluded.",
117
  "",
118
  "All accuracy values are fractions. GPU memory is the PyTorch peak reserved memory for inference, with peak allocated memory used only when reserved memory is absent. FPS is model-only throughput. A dash means the evaluator did not record that metric; values are never estimated.",
119
  "",
@@ -189,6 +189,29 @@ def build_results() -> tuple[str, list[Path]]:
189
  else:
190
  lines.append("No completed test-set result is available, so no checkpoint is published.")
191
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
192
  lines.extend(
193
  [
194
  "",
 
113
  lines = [
114
  "## Results and released checkpoints",
115
  "",
116
+ "Only completed `metrics_test.json` evaluations are eligible for rankings. Rankings are computed per dataset by test-set F1 (descending), and the canonical `best_model.pth` checkpoint for every ranked model is released. Separately requested checkpoint-only artifacts are listed below without fabricated metrics or a rank.",
117
  "",
118
  "All accuracy values are fractions. GPU memory is the PyTorch peak reserved memory for inference, with peak allocated memory used only when reserved memory is absent. FPS is model-only throughput. A dash means the evaluator did not record that metric; values are never estimated.",
119
  "",
 
189
  else:
190
  lines.append("No completed test-set result is available, so no checkpoint is published.")
191
 
192
+ pending_checkpoint = RESULTS / "changemamba" / "levir_val_as_test" / "checkpoints" / "best_model.pth"
193
+ if pending_checkpoint.is_file():
194
+ checkpoints.append(pending_checkpoint)
195
+ lines.extend(
196
+ [
197
+ "",
198
+ "### Additional checkpoint without completed test metrics",
199
+ "",
200
+ "This trained checkpoint is published on request, but it is not included in the F1 rankings because its `metrics_test.json` evaluation has not completed. The protocol is LEVIR-CD+ validation-as-test, not the test-as-validation benchmark above.",
201
+ "",
202
+ *markdown_table(
203
+ ["Dataset", "Model", "Evaluation status", "Download", "Size"],
204
+ [[
205
+ "LEVIR-CD+ (val-as-test protocol)",
206
+ "ChangeMamba",
207
+ "Metrics pending",
208
+ f"[Download]({download_url(pending_checkpoint)})",
209
+ f"{pending_checkpoint.stat().st_size / (1024 ** 2):.1f} MiB",
210
+ ]],
211
+ ),
212
+ ]
213
+ )
214
+
215
  lines.extend(
216
  [
217
  "",