[martin-dev] add model cards
Browse files
README.md
CHANGED
|
@@ -14,4 +14,67 @@ metrics:
|
|
| 14 |
- psnr
|
| 15 |
- ssim
|
| 16 |
- lpips
|
| 17 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
- psnr
|
| 15 |
- ssim
|
| 16 |
- lpips
|
| 17 |
+
---
|
| 18 |
+
# Model Card for Fast Spatial Memory Models
|
| 19 |
+
|
| 20 |
+
This repo is a public release of [**Fast Spatial Memory with Elastic Test-Time Training**](https://mars-tin.github.io/blogs/posts/elastic_ttt.html), as well as a *self-retrained (non-official!)* version of [**4D-LRM**](https://4dlrm.github.io/).
|
| 21 |
+
|
| 22 |
+
## Model Details
|
| 23 |
+
|
| 24 |
+
### Model Description
|
| 25 |
+
|
| 26 |
+
- **Developed by:** [MIT-IBM Watson Lab]
|
| 27 |
+
- **License:** [Apache License 2.0]
|
| 28 |
+
|
| 29 |
+
### Model Sources [optional]
|
| 30 |
+
|
| 31 |
+
- **Repository:** [https://github.com/Mars-tin/fast-spatial-mem]
|
| 32 |
+
- **Paper:** [To be updated]
|
| 33 |
+
- **Homepage:** [https://fast-spatial-mem.github.io/]
|
| 34 |
+
|
| 35 |
+
## Performance Documentations
|
| 36 |
+
|
| 37 |
+
| Checkpoint | Steoro4D PSNR | Steoro4D LPIPS | Steoro4D SSIM | NVIDIA PSNR | NVIDIA LPIPS | NVIDIA SSIM | DL3DV PSNR | DL3DV LPIPS | DL3DV SSIM |
|
| 38 |
+
|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|
|
| 39 |
+
| `lrm_checkpoints/fsm_4dlrm_patch8_res256.pth` | 27.54 | 0.163 | 0.841 | 20.17 | 0.337 | 0.567 | 21.89 | 0.314 | 0.692 |
|
| 40 |
+
| `lrm_checkpoints/fsm_4dlrm_patch8_multilen_res256.pth` | 24.88 | 0.245 | 0.786 | 23.27 | 0.275 | 0.700 | 20.71 | 0.365 | 0.652 |
|
| 41 |
+
| `lrm_checkpoints/fsm_4dlrm_patch8_static_res256.pth` | 28.51 | 0.110 | 0.865 | 16.45 | 0.386 | 0.407 | 23.59 | 0.206 | 0.766 |
|
| 42 |
+
| `lvsm_checkpoints/fsm_3dlvsm_patch8_res256.pth` | 32.16 | 0.043 | 0.931 | 23.10 | 0.117 | 0.713 | 24.64 | 0.118 | 0.787 |
|
| 43 |
+
| `lvsm_checkpoints/fsm_4dlvsm_patch8_multilen_res256.pth` | 32.16 | 0.043 | 0.931 | 23.90 | 0.105 | 0.747 | 24.61 | 0.118 | 0.787 |
|
| 44 |
+
| `lvsm_checkpoints/fsm_3dlvsm_patch8_res256.pth` | N/A | N/A | N/A | N/A | N/A | N/A | 27.01 | 0.084 | 0.859 |
|
| 45 |
+
|
| 46 |
+
|
| 47 |
+
## Citation
|
| 48 |
+
|
| 49 |
+
### Fast Spatial Memory with Elastic Test-Time Training
|
| 50 |
+
Ziqiao Ma*, Xueyang Yu*, Haoyu Zhen, Yuncong Yang, Joyce Chai, Chuang Gan
|
| 51 |
+
|
| 52 |
+
```bibtex
|
| 53 |
+
@article{ma2025fast,
|
| 54 |
+
title={Fast Spatial Memory with Elastic Test-Time Training},
|
| 55 |
+
author={Ma, Ziqiao and Yu, Xueyang and Zhen, Haoyu and Yang, Yuncong and Chai, Joyce and Gan, Chuang},
|
| 56 |
+
journal={Blog Post},
|
| 57 |
+
url={https://mars-tin.github.io/blogs/posts/elastic_ttt.html},
|
| 58 |
+
year={2025}
|
| 59 |
+
}
|
| 60 |
+
```
|
| 61 |
+
|
| 62 |
+
### 4D-LRM: Large Space-Time Reconstruction Model From and To Any View at Any Time
|
| 63 |
+
Ziqiao Ma, Xuweiyi Chen, Shoubin Yu, Sai Bi, Kai Zhang, Chen Ziwen, Sihan Xu, Jianing Yang, Zexiang Xu, Kalyan Sunkavalli, Mohit Bansal, Joyce Chai, Hao Tan
|
| 64 |
+
|
| 65 |
+
```bibtex
|
| 66 |
+
@inproceedings{ma20254dlrm,
|
| 67 |
+
title={4D-LRM: Large Space-Time Reconstruction Model From and To Any View at Any Time},
|
| 68 |
+
author={Ma, Ziqiao and Chen, Xuweiyi and Yu, Shoubin and Bi, Sai and Zhang, Kai and Ziwen, Chen and Xu, Sihan and Yang, Jianing and Xu, Zexiang and Sunkavalli, Kalyan and others},
|
| 69 |
+
booktitle={The Thirty-ninth Annual Conference on Neural Information Processing Systems},
|
| 70 |
+
year={2025}
|
| 71 |
+
}
|
| 72 |
+
```
|
| 73 |
+
|
| 74 |
+
## Model Card Author
|
| 75 |
+
|
| 76 |
+
Martin Ziqiao Ma
|
| 77 |
+
|
| 78 |
+
## Model Card Contact
|
| 79 |
+
|
| 80 |
+
marstin@umich.edu / ziqiaoma@ibm.com
|