---
license: apache-2.0
datasets:
- multicam
- stereo4d
- waymo
- egoexo4d
- dynamic_replica
- spring
- point_odyssey
- re10k
- dl3dv
metrics:
- psnr
- ssim
- lpips
---
# Model Card for Fast Spatial Memory Models

This repo is a public release of [**Fast Spatial Memory with Elastic Test-Time Training**](https://mars-tin.github.io/blogs/posts/elastic_ttt.html), as well as a *self-retrained (non-official!)* version of [**4D-LRM**](https://4dlrm.github.io/).

## Model Details

### Model Description

- **Developed by:** [MIT-IBM Watson Lab]
- **License:** [Apache License 2.0]

### Model Sources [optional]

- **Repository:** [https://github.com/Mars-tin/fast-spatial-mem]
- **Paper:** [https://arxiv.org/abs/2604.07350]
- **Homepage:** [https://fast-spatial-memory.github.io/]

## Performance Documentations

| Checkpoint | Steoro4D PSNR | Steoro4D LPIPS | Steoro4D SSIM | NVIDIA PSNR | NVIDIA LPIPS | NVIDIA SSIM | DL3DV PSNR | DL3DV LPIPS | DL3DV SSIM |
|---|---:|---:|---:|---:|---:|---:|---:|---:|---:|
| `lrm_checkpoints/fsm_4dlrm_patch8_res256.pth` | 27.54 | 0.163 | 0.841 | 20.17 | 0.337 | 0.567 | 21.89 | 0.314 | 0.692 |
| `lrm_checkpoints/fsm_4dlrm_patch8_multilen_res256.pth` | 24.88 | 0.245 | 0.786 | 23.27 | 0.275 | 0.700 | 20.71 | 0.365 | 0.652 |
| `lrm_checkpoints/fsm_4dlrm_patch8_static_res256.pth` | 28.51 | 0.110 | 0.865 | 16.45 | 0.386 | 0.407 | 23.59 | 0.206 | 0.766 |
| `lvsm_checkpoints/fsm_3dlvsm_patch8_res256.pth` | 32.16 | 0.043 | 0.931 | 23.10 | 0.117 | 0.713 | 24.64 | 0.118 | 0.787 |
| `lvsm_checkpoints/fsm_4dlvsm_patch8_multilen_res256.pth` | 31.24 | 0.072 | 0.925 | 23.90 | 0.105 | 0.747 | 24.54 | 0.135 | 0.772 |
| `lvsm_checkpoints/fsm_3dlvsm_patch8_res256.pth` | N/A | N/A | N/A | N/A | N/A | N/A | 27.01 | 0.084 | 0.859 |


## Citation

### Fast Spatial Memory with Elastic Test-Time Training
Ziqiao Ma*, Xueyang Yu*, Haoyu Zhen, Yuncong Yang, Joyce Chai, Chuang Gan 

```bibtex
@article{ma2026fast,
  title={Fast Spatial Memory with Elastic Test-Time Training},
  author={Ma, Ziqiao and Yu, Xueyang and Zhen, Haoyu and Yang, Yuncong and Chai, Joyce and Gan, Chuang},
  journal={arXiv preprint arXiv:2604.07350},
  year={2026}
}
```

### 4D-LRM: Large Space-Time Reconstruction Model From and To Any View at Any Time
Ziqiao Ma, Xuweiyi Chen, Shoubin Yu, Sai Bi, Kai Zhang, Chen Ziwen, Sihan Xu, Jianing Yang, Zexiang Xu, Kalyan Sunkavalli, Mohit Bansal, Joyce Chai, Hao Tan

```bibtex
@inproceedings{ma20254dlrm,
  title={4D-LRM: Large Space-Time Reconstruction Model From and To Any View at Any Time},
  author={Ma, Ziqiao and Chen, Xuweiyi and Yu, Shoubin and Bi, Sai and Zhang, Kai and Ziwen, Chen and Xu, Sihan and Yang, Jianing and Xu, Zexiang and Sunkavalli, Kalyan and others},
  booktitle={The Thirty-ninth Annual Conference on Neural Information Processing Systems},
  year={2025}
}
```

## Model Card Author

Martin Ziqiao Ma

## Model Card Contact

marstin@umich.edu / ziqiaoma@ibm.com