byeonghyunpak commited on
Commit
427468e
·
verified ·
1 Parent(s): 7d900d3

Add model card

Browse files
Files changed (1) hide show
  1. README.md +99 -0
README.md ADDED
@@ -0,0 +1,99 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # SERF-VLA BEHAVIOR-1K Checkpoints
2
+
3
+ Official checkpoint release for:
4
+
5
+ **SERF: Spatiotemporal Environment and Robot Feature Map for Long-Horizon Mobile Manipulation**
6
+
7
+ [[arXiv](https://arxiv.org/abs/2606.12956)] [[Website](https://existentialrobotics.org/serf/)] [[Code](https://github.com/ExistentialRobotics/SERF-VLA)]
8
+
9
+ ## Overview
10
+
11
+ This repository contains PI0.5 baseline and SERF-VLA policy checkpoints for BEHAVIOR-1K experiments.
12
+
13
+ It includes:
14
+
15
+ * PI0.5 baseline checkpoints fine-tuned on individual BEHAVIOR-1K tasks
16
+ * SERF-VLA checkpoints conditioned on 4D spatiotemporal environment and robot feature maps
17
+
18
+ These checkpoints are for the policy learning component only. The SERF mapping component is not included in this repository.
19
+
20
+ ## Checkpoint Initialization
21
+
22
+ All released checkpoints were initialized from the PI0.5 checkpoint pretrained on 50 BEHAVIOR-1K tasks:
23
+
24
+ * [`IliaLarchenko/behavior_50t_checkpoint`](https://huggingface.co/IliaLarchenko/behavior_50t_checkpoint)
25
+
26
+ This checkpoint was released by the first-place solution of the 2025 BEHAVIOR Challenge and was used as the initialization for both the PI0.5 baseline checkpoints and the SERF-VLA checkpoints in this repository.
27
+
28
+ ## Checkpoints
29
+
30
+ | Folder | Model | Representation | Task |
31
+ | ----------------------------------------------------------------------- | -------------- | ------------------------------------ | ----------- |
32
+ | `pi_behavior_b1k_fast--50t_lora--task-0021` | PI0.5 baseline | 2D image observation | 21 |
33
+ | `pi_behavior_b1k_fast--50t_lora--task-0022` | PI0.5 baseline | 2D image observation | 22 |
34
+ | `pi_behavior_b1k_fast--50t_lora--task-0026` | PI0.5 baseline | 2D image observation | 26 |
35
+ | `pi_serf_behavior_b1k_fast--4d_env_robot_feat_map--50t_lora--task-0021` | SERF-VLA | 4D environment and robot feature map | 21 |
36
+ | `pi_serf_behavior_b1k_fast--4d_env_robot_feat_map--50t_lora--task-0022` | SERF-VLA | 4D environment and robot feature map | 22 |
37
+ | `pi_serf_behavior_b1k_fast--4d_env_robot_feat_map--50t_lora--task-0026` | SERF-VLA | 4D environment and robot feature map | 26 |
38
+
39
+ Each checkpoint follows the original policy checkpoint structure:
40
+
41
+ ```text
42
+ checkpoint_name/
43
+ ├── assets/
44
+ └── params/
45
+ ```
46
+
47
+ ## Usage
48
+
49
+ Download all checkpoints with `huggingface_hub`:
50
+
51
+ ```python
52
+ from huggingface_hub import snapshot_download
53
+
54
+ snapshot_download(
55
+ repo_id="byeonghyunpak/SERF-VLA",
56
+ repo_type="model",
57
+ local_dir="checkpoints/serf-vla-behavior-b1k",
58
+ )
59
+ ```
60
+
61
+ To download a specific checkpoint folder only:
62
+
63
+ ```python
64
+ from huggingface_hub import snapshot_download
65
+
66
+ snapshot_download(
67
+ repo_id="byeonghyunpak/SERF-VLA",
68
+ repo_type="model",
69
+ local_dir="checkpoints/serf-vla-behavior-b1k",
70
+ allow_patterns=[
71
+ "pi_serf_behavior_b1k_fast--4d_env_robot_feat_map--50t_lora--task-0021/**"
72
+ ],
73
+ )
74
+ ```
75
+
76
+ For installation, data preparation, training, and evaluation instructions, please refer to the official code repository:
77
+
78
+ https://github.com/ExistentialRobotics/SERF-VLA
79
+
80
+ ## Note
81
+
82
+ BEHAVIOR-1K evaluation is non-deterministic; results can differ across repeated runs due to variability in the underlying physics simulation and error accumulation over long execution time.
83
+
84
+ ## Citation
85
+
86
+ If you find these checkpoints useful, please cite our paper:
87
+
88
+ ```bibtex
89
+ @article{kim2026serf,
90
+ title = {SERF: Spatiotemporal Environment and Robot Feature Map for Long-Horizon Mobile Manipulation},
91
+ author = {Kim, Sunghwan and Pak, Byeonghyun and Long, Kehan and Tian, Yulun and Atanasov, Nikolay},
92
+ journal = {arXiv preprint arXiv:2606.12956},
93
+ year = {2026}
94
+ }
95
+ ```
96
+
97
+ ## Acknowledgements
98
+
99
+ This release builds on behavior-1k-solution, openpi, and BEHAVIOR-1K. We thank the authors and maintainers of these projects.