spikefly commited on
Commit
6a6aed4
Β·
0 Parent(s):

Initial placeholder model card

Browse files
Files changed (2) hide show
  1. .gitattributes +35 -0
  2. README.md +99 -0
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,99 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ library_name: pytorch
4
+ pipeline_tag: robotics
5
+ tags:
6
+ - robotics
7
+ - vision-language-action
8
+ - vla
9
+ - libero
10
+ - manipulation
11
+ - qwen-vl
12
+ ---
13
+
14
+ # SemanticVLA Β· LIBERO
15
+
16
+ > 🚧 **Placeholder.** The URL is stable; checkpoints will be uploaded incrementally per the [release roadmap](https://github.com/Fei-Ni/SemanticVLA_Offcial/blob/main/docs/ROADMAP.md).
17
+
18
+ [SemanticVLA](https://github.com/Fei-Ni/SemanticVLA_Offcial) finetuned on the [LIBERO](https://github.com/Lifelong-Robot-Learning/LIBERO) benchmark.
19
+
20
+ ## Headline result
21
+
22
+ | Suite | Success rate |
23
+ |---|---:|
24
+ | `libero_spatial` | 0.988 |
25
+ | `libero_object` | 0.996 |
26
+ | `libero_goal` | 0.986 |
27
+ | `libero_10` | 0.966 |
28
+ | **4-suite mean** | **0.9840** |
29
+
30
+ Best configuration: `TL_saembs_lw010` (trace + latent semantic output, `sa_embs` injection, LM loss weight 0.10, step 30000).
31
+
32
+ ## Architecture
33
+
34
+ - **Backbone**: Qwen2.5-VL-3B (with trace + latent-action semantic heads)
35
+ - **Action head**: GR00T-style flow-matching expert (continuous action chunks)
36
+ - **LAM tokenizer**: [`SemanticVLA-LAM` β†’ `libero/v5`](https://huggingface.co/spikefly/SemanticVLA-LAM)
37
+ - **Action horizon**: 16
38
+
39
+ ## Planned layout
40
+
41
+ ```
42
+ SemanticVLA-LIBERO/
43
+ β”œβ”€β”€ tl-saembs-lw010-best/
44
+ β”‚ β”œβ”€β”€ pytorch_model.pt
45
+ β”‚ β”œβ”€β”€ config.yaml
46
+ β”‚ └── model_card.md
47
+ └── README.md
48
+ ```
49
+
50
+ Additional ablation variants (`L_none_lw010`, `TL_none_lw010`, `TL_saembs_lw005`, etc.) may be uploaded as additional subdirectories upon release.
51
+
52
+ ## Sibling SemanticVLA checkpoint repos
53
+
54
+ | Repo | Purpose |
55
+ |---|---|
56
+ | πŸ€— [`SemanticVLA-LAM`](https://huggingface.co/spikefly/SemanticVLA-LAM) | LAM tokenizers used by this VLA |
57
+ | πŸ€— [`SemanticVLA-Bridge`](https://huggingface.co/spikefly/SemanticVLA-Bridge) | Bridge-finetuned VLA for SimplerEnv WidowX |
58
+
59
+ ## Related resources
60
+
61
+ - **Code**: https://github.com/Fei-Ni/SemanticVLA_Offcial
62
+ - **Datasets**: https://hf.co/collections/spikefly/semanticvla-datasets
63
+ - **Collection Β· Model Zoo**: https://hf.co/collections/spikefly/semanticvla-model-zoo
64
+
65
+ ## How to load (placeholder API)
66
+
67
+ ```python
68
+ from huggingface_hub import hf_hub_download
69
+ import torch
70
+
71
+ ckpt = hf_hub_download(
72
+ repo_id="spikefly/SemanticVLA-LIBERO",
73
+ filename="tl-saembs-lw010-best/pytorch_model.pt",
74
+ )
75
+ state = torch.load(ckpt, map_location="cpu")
76
+ # loader will be released with the code repo
77
+ ```
78
+
79
+ ## Citation
80
+
81
+ ```bibtex
82
+ @misc{semanticvla2026,
83
+ title = {SemanticVLA: Semantic Vision-Language-Action Models with Trace-Conditioned Latent Action Tokens},
84
+ author = {SemanticVLA Authors},
85
+ year = {2026},
86
+ url = {https://github.com/Fei-Ni/SemanticVLA_Offcial}
87
+ }
88
+
89
+ @inproceedings{liu2023libero,
90
+ title = {LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learning},
91
+ author = {Liu, Bo and Zhu, Yifeng and others},
92
+ booktitle = {NeurIPS Datasets and Benchmarks},
93
+ year = {2023}
94
+ }
95
+ ```
96
+
97
+ ## License
98
+
99
+ Released under the [MIT License](https://github.com/Fei-Ni/SemanticVLA_Offcial/blob/main/LICENSE).