mlshehab commited on
Commit
fd92a15
·
verified ·
1 Parent(s): 4cd419e

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +52 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - robotics
5
+ - vla
6
+ - openpi
7
+ - pi05
8
+ - forcesight
9
+ - tactile
10
+ ---
11
+
12
+ # ForceSight — pi0.5 fine-tuned checkpoints
13
+
14
+ Fine-tuned pi0.5 (openpi) policies for ForceSight manipulation tasks.
15
+ All checkpoints are from step 20000, trained on 6/3 data.
16
+
17
+ ## Checkpoints
18
+
19
+ | Folder | Variant | Description |
20
+ |--------|---------|-------------|
21
+ | `pi05_6_3/` | Baseline pi0.5 | Vanilla pi0.5 fine-tune, no tactile. |
22
+ | `encoder_6_3/` | pi0.5 + tactile encoder | Conv-Based encoder for tactile images |
23
+ | `tactile_6_3/` | pi0.5 + tactile | Tactile images are augmented as camera inputs to the VLA model |
24
+
25
+ Each folder contains `params/` (orbax weights) and `assets/` (normalization stats — required for inference).
26
+
27
+ ## Setup
28
+
29
+ - **Base model:** pi0.5 (openpi)
30
+ - **Robot:** Franka Emika Panda + Franka Hand
31
+ - **Tasks:** Medicine, Balance, Gear Insertion, Plug Insertion.
32
+ - **Training:** 20000 steps, 4 A6000 GPUs.
33
+
34
+ ## Loading
35
+
36
+ Download a single checkpoint:
37
+
38
+ ```bash
39
+ hf download mlshehab/forcesight --include "pi05_6_3/*" --local-dir ./forcesight
40
+ ```
41
+
42
+ Load with openpi:
43
+
44
+ ```python
45
+ from openpi.policies import policy_config
46
+ from openpi.training import config
47
+
48
+ cfg = config.get_config("<FILL IN: config name, e.g. pi05_forcesight>")
49
+ policy = policy_config.create_trained_policy(cfg, "./forcesight/pi05_6_3")
50
+ ```
51
+
52
+ > Note: the tactile variants require a custom openpi config/fork. See [openpi](https://github.com/Physical-Intelligence/openpi).