mlshehab commited on
Commit
585b02a
·
verified ·
1 Parent(s): f3fab9a

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +2 -15
README.md CHANGED
@@ -8,45 +8,32 @@ tags:
8
  - forcesight
9
  - tactile
10
  ---
11
-
12
  # ForceSight — pi0.5 fine-tuned checkpoints
13
-
14
  Fine-tuned pi0.5 (openpi) policies for ForceSight manipulation tasks.
15
  All checkpoints are from step 20000, trained on 6/3 data.
16
-
17
  ## Checkpoints
18
-
19
  | Folder | Variant | Description |
20
  |--------|---------|-------------|
21
  | `pi05_6_3/` | Baseline pi0.5 | Vanilla pi0.5 fine-tune, no tactile. |
22
  | `encoder_6_3/` | pi0.5 + tactile encoder | Conv-Based encoder for tactile images |
23
  | `tactile_6_3/` | pi0.5 + tactile | Tactile images are augmented as camera inputs to the VLA model |
24
-
25
  Each folder contains `params/` (orbax weights) and `assets/` (normalization stats — required for inference).
26
-
27
  ## Setup
28
-
29
  - **Base model:** pi0.5 (openpi)
30
  - **Robot:** Franka Emika Panda + Franka Hand
31
  - **Tasks:** Medicine, Balance, Gear Insertion, Plug Insertion.
32
  - **Training:** 20000 steps, 4 A6000 GPUs.
33
-
34
  ## Loading
35
-
36
  Download a single checkpoint:
37
-
38
  ```bash
39
  hf download mlshehab/forcesight --include "pi05_6_3/*" --local-dir ./forcesight
40
  ```
41
-
42
  Load with openpi:
43
-
44
  ```python
45
  from openpi.policies import policy_config
46
  from openpi.training import config
47
-
48
  cfg = config.get_config("<FILL IN: config name, e.g. pi05_forcesight>")
49
  policy = policy_config.create_trained_policy(cfg, "./forcesight/pi05_6_3")
50
  ```
51
-
52
- > Note: the tactile variants require a custom openpi config/fork. See [openpi](https://github.com/Physical-Intelligence/openpi).
 
8
  - forcesight
9
  - tactile
10
  ---
 
11
  # ForceSight — pi0.5 fine-tuned checkpoints
 
12
  Fine-tuned pi0.5 (openpi) policies for ForceSight manipulation tasks.
13
  All checkpoints are from step 20000, trained on 6/3 data.
 
14
  ## Checkpoints
 
15
  | Folder | Variant | Description |
16
  |--------|---------|-------------|
17
  | `pi05_6_3/` | Baseline pi0.5 | Vanilla pi0.5 fine-tune, no tactile. |
18
  | `encoder_6_3/` | pi0.5 + tactile encoder | Conv-Based encoder for tactile images |
19
  | `tactile_6_3/` | pi0.5 + tactile | Tactile images are augmented as camera inputs to the VLA model |
20
+ | `tapvla_6_3/` | pi0.5 + annotation | Tactile sensor data is annotated directly on the VLA images |
21
  Each folder contains `params/` (orbax weights) and `assets/` (normalization stats — required for inference).
 
22
  ## Setup
 
23
  - **Base model:** pi0.5 (openpi)
24
  - **Robot:** Franka Emika Panda + Franka Hand
25
  - **Tasks:** Medicine, Balance, Gear Insertion, Plug Insertion.
26
  - **Training:** 20000 steps, 4 A6000 GPUs.
 
27
  ## Loading
 
28
  Download a single checkpoint:
 
29
  ```bash
30
  hf download mlshehab/forcesight --include "pi05_6_3/*" --local-dir ./forcesight
31
  ```
 
32
  Load with openpi:
 
33
  ```python
34
  from openpi.policies import policy_config
35
  from openpi.training import config
 
36
  cfg = config.get_config("<FILL IN: config name, e.g. pi05_forcesight>")
37
  policy = policy_config.create_trained_policy(cfg, "./forcesight/pi05_6_3")
38
  ```
39
+ > Note: the tactile and TAP-VLA variants require a custom openpi config/fork. See [openpi](https://github.com/Physical-Intelligence/openpi).