File size: 1,847 Bytes
f4bdec1
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
---
license: mit
base_model: AAyano/oft_setting2_chunksize25_batch32_20k
tags:
- robotics
- vla
- openvla
- openvla-oft
- xarm
- task-conditioned-gate
library_name: transformers
---

# gate_setting2_chunksize25_batch32_from20000

Task-conditioned **text-token-gate** OpenVLA-OFT model for real-world XArm, **setting 2: cup stacking**.
Trained fresh for **10000 steps** on top of the [oft_setting2_chunksize25_batch32_20k](https://huggingface.co/AAyano/oft_setting2_chunksize25_batch32_20k) OFT backbone (action head / proprio projector / FiLM re-trained; cosine LR 5e-4 with 1000 warmup, effective batch 32, seed 6).

## Gate configuration (baked into `config.json`)

- Gazing: `self_attention` (dim 512, 8 heads, 1 layer), gate MLP hidden 512 / depth 1
- Text pooling: `contrastive_alignment_score` (visual τ 0.1, text τ 0.05), instruction-only pooling, stopword filtering
- Layer gate: `threshold` mode, threshold 0.3, strength 0.5
- Budget loss: target 0.4, weight 0.01

## ⚠️ Serving requires the Task-conditioned_Gate codebase

The gate modules live in this repo's `modeling_prismatic.py` (loaded via `trust_remote_code`), but the openvla-oft serve flow syncs the local repo's modeling files INTO the checkpoint before loading. Serve with `REPO_DIR` pointing at the [Task-conditioned_Gate](https://github.com/Kaixi66/Task-conditioned_Gate) repo — serving with vanilla openvla-oft silently drops the gate weights.

## Contents

- Merged full model (`model-*.safetensors`, gate config in `config.json`)
- `lora_adapter/` — LoRA + gate weights (`modules_to_save=["text_token_gate"]`), standalone copy
- `action_head--10000_checkpoint.pt`, `proprio_projector--10000_checkpoint.pt`, `vision_backbone--10000_checkpoint.pt` (FiLM)
- `dataset_statistics.json`, `oft_training_config.json` (chunk 25, action dim 7, proprio dim 6, BOUNDS_Q99)