Update README.md
Browse files
README.md
CHANGED
|
@@ -46,7 +46,7 @@ This LoRA model is trained on Maniskill setting by SFT with base model ``Haozhan
|
|
| 46 |
## How to Use
|
| 47 |
Please integrate the provided model with the [RLinf](https://github.com/RLinf/RLinf) codebase and the model ``RLinf/RLinf-OpenVLAOFT-ManiSkill-Base-Main``. To do so, modify the following parameters in the configuration file ``examples/embodiment/config/maniskill_ppo_openvlaoft.yaml``:
|
| 48 |
|
| 49 |
-
- Set ``actor.checkpoint_load_path``, ``actor.tokenizer.tokenizer_model``, and ``rollout.model_dir`` to the path of the ``RLinf/
|
| 50 |
- Set ``actor.model.lora_path`` to the path of this LoRA checkpoint and set ``actor.model.is_lora`` as True.
|
| 51 |
|
| 52 |
Note: Currently we only support LoRA training with this checkpoint. If you do not want to use LoRA, please combine the base model and the lora checkpoint by the ``merge_and_unload`` function in the ``peft`` package.
|
|
|
|
| 46 |
## How to Use
|
| 47 |
Please integrate the provided model with the [RLinf](https://github.com/RLinf/RLinf) codebase and the model ``RLinf/RLinf-OpenVLAOFT-ManiSkill-Base-Main``. To do so, modify the following parameters in the configuration file ``examples/embodiment/config/maniskill_ppo_openvlaoft.yaml``:
|
| 48 |
|
| 49 |
+
- Set ``actor.checkpoint_load_path``, ``actor.tokenizer.tokenizer_model``, and ``rollout.model_dir`` to the path of the ``RLinf/RLinf-OpenVLAOFT-ManiSkill-Base-Main`` checkpoint.
|
| 50 |
- Set ``actor.model.lora_path`` to the path of this LoRA checkpoint and set ``actor.model.is_lora`` as True.
|
| 51 |
|
| 52 |
Note: Currently we only support LoRA training with this checkpoint. If you do not want to use LoRA, please combine the base model and the lora checkpoint by the ``merge_and_unload`` function in the ``peft`` package.
|