Spaces:
Build error
Build error
Update README.md
Browse files
README.md
CHANGED
|
@@ -15,28 +15,34 @@ license: apache-2.0
|
|
| 15 |
|
| 16 |
This demo is from the paper:
|
| 17 |
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
Below is an interactive demo for the simulated tabletop manipulation domain, seen in the paper section IV.D
|
| 21 |
|
| 22 |
## Preparations
|
| 23 |
1. Obtain an [OpenAI API Key](https://openai.com/blog/openai-api/)
|
| 24 |
|
| 25 |
## Usage
|
| 26 |
-
|
| 27 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 28 |
|
| 29 |
## Guideline
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 30 |
|
| 31 |
## Known Limitations
|
| 32 |
-
1. The code generation can fail or generate infeasible tasks.
|
| 33 |
2. The low-level pick place primitive does not do collision checking and cannot pick up certain objects.
|
| 34 |
3. Top-down generation is typically more challenging if the task name is too vague or too distant from motions such as stacking.
|
| 35 |
|
| 36 |
|
| 37 |
## Note
|
| 38 |
-
For GPT-4 model, each inference costs about $\\$$0.3. For GPT-3.5 model, each inference costs about $\\$$0.03.
|
| 39 |
-
|
| 40 |
|
| 41 |
-
## Acknowledgement
|
| 42 |
-
Thanks to Jacky's [code-as-policies](https://huggingface.co/spaces/jackyliang42/code-as-policies/tree/main) demo.
|
|
|
|
| 15 |
|
| 16 |
This demo is from the paper:
|
| 17 |
|
| 18 |
+
GenSim: Supersizing Robotic Simulation Tasks for Policy Learning via Generative Models
|
| 19 |
+
|
|
|
|
| 20 |
|
| 21 |
## Preparations
|
| 22 |
1. Obtain an [OpenAI API Key](https://openai.com/blog/openai-api/)
|
| 23 |
|
| 24 |
## Usage
|
| 25 |
+
0. Click Run-Example will simulate one example of pre-saved tasks in the task library and render videos.
|
| 26 |
+
1. Top-Down Model:
|
| 27 |
+
0. Type in the desired task name in the box. Then GenSim will try to run through the pipeline to generate the task.
|
| 28 |
+
1. The task name has the form word separated by dash. For instance, 'place-blue-in-yellow' and 'align-rainbow-along-line'.
|
| 29 |
+
2. Bottom-Up Model: No need to type in desired task. GenSim will try to generate a novel tasks that is different from the task library.
|
| 30 |
+
3. Usage: Always click on "Setup/Reset Simulation" and then click "Run".
|
| 31 |
|
| 32 |
## Guideline
|
| 33 |
+
0. The first output is the current stage of the task generation pipeline.
|
| 34 |
+
1. The second output shows the generated code from Gen-Sim
|
| 35 |
+
2. If there are errors in the generation stage above, you will see an error log on the top right.
|
| 36 |
+
3. If there is still orange bars around the third output, then it means the task is being simulated and rendered.
|
| 37 |
+
4. The rendered video will come out in a stream, i.e. it will render and re-render in a sequence. Each new update takes 15 seconds.
|
| 38 |
+
|
| 39 |
|
| 40 |
## Known Limitations
|
| 41 |
+
1. The code generation can fail or generate infeasible tasks. The success rate is around 0.5.
|
| 42 |
2. The low-level pick place primitive does not do collision checking and cannot pick up certain objects.
|
| 43 |
3. Top-down generation is typically more challenging if the task name is too vague or too distant from motions such as stacking.
|
| 44 |
|
| 45 |
|
| 46 |
## Note
|
| 47 |
+
For GPT-4 model, each inference costs about $\\$$0.3. For GPT-3.5 model, each inference costs about $\\$$0.03. You can select which LLM model you would like to use.
|
|
|
|
| 48 |
|
|
|
|
|
|