Gen-Sim commited on
Commit
b050134
·
1 Parent(s): 02f2fd9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -10
README.md CHANGED
@@ -15,28 +15,34 @@ license: apache-2.0
15
 
16
  This demo is from the paper:
17
 
18
- <!-- [Code as Policies: Language Model Programs for Embodied Control](https://code-as-policies.github.io/)
19
- -->
20
- Below is an interactive demo for the simulated tabletop manipulation domain, seen in the paper section IV.D
21
 
22
  ## Preparations
23
  1. Obtain an [OpenAI API Key](https://openai.com/blog/openai-api/)
24
 
25
  ## Usage
26
- 1. Type in desired task name in the box. Then GenSim will try to run through the pipeline
27
- 2. The task name has the form word separated by dash. For instance, 'place-blue-in-yellow' and 'align-rainbow-along-line'.
 
 
 
 
28
 
29
  ## Guideline
 
 
 
 
 
 
30
 
31
  ## Known Limitations
32
- 1. The code generation can fail or generate infeasible tasks.
33
  2. The low-level pick place primitive does not do collision checking and cannot pick up certain objects.
34
  3. Top-down generation is typically more challenging if the task name is too vague or too distant from motions such as stacking.
35
 
36
 
37
  ## Note
38
- For GPT-4 model, each inference costs about $\\$$0.3. For GPT-3.5 model, each inference costs about $\\$$0.03.
39
-
40
 
41
- ## Acknowledgement
42
- Thanks to Jacky's [code-as-policies](https://huggingface.co/spaces/jackyliang42/code-as-policies/tree/main) demo.
 
15
 
16
  This demo is from the paper:
17
 
18
+ GenSim: Supersizing Robotic Simulation Tasks for Policy Learning via Generative Models
19
+
 
20
 
21
  ## Preparations
22
  1. Obtain an [OpenAI API Key](https://openai.com/blog/openai-api/)
23
 
24
  ## Usage
25
+ 0. Click Run-Example will simulate one example of pre-saved tasks in the task library and render videos.
26
+ 1. Top-Down Model:
27
+ 0. Type in the desired task name in the box. Then GenSim will try to run through the pipeline to generate the task.
28
+ 1. The task name has the form word separated by dash. For instance, 'place-blue-in-yellow' and 'align-rainbow-along-line'.
29
+ 2. Bottom-Up Model: No need to type in desired task. GenSim will try to generate a novel tasks that is different from the task library.
30
+ 3. Usage: Always click on "Setup/Reset Simulation" and then click "Run".
31
 
32
  ## Guideline
33
+ 0. The first output is the current stage of the task generation pipeline.
34
+ 1. The second output shows the generated code from Gen-Sim
35
+ 2. If there are errors in the generation stage above, you will see an error log on the top right.
36
+ 3. If there is still orange bars around the third output, then it means the task is being simulated and rendered.
37
+ 4. The rendered video will come out in a stream, i.e. it will render and re-render in a sequence. Each new update takes 15 seconds.
38
+
39
 
40
  ## Known Limitations
41
+ 1. The code generation can fail or generate infeasible tasks. The success rate is around 0.5.
42
  2. The low-level pick place primitive does not do collision checking and cannot pick up certain objects.
43
  3. Top-down generation is typically more challenging if the task name is too vague or too distant from motions such as stacking.
44
 
45
 
46
  ## Note
47
+ For GPT-4 model, each inference costs about $\\$$0.3. For GPT-3.5 model, each inference costs about $\\$$0.03. You can select which LLM model you would like to use.
 
48