Georg commited on
Commit
4d72f45
·
1 Parent(s): e2be278

Add T-shape CAD model from MuJoCo scene for FoundationPose testing

Browse files
tests/reference/t_shape/README.md ADDED
@@ -0,0 +1,63 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # T-Shaped Object Mesh
2
+
3
+ This directory contains a 3D mesh of the T-shaped pushing object from the MuJoCo scene `nova-sim/robots/ur5/model/scene_t_push.xml`.
4
+
5
+ ## Files
6
+
7
+ - `t_shape.obj` - 3D mesh in Wavefront OBJ format
8
+
9
+ ## Dimensions
10
+
11
+ The T-shape consists of two rectangular boxes:
12
+
13
+ ### Stem (vertical part)
14
+ - Dimensions: 40mm × 140mm × 60mm (width × height × depth)
15
+ - Position: centered at (0, -50mm, 0)
16
+
17
+ ### Cap (horizontal part)
18
+ - Dimensions: 160mm × 40mm × 60mm
19
+ - Position: centered at (0, 30mm, 0)
20
+
21
+ ### Overall Bounds
22
+ - X: [-80mm, 80mm] (160mm total width)
23
+ - Y: [-120mm, 50mm] (170mm total height)
24
+ - Z: [-30mm, 30mm] (60mm total depth)
25
+
26
+ ## Usage
27
+
28
+ This mesh can be used with FoundationPose's CAD-based initialization mode for 6D pose estimation of the T-shaped object in the nova-sim push manipulation task.
29
+
30
+ ### Example Usage
31
+
32
+ ```python
33
+ from gradio_client import Client, handle_file
34
+
35
+ client = Client("https://gpue-foundationpose.hf.space")
36
+
37
+ # Initialize with T-shape mesh
38
+ result = client.predict(
39
+ object_id="t_shape",
40
+ mesh_file=handle_file("t_shape.obj"),
41
+ reference_files=[], # Optional reference images
42
+ fx=500.0, fy=500.0, cx=320.0, cy=240.0,
43
+ api_name="/gradio_initialize_cad"
44
+ )
45
+
46
+ # Estimate pose in query image
47
+ result = client.predict(
48
+ object_id="t_shape",
49
+ query_image=handle_file("camera_frame.jpg"),
50
+ fx=500.0, fy=500.0, cx=320.0, cy=240.0,
51
+ api_name="/gradio_estimate"
52
+ )
53
+ ```
54
+
55
+ ## Material Properties (from MuJoCo)
56
+
57
+ - Mass: 5.0 kg total (stem: 3.0 kg, cap: 2.0 kg)
58
+ - Friction: 0.3 (sliding), 0.005 (torsional), 0.005 (rolling)
59
+ - Color: Light blue (rgba: 0.55, 0.65, 0.98, 1.0)
60
+
61
+ ## Generation
62
+
63
+ This mesh was automatically generated from the MuJoCo scene definition using a Python script that extracts the box geometries and creates a combined mesh.
tests/reference/t_shape/t_shape.obj ADDED
@@ -0,0 +1,44 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # T-shaped object from MuJoCo scene_t_push.xml
2
+ # Generated for FoundationPose testing
3
+
4
+ v -0.020000 -0.120000 -0.030000
5
+ v 0.020000 -0.120000 -0.030000
6
+ v 0.020000 0.020000 -0.030000
7
+ v -0.020000 0.020000 -0.030000
8
+ v -0.020000 -0.120000 0.030000
9
+ v 0.020000 -0.120000 0.030000
10
+ v 0.020000 0.020000 0.030000
11
+ v -0.020000 0.020000 0.030000
12
+ v -0.080000 0.010000 -0.030000
13
+ v 0.080000 0.010000 -0.030000
14
+ v 0.080000 0.050000 -0.030000
15
+ v -0.080000 0.050000 -0.030000
16
+ v -0.080000 0.010000 0.030000
17
+ v 0.080000 0.010000 0.030000
18
+ v 0.080000 0.050000 0.030000
19
+ v -0.080000 0.050000 0.030000
20
+
21
+ f 1 2 3
22
+ f 1 3 4
23
+ f 5 7 6
24
+ f 5 8 7
25
+ f 1 4 8
26
+ f 1 8 5
27
+ f 2 6 7
28
+ f 2 7 3
29
+ f 1 5 6
30
+ f 1 6 2
31
+ f 4 3 7
32
+ f 4 7 8
33
+ f 9 10 11
34
+ f 9 11 12
35
+ f 13 15 14
36
+ f 13 16 15
37
+ f 9 12 16
38
+ f 9 16 13
39
+ f 10 14 15
40
+ f 10 15 11
41
+ f 9 13 14
42
+ f 9 14 10
43
+ f 12 11 15
44
+ f 12 15 16