Robotics
Transformers
ONNX
PyTorch
ballnet
metaball
multimodal
custom_code
han-xudong commited on
Commit
8fe82e6
·
1 Parent(s): 4d63463

modified: README.md

Browse files

modified: __init__.py

Files changed (2) hide show
  1. README.md +86 -1
  2. __init__.py +1 -1
README.md CHANGED
@@ -1,3 +1,88 @@
1
  ---
2
- license: mit
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: bsd-3-clause
3
+ pipeline_tag: robotics
4
+ tags:
5
+ - ballnet
6
+ - metaball
7
+ - multimodal
8
+ - onnx
9
+ - pytorch
10
+ library_name: transformers
11
+ datasets:
12
+ - asRobotics/ballnet-100k
13
  ---
14
+
15
+ # Model Card for BallNet
16
+
17
+ ## Table of Contents
18
+
19
+ - [Model Card for BallNet](#model-card-for-ballnet)
20
+ - [Table of Contents](#table-of-contents)
21
+ - [Model Description](#model-description)
22
+ - [Intended Use](#intended-use)
23
+ - [Training Data](#training-data)
24
+ - [Citation](#citation)
25
+
26
+ ## Model Description
27
+
28
+ BallNet is an MLP model designed for the Metaball. It can predict both 6D force and 3D shape (mesh nodes) from the 6D motion of the ball.
29
+
30
+ Try it out on the [Spaces demo](https://huggingface.co/spaces/asRobotics/ballnet-demo).
31
+
32
+ - Developer: Xudong Han, Tianyu Wu, Fang Wan, and Chaoyang Song.
33
+ - Model type: MLP
34
+ - License: BSD-3-Clause
35
+
36
+ ## Intended Use
37
+
38
+ This model is intended for researchers and developers working in robotics and tactile sensing. It can be used to enhance the capabilities of robotic systems by providing accurate predictions of force and shape based on tactile data.
39
+
40
+ To load the model:
41
+
42
+ ```python
43
+ from transformers import AutoModel
44
+
45
+ model = AutoModel.from_pretrained("asRobotics/ballnet", trust_remote_code=True)
46
+ x = torch.zeros((1, 6)) # Example input: batch size of 1, 6D motion
47
+ output = model(x)
48
+ ```
49
+
50
+ Or to load the ONNX version:
51
+
52
+ ```python
53
+ # Example code to load onnx
54
+ import onnxruntime as ort
55
+ import numpy as np
56
+ from huggingface_hub import hf_hub_download
57
+
58
+ onnx_model_path = hf_hub_download("asRobotics/ballnet", filename="model.onnx")
59
+ ort_session = ort.InferenceSession(onnx_model_path)
60
+
61
+ # Example input
62
+ x = np.zeros((1, 6), dtype=np.float32) # Batch size of 1, 6D motion
63
+ output = ort_session.run(None, {"motion": x})
64
+ ```
65
+
66
+ ## Training Data
67
+
68
+ The model was trained on the [BallNet-100K](https://huggingface.co/datasets/asRobotics/ballnet-100k) dataset, which includes a variety of motion, force, and shape data collected by finite element simulations.
69
+
70
+ ## Citation
71
+
72
+ If you use this model in your research, please cite the following papers:
73
+
74
+ ```bibtex
75
+ @article{liu2024proprioceptive,
76
+ title={Proprioceptive learning with soft polyhedral networks},
77
+ author={Liu, Xiaobo and Han, Xudong and Hong, Wei and Wan, Fang and Song, Chaoyang},
78
+ journal={The International Journal of Robotics Research},
79
+ volume = {43},
80
+ number = {12},
81
+ pages = {1916-1935},
82
+ year = {2024},
83
+ publisher={SAGE Publications Sage UK: London, England},
84
+ doi = {10.1177/02783649241238765}
85
+ }
86
+ ```
87
+
88
+ [](https://arxiv.org/abs/2308.08538)
__init__.py CHANGED
@@ -1 +1 @@
1
- from .modeling import FingerNet, FingerNetConfig
 
1
+ from .modeling import BallNet, BallNetConfig