Spaces:
Running
Running
Lead with the senses; sense packs above the base models
Browse files
README.md
CHANGED
|
@@ -9,20 +9,28 @@ pinned: false
|
|
| 9 |
|
| 10 |

|
| 11 |
|
| 12 |
-
Eximius Labs builds open
|
| 13 |
|
| 14 |
-
|
| 15 |
|
| 16 |
-
|
| 17 |
|
| 18 |
-
|
|
|
|
|
|
|
| 19 |
|
| 20 |
-
- [fusion-embedding-2](https://huggingface.co/EximiusLabs/fusion-embedding-2-2b-preview) β text, image, video, and audio in one space (connector plus modality-gated adapters).
|
| 21 |
-
- [fusion-embedding-1](https://huggingface.co/EximiusLabs/fusion-embedding-1-2b-preview) β the connector-only first generation.
|
| 22 |
- [Ember](https://huggingface.co/EximiusLabs/fusion-embedding-2-ember) β thermal and infrared, as a loadable sense pack.
|
| 23 |
- [Tremor](https://huggingface.co/EximiusLabs/fusion-embedding-2-tremor) β body-worn and robot motion (IMU and accelerometer), read as language, with a [Unitree-G1 head](https://huggingface.co/EximiusLabs/fusion-embedding-2-tremor-g1).
|
| 24 |
- [Tactus](https://huggingface.co/EximiusLabs/fusion-embedding-2-tactus) β touch (32x32 pressure/taxel arrays from FSR gloves, e-skins, and robot hands), as a loadable sense pack; matches, and at best exceeds, the STAG (Nature 2019) supervised baseline while remaining open-vocabulary.
|
| 25 |
- [Tactus Mat](https://huggingface.co/EximiusLabs/fusion-embedding-2-tactus-mat) β the same tactile pack trained for a 64x32 body pressure mat (bed, seat, wheelchair, insole): 17 in-bed postures answered as text queries, 0.957 top-1 on held-out subjects.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
- [fusion-embedding-2-k3-vision](https://huggingface.co/EximiusLabs/fusion-embedding-2-k3-vision) β Kimi K3's vision encoder, projected into the shared space.
|
| 27 |
|
| 28 |
## Fusion Perception, the perception layer
|
|
|
|
| 9 |
|
| 10 |

|
| 11 |
|
| 12 |
+
Eximius Labs builds open models that give machines senses. Touch, heat, motion and sound become things you can search in plain language, on hardware you own.
|
| 13 |
|
| 14 |
+
The method is the same every time: freeze a strong multimodal base, attach a sense from the outside, and keep every existing embedding bit-for-bit valid. Adding a sensor is a small trained head and an afternoon of compute, not a new foundation model. One shared space spans text, image, video, audio, thermal, motion and touch.
|
| 15 |
|
| 16 |
+
Technical report: https://arxiv.org/abs/2607.18666. Try a real robot's memory in the live playground: https://www.eximiuslabs.com/playground.
|
| 17 |
|
| 18 |
+
## The senses
|
| 19 |
+
|
| 20 |
+
Each pack is separately loadable and leaves the base model untouched.
|
| 21 |
|
|
|
|
|
|
|
| 22 |
- [Ember](https://huggingface.co/EximiusLabs/fusion-embedding-2-ember) β thermal and infrared, as a loadable sense pack.
|
| 23 |
- [Tremor](https://huggingface.co/EximiusLabs/fusion-embedding-2-tremor) β body-worn and robot motion (IMU and accelerometer), read as language, with a [Unitree-G1 head](https://huggingface.co/EximiusLabs/fusion-embedding-2-tremor-g1).
|
| 24 |
- [Tactus](https://huggingface.co/EximiusLabs/fusion-embedding-2-tactus) β touch (32x32 pressure/taxel arrays from FSR gloves, e-skins, and robot hands), as a loadable sense pack; matches, and at best exceeds, the STAG (Nature 2019) supervised baseline while remaining open-vocabulary.
|
| 25 |
- [Tactus Mat](https://huggingface.co/EximiusLabs/fusion-embedding-2-tactus-mat) β the same tactile pack trained for a 64x32 body pressure mat (bed, seat, wheelchair, insole): 17 in-bed postures answered as text queries, 0.957 top-1 on held-out subjects.
|
| 26 |
+
|
| 27 |
+
## The base models
|
| 28 |
+
|
| 29 |
+
The shared space itself: one vector space for cross-modal retrieval, RAG, clustering and
|
| 30 |
+
semantic search. The senses above attach to these and never modify them.
|
| 31 |
+
|
| 32 |
+
- [fusion-embedding-2](https://huggingface.co/EximiusLabs/fusion-embedding-2-2b-preview) β text, image, video, and audio in one space (connector plus modality-gated adapters).
|
| 33 |
+
- [fusion-embedding-1](https://huggingface.co/EximiusLabs/fusion-embedding-1-2b-preview) β the connector-only first generation.
|
| 34 |
- [fusion-embedding-2-k3-vision](https://huggingface.co/EximiusLabs/fusion-embedding-2-k3-vision) β Kimi K3's vision encoder, projected into the shared space.
|
| 35 |
|
| 36 |
## Fusion Perception, the perception layer
|