abtonmoy commited on
Commit
dbf73d0
Β·
verified Β·
1 Parent(s): 8b31bb0

Lead with the senses; sense packs above the base models

Browse files
Files changed (1) hide show
  1. README.md +14 -6
README.md CHANGED
@@ -9,20 +9,28 @@ pinned: false
9
 
10
  ![Eximius Labs](assets/banner.png)
11
 
12
- Eximius Labs builds open-weight multimodal models and tools that run on your own hardware: the embedding, perception, memory, and control layers for physical AI. The technical report is on arXiv: https://arxiv.org/abs/2607.18666. Try a real robot's memory in the live playground: https://www.eximiuslabs.com/playground.
13
 
14
- We freeze a strong base model and add new senses from the outside, so existing embeddings stay valid and gaining a modality never forces a re-index. One shared vector space spans text, image, video, audio, thermal, motion (IMU), and touch.
15
 
16
- ## Fusion Embedding, the embedding layer
17
 
18
- One vector space for cross-modal retrieval, RAG, clustering, and semantic search.
 
 
19
 
20
- - [fusion-embedding-2](https://huggingface.co/EximiusLabs/fusion-embedding-2-2b-preview) β€” text, image, video, and audio in one space (connector plus modality-gated adapters).
21
- - [fusion-embedding-1](https://huggingface.co/EximiusLabs/fusion-embedding-1-2b-preview) β€” the connector-only first generation.
22
  - [Ember](https://huggingface.co/EximiusLabs/fusion-embedding-2-ember) β€” thermal and infrared, as a loadable sense pack.
23
  - [Tremor](https://huggingface.co/EximiusLabs/fusion-embedding-2-tremor) β€” body-worn and robot motion (IMU and accelerometer), read as language, with a [Unitree-G1 head](https://huggingface.co/EximiusLabs/fusion-embedding-2-tremor-g1).
24
  - [Tactus](https://huggingface.co/EximiusLabs/fusion-embedding-2-tactus) β€” touch (32x32 pressure/taxel arrays from FSR gloves, e-skins, and robot hands), as a loadable sense pack; matches, and at best exceeds, the STAG (Nature 2019) supervised baseline while remaining open-vocabulary.
25
  - [Tactus Mat](https://huggingface.co/EximiusLabs/fusion-embedding-2-tactus-mat) β€” the same tactile pack trained for a 64x32 body pressure mat (bed, seat, wheelchair, insole): 17 in-bed postures answered as text queries, 0.957 top-1 on held-out subjects.
 
 
 
 
 
 
 
 
26
  - [fusion-embedding-2-k3-vision](https://huggingface.co/EximiusLabs/fusion-embedding-2-k3-vision) β€” Kimi K3's vision encoder, projected into the shared space.
27
 
28
  ## Fusion Perception, the perception layer
 
9
 
10
  ![Eximius Labs](assets/banner.png)
11
 
12
+ Eximius Labs builds open models that give machines senses. Touch, heat, motion and sound become things you can search in plain language, on hardware you own.
13
 
14
+ The method is the same every time: freeze a strong multimodal base, attach a sense from the outside, and keep every existing embedding bit-for-bit valid. Adding a sensor is a small trained head and an afternoon of compute, not a new foundation model. One shared space spans text, image, video, audio, thermal, motion and touch.
15
 
16
+ Technical report: https://arxiv.org/abs/2607.18666. Try a real robot's memory in the live playground: https://www.eximiuslabs.com/playground.
17
 
18
+ ## The senses
19
+
20
+ Each pack is separately loadable and leaves the base model untouched.
21
 
 
 
22
  - [Ember](https://huggingface.co/EximiusLabs/fusion-embedding-2-ember) β€” thermal and infrared, as a loadable sense pack.
23
  - [Tremor](https://huggingface.co/EximiusLabs/fusion-embedding-2-tremor) β€” body-worn and robot motion (IMU and accelerometer), read as language, with a [Unitree-G1 head](https://huggingface.co/EximiusLabs/fusion-embedding-2-tremor-g1).
24
  - [Tactus](https://huggingface.co/EximiusLabs/fusion-embedding-2-tactus) β€” touch (32x32 pressure/taxel arrays from FSR gloves, e-skins, and robot hands), as a loadable sense pack; matches, and at best exceeds, the STAG (Nature 2019) supervised baseline while remaining open-vocabulary.
25
  - [Tactus Mat](https://huggingface.co/EximiusLabs/fusion-embedding-2-tactus-mat) β€” the same tactile pack trained for a 64x32 body pressure mat (bed, seat, wheelchair, insole): 17 in-bed postures answered as text queries, 0.957 top-1 on held-out subjects.
26
+
27
+ ## The base models
28
+
29
+ The shared space itself: one vector space for cross-modal retrieval, RAG, clustering and
30
+ semantic search. The senses above attach to these and never modify them.
31
+
32
+ - [fusion-embedding-2](https://huggingface.co/EximiusLabs/fusion-embedding-2-2b-preview) β€” text, image, video, and audio in one space (connector plus modality-gated adapters).
33
+ - [fusion-embedding-1](https://huggingface.co/EximiusLabs/fusion-embedding-1-2b-preview) β€” the connector-only first generation.
34
  - [fusion-embedding-2-k3-vision](https://huggingface.co/EximiusLabs/fusion-embedding-2-k3-vision) β€” Kimi K3's vision encoder, projected into the shared space.
35
 
36
  ## Fusion Perception, the perception layer