Add model card and metadata for APEIRIA

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +51 -0
README.md ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ library_name: peft
4
+ pipeline_tag: image-text-to-text
5
+ base_model: Qwen/Qwen3-VL-8B-Instruct
6
+ tags:
7
+ - 3d
8
+ - multi-modal
9
+ - chain-of-thought
10
+ - neuro-symbolic
11
+ ---
12
+
13
+ # APEIRIA: Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs
14
+
15
+ **APEIRIA** (ἄπειρον, *unlimited* in Greek) is a neuro-symbolic 3D multi-modal LLM framework designed to bridge the gap between interpretable neuro-symbolic reasoning and the flexibility of end-to-end 3D MLLMs. It distills symbolic reasoning patterns into MLLMs using a natural language chain-of-thought (CoT) approach.
16
+
17
+ The model was presented in the paper [Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs](https://huggingface.co/papers/2606.01215), which was accepted to ICML 2026. This repository contains the released APEIRIA model checkpoint as a LoRA adapter based on the [Qwen3-VL-8B-Instruct](https://huggingface.co/Qwen/Qwen3-VL-8B-Instruct) backbone.
18
+
19
+ - **Paper:** [Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs](https://huggingface.co/papers/2606.01215)
20
+ - **Project Page:** [https://matthewdm0816.github.io/Apeiria_Open](https://matthewdm0816.github.io/Apeiria_Open)
21
+ - **Repository:** [https://github.com/oceanflowlab/APEIRIA](https://github.com/oceanflowlab/APEIRIA)
22
+
23
+ ## Model Description
24
+
25
+ APEIRIA introduces a three-stage curriculum to progressively build reasoning capabilities:
26
+ 1. **3D Perception Alignment**: Grounds object visual-geometric features to the LLM.
27
+ 2. **CoT-SFT**: Teaches query decomposition and stepwise verification from symbolic program traces.
28
+ 3. **CoT-RL**: Extends reasoning patterns to open-set concepts and deeply nested instructions.
29
+
30
+ By transferring reasoning patterns rather than concept-specific knowledge, APEIRIA preserves transparent reasoning and modular interchangeability of planning and perception components.
31
+
32
+ ## Usage
33
+
34
+ Please refer to the [official GitHub repository](https://github.com/oceanflowlab/APEIRIA) for environment setup, data preparation, and detailed instructions on running inference or training.
35
+
36
+ ## Citation
37
+
38
+ If you find this work useful, please consider citing:
39
+
40
+ ```bibtex
41
+ @inproceedings{mo2026,
42
+ title={Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs},
43
+ author={Mo, Wentao and Liu, Yang},
44
+ booktitle={International Conference on Machine Learning},
45
+ year={2026}
46
+ }
47
+ ```
48
+
49
+ ## Acknowledgements
50
+
51
+ This code builds upon previous 3D MLLMs and foundation models, including [Chat-Scene](https://github.com/ZzZZCHS/Chat-Scene), [SegDINO3D](https://github.com/IDEA-Research/SegDINO3D), and [Mask3D](https://github.com/jonasschult/mask3d). It utilizes the [SGLang](https://github.com/sgl-project/sglang) library for fast multi-modal generation.