File size: 11,443 Bytes
9657a19
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7b24b1d
9657a19
 
 
 
 
 
 
 
 
 
 
 
 
90c652c
 
 
 
 
7b24b1d
 
9657a19
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
<div style="max-width:100%;overflow:hidden;">
<pre style="
  background:#0d0d0d;
  font-family:'Courier New',Courier,monospace;
  font-size:clamp(3.5px,0.82vw,10px);
  line-height:1.15;
  padding:0.9em 1.1em;
  border-radius:12px;
  white-space:pre;
  overflow:hidden;
  max-width:100%;
  box-sizing:border-box;
  color:transparent;
  background-clip:text;
  -webkit-background-clip:text;
  background-image:linear-gradient(
    118deg,
    #FF6B6B  0%,
    #FF8C42 20%,
    #FFCF48 40%,
    #FFFFFF 55%,
    #FFCF48 70%,
    #FF8C42 85%,
    #FF6B6B 100%
  );
">β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•— β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•— β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•— β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•— β–ˆβ–ˆβ–ˆβ•—   β–ˆβ–ˆβ–ˆβ•—
β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•—β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•—β–ˆβ–ˆβ•”β•β•β•β•β•β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•—β–ˆβ–ˆβ–ˆβ–ˆβ•— β–ˆβ–ˆβ–ˆβ–ˆβ•‘
β–ˆβ–ˆβ•‘  β–ˆβ–ˆβ•‘β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•”β•β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—  β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•‘β–ˆβ–ˆβ•”β–ˆβ–ˆβ–ˆβ–ˆβ•”β–ˆβ–ˆβ•‘
β–ˆβ–ˆβ•‘  β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•—β–ˆβ–ˆβ•”β•β•β•  β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘β•šβ–ˆβ–ˆβ•”β•β–ˆβ–ˆβ•‘
β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•”β•β–ˆβ–ˆβ•‘  β–ˆβ–ˆβ•‘β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–ˆβ–ˆβ•‘  β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘ β•šβ•β• β–ˆβ–ˆβ•‘
β•šβ•β•β•β•β•β• β•šβ•β•  β•šβ•β•β•šβ•β•β•β•β•β•β•β•šβ•β•  β•šβ•β•β•šβ•β•     β•šβ•β•

β–ˆβ–ˆβ–ˆβ•—   β–ˆβ–ˆβ–ˆβ•— β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—  β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–ˆβ–ˆβ•—  β–ˆβ–ˆβ•—β–ˆβ–ˆβ•—β–ˆβ–ˆβ–ˆβ•—   β–ˆβ–ˆβ•—β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—
β–ˆβ–ˆβ–ˆβ–ˆβ•— β–ˆβ–ˆβ–ˆβ–ˆβ•‘β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•—β–ˆβ–ˆβ•”β•β•β•β•β•β–ˆβ–ˆβ•‘  β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘β–ˆβ–ˆβ–ˆβ–ˆβ•—  β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•”β•β•β•β•β•
β–ˆβ–ˆβ•”β–ˆβ–ˆβ–ˆβ–ˆβ•”β–ˆβ–ˆβ•‘β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘     β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•”β–ˆβ–ˆβ•— β–ˆβ–ˆβ•‘β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—
β–ˆβ–ˆβ•‘β•šβ–ˆβ–ˆβ•”β•β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘     β–ˆβ–ˆβ•”β•β•β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘β•šβ–ˆβ–ˆβ•—β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•”β•β•β•
β–ˆβ–ˆβ•‘ β•šβ•β• β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘  β–ˆβ–ˆβ•‘β•šβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—β–ˆβ–ˆβ•‘  β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘β–ˆβ–ˆβ•‘ β•šβ–ˆβ–ˆβ–ˆβ–ˆβ•‘β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ•—
β•šβ•β•     β•šβ•β•β•šβ•β•  β•šβ•β• β•šβ•β•β•β•β•β•β•šβ•β•  β•šβ•β•β•šβ•β•β•šβ•β•  β•šβ•β•β•β•β•šβ•β•β•β•β•β•β•</pre>
</div>

<div align="center">

<p style="font-size:1.6em;font-weight:900;letter-spacing:0.04em;margin:0.2em 0 0.1em;">
  ✨ DreamMachine Research ✨
</p>

<p style="font-size:1.05em;font-weight:500;color:#aaa;margin:0 0 1em;">
  Billion-Item Neural Recommendation Β· Industrial AI Β· Open Research
</p>

[![Model](https://img.shields.io/badge/πŸ€—%20Model-Dream--Machine--08--09-FF8C42?style=for-the-badge)](https://huggingface.co/dream-machine-ai/Dream-Machine-08-09)
[![Dataset](https://img.shields.io/badge/πŸ€—%20Dataset-Dream--Machine--08--09--Dataset-FFCF48?style=for-the-badge&labelColor=555)](https://huggingface.co/datasets/dream-machine-ai/Dream-Machine-08-09-Dataset)
[![Space](https://img.shields.io/badge/🌟%20Space-DreamMachine--AI-3b82f6?style=for-the-badge)](https://huggingface.co/spaces/dream-machine-ai/)
[![Paper](https://img.shields.io/badge/πŸ“„%20Paper-Zenodo%2021906715-8b5cf6?style=for-the-badge)](https://doi.org/10.5281/zenodo.21906715)
[![GitHub](https://img.shields.io/badge/πŸ’»%20GitHub-Dream--Machine-24292e?style=for-the-badge&logo=github)](https://github.com/When-Summer-Understands-Winter/Dream-Machine/)
[![License](https://img.shields.io/badge/License-CC%20BY--NC%204.0-ed6c02?style=for-the-badge&logo=creativecommons&logoColor=white)](https://creativecommons.org/licenses/by-nc/4.0/)

<br/>

> *"We build the magic shop β€” the AI that knows exactly what you want before you do."*

**[πŸ€— Models](#-models)** &nbsp;Β·&nbsp;
**[πŸ“¦ Datasets](#-datasets)** &nbsp;Β·&nbsp;
**[🌟 Spaces](#-spaces)** &nbsp;·&nbsp;
**[πŸ“„ Research](#-research)** &nbsp;Β·&nbsp;
**[βš–οΈ License](#️-license)**

</div>

---

## ✦ Our Mission

```
  ╔══════════════════════════════════════════════════════════════════════╗
  β•‘  ✦ 10¹⁰-item scale  β€” recommend from billion-item catalogues       β•‘
  β•‘  ✦ Open research    β€” weights, data, code, paper all public        β•‘
  β•‘  ✦ Reproducible     β€” every result in the paper can be verified    β•‘
  β•‘  ✦ Production-grade β€” from laptop to 250 Γ— A100 cluster unchanged  β•‘
  β•‘  ✦ Community-first  β€” CC BY-NC 4.0, free for academic use         β•‘
  β•šβ•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•β•
```

> **Note on repository location:** All models, datasets, and Spaces are published under the
> **[dream-machine-ai](https://huggingface.co/dream-machine-ai)** account namespace.
> This organization page (`DreamMachine-AI`) serves as the team portal and research hub.
> Follow **[dream-machine-ai](https://huggingface.co/dream-machine-ai)** to get notified of new releases.

---

## πŸ€— Models

### [Dream-Machine-08-09](https://huggingface.co/dream-machine-ai/Dream-Machine-08-09)

> **Billion-Item Neural Recommendation Sorcerer** β€” Multi-Hash Transformer Dual-Tower with RAG-Enhanced Recall

| Property | Value |
|:---------|:------|
| Architecture | Dual-Tower Transformer (Item + User) |
| Scale | Up to 10¹⁰ items, 10¹⁰ users |
| Embedding | Multi-Hash K=3, B=50K buckets |
| Layers | L=2 Transformer, H=8 heads, d=128 |
| Retrieval | FAISS HNSW, ≀ 100 ms P99 |
| **AUC** | **0.4849** Β· HR@10 **1.0** Β· NDCG@10 **0.537** |
| Format | `safetensors` Β· `transformers`-compatible |

```python
from transformers import AutoModel
model = AutoModel.from_pretrained(
    "dream-machine-ai/Dream-Machine-08-09", trust_remote_code=True
).eval()
```

**[β†’ View Model Card](https://huggingface.co/dream-machine-ai/Dream-Machine-08-09)**

---

## πŸ“¦ Datasets

### [Dream-Machine-08-09-Dataset](https://huggingface.co/datasets/dream-machine-ai/Dream-Machine-08-09-Dataset)

> **E-Commerce Synthetic Dataset** β€” JD / Taobao schema, fully reproducible, zero real PII

| Split | Records | Format | Description |
|:------|--------:|:------:|:------------|
| `products` | 1,000 | JSONL | SKU catalogue β€” price, brand, category, attributes |
| `users` | 1,000 | JSONL | User profiles β€” demographics, interests, spending |
| `behaviors` | 5,000 | JSONL | Click / purchase / rating events |

```python
from datasets import load_dataset
products = load_dataset(
    "dream-machine-ai/Dream-Machine-08-09-Dataset",
    name="products", split="train"
)
```

**[β†’ View Dataset Card](https://huggingface.co/datasets/dream-machine-ai/Dream-Machine-08-09-Dataset)**

---

## 🌟 Spaces

### [dream-machine-ai / README](https://huggingface.co/spaces/dream-machine-ai/README)

Interactive landing page β€” no installation required.  
Explore the model architecture, scaling law charts, and end-to-end deployment guide.

**[β†’ Open Space](https://huggingface.co/spaces/dream-machine-ai/)**

---

## πŸ“„ Research

### DreamMachine: A Billion-Item Neural Recommendation Sorcerer

> Wen, Fangjun Β· DreamMachine Research Team Β· August 2026  
> DOI: [10.5281/zenodo.21906715](https://doi.org/10.5281/zenodo.21906715)

**Seven original contributions:**

| # | Contribution | Key Formula |
|:-:|:-------------|:------------|
| C1 | Multi-Hash Transformer Dual-Tower | Ξ΅_eff = (1 βˆ’ e^{βˆ’N/2B})^K |
| C2 | Hierarchical Feature Architecture | ID β†’ sparse β†’ dense numeric |
| C3 | RAG-Enhanced Multi-Channel Recall | FAISS IVF-PQ + CF + rules |
| C4 | Cross-Attention Listwise Re-ranker | CTR / CVR / dwell-time |
| C5 | Uncertainty-Weighted InfoNCE | Learnable Οƒ_kΒ² per task |
| C6 | Closed-Form Scaling Laws | 9 breakpoints 10Β² β†’ 10¹⁰ |
| C7 | Production Serving Stack | FastAPI + ONNX + INT8 |

```bibtex
@techreport{wen2026dreammachine,
  title       = {Magic Shop at Scale: Dream-Machine --- A Billion-Item
                 Real-Time Neural Recommendation Sorcerer},
  author      = {Wen, Fangjun},
  year        = {2026},
  institution = {DreamMachine Research Team},
  doi         = {10.5281/zenodo.21906715},
  url         = {https://doi.org/10.5281/zenodo.21906715},
  note        = {Technical Report, August 2026. arXiv cs.IR / cs.LG}
}
```

---

## πŸš€ Quick Start

```bash
pip install transformers torch faiss-cpu huggingface_hub datasets
```

```python
# 1. Load model
from transformers import AutoModel, AutoFeatureExtractor
model = AutoModel.from_pretrained(
    "dream-machine-ai/Dream-Machine-08-09", trust_remote_code=True
).eval()

# 2. Load dataset
from datasets import load_dataset
ds = load_dataset("dream-machine-ai/Dream-Machine-08-09-Dataset",
                  name="products", split="train")

# 3. Start inference server
# git clone https://huggingface.co/dream-machine-ai/Dream-Machine-08-09
# python serve_hf.py --model_dir ./hf_model --port 8000
```

---

## πŸ”— All Resources

| Resource | Link |
|:---------|:-----|
| πŸ€— **Model** | [dream-machine-ai/Dream-Machine-08-09](https://huggingface.co/dream-machine-ai/Dream-Machine-08-09) |
| πŸ“¦ **Dataset** | [dream-machine-ai/Dream-Machine-08-09-Dataset](https://huggingface.co/datasets/dream-machine-ai/Dream-Machine-08-09-Dataset) |
| 🌟 **Space** | [spaces/dream-machine-ai](https://huggingface.co/spaces/dream-machine-ai/) |
| 🏒 **Org** | [huggingface.co/DreamMachine-AI](https://huggingface.co/DreamMachine-AI) |
| πŸ“„ **Paper** | [Zenodo 10.5281/zenodo.21906715](https://doi.org/10.5281/zenodo.21906715) |
| πŸ’» **GitHub** | [When-Summer-Understands-Winter/Dream-Machine](https://github.com/When-Summer-Understands-Winter/Dream-Machine/) |

---

## βš–οΈ License

All models, datasets, and code published by DreamMachine Research are licensed under the
**Creative Commons Attribution-NonCommercial 4.0 International License (CC BY-NC 4.0)**.

| βœ… Permitted | ❌ Prohibited |
|:---|:---|
| Academic research & publication | Commercial products or services |
| Personal learning & experimentation | Revenue-generating deployments |
| Non-commercial derivative works | Sublicensing for profit |
| Citing in papers with attribution | Any business use without written permission |

> **Commercial use of any kind β€” including integrating model weights, code, or outputs into a product or service β€” requires explicit prior written consent from the author (Fangjun Wen).**  
> Contact: fangjunwen168@outlook.com

[![License: CC BY-NC 4.0](https://img.shields.io/badge/License-CC%20BY--NC%204.0-ed6c02?style=for-the-badge&logo=creativecommons&logoColor=white)](https://creativecommons.org/licenses/by-nc/4.0/)

---

<div align="center">

<p style="font-size:1.05em;font-weight:700;margin:0.5em 0 0.3em;">
  πŸ€— <a href="https://huggingface.co/dream-machine-ai/Dream-Machine-08-09">Model</a> &nbsp;Β·&nbsp;
  πŸ“¦ <a href="https://huggingface.co/datasets/dream-machine-ai/Dream-Machine-08-09-Dataset">Dataset</a> &nbsp;Β·&nbsp;
  🌟 <a href="https://huggingface.co/spaces/dream-machine-ai/">Space</a> &nbsp;·&nbsp;
  πŸ“„ <a href="https://doi.org/10.5281/zenodo.21906715">Paper</a> &nbsp;Β·&nbsp;
  πŸ’» <a href="https://github.com/When-Summer-Understands-Winter/Dream-Machine/">GitHub</a>
</p>

**DreamMachine Research Team** Β· Fangjun Wen Β· August 2026

`// built with focus Β· DreamMachine Research`

</div>