Add model card for ELF

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +56 -0
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: text-generation
4
+ ---
5
+
6
+ # ELF: Embedded Language Flows
7
+
8
+ Embedded Language Flows (ELF) is a class of continuous diffusion language models based on continuous-time Flow Matching. Unlike existing diffusion language models (DLMs), ELF predominantly stays within the continuous embedding space until the final time step, where it maps to discrete tokens using a shared-weight network. This formulation makes it straightforward to adapt established techniques from image-domain diffusion models, such as classifier-free guidance (CFG).
9
+
10
+ - **Paper:** [ELF: Embedded Language Flows](https://huggingface.co/papers/2605.10938)
11
+ - **Repository:** [https://github.com/lillian039/ELF](https://github.com/lillian039/ELF)
12
+
13
+ ## Description
14
+
15
+ Experiments show that ELF substantially outperforms leading discrete and continuous DLMs, achieving better generation quality with fewer sampling steps. These results suggest that ELF offers a promising path toward effective continuous DLMs.
16
+
17
+ ## Usage
18
+
19
+ To use these models, please follow the installation instructions in the [official repository](https://github.com/lillian039/ELF).
20
+
21
+ ### Inference and Evaluation
22
+
23
+ You can run evaluation for unconditional generation (e.g., using ELF-B) with the following command:
24
+
25
+ ```bash
26
+ cd src/
27
+
28
+ python eval.py \
29
+ --config configs/training_configs/train_owt_ELF-B.yml \
30
+ --checkpoint_path embedded-language-flows/ELF-B-owt
31
+ ```
32
+
33
+ For conditional tasks like translation or summarization, use the corresponding configuration files:
34
+
35
+ ```bash
36
+ # XSum (summarization)
37
+ python eval.py \
38
+ --config configs/training_configs/train_xsum_ELF-B.yml \
39
+ --checkpoint_path embedded-language-flows/ELF-B-xsum
40
+
41
+ # WMT14 De-En (translation)
42
+ python eval.py \
43
+ --config configs/training_configs/train_de-en_ELF-B.yml \
44
+ --checkpoint_path embedded-language-flows/ELF-B-de-en
45
+ ```
46
+
47
+ ## Citation
48
+
49
+ ```bibtex
50
+ @article{elf2026,
51
+ title={ELF: Embedded Language Flows},
52
+ author={Hu, Keya and Qiu, Linlu and Lu, Yiyang and Zhao, Hanhong and Li, Tianhong and Kim, Yoon and Andreas, Jacob and He, Kaiming},
53
+ journal={arXiv preprint arXiv:2605.10938},
54
+ year={2026}
55
+ }
56
+ ```