Add model card and metadata

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: text-generation
4
+ ---
5
+
6
+ # ELF: Embedded Language Flows
7
+
8
+ ELF is a class of continuous diffusion language models based on continuous-time Flow Matching. Unlike existing diffusion language models (DLMs), ELF predominantly stays within the continuous embedding space until the final time step, where it maps to discrete tokens using a shared-weight network. This formulation makes it straightforward to adapt established techniques from image-domain diffusion models, such as classifier-free guidance (CFG).
9
+
10
+ - **Paper:** [ELF: Embedded Language Flows](https://huggingface.co/papers/2605.10938)
11
+ - **Repository:** [GitHub](https://github.com/lillian039/ELF)
12
+
13
+ ## Evaluation and Inference
14
+
15
+ The official implementation is provided in JAX. To evaluate the pre-trained checkpoints, follow the installation instructions in the [GitHub repository](https://github.com/lillian039/ELF) and use the following commands from the `src/` directory:
16
+
17
+ ### Unconditional Generation (OpenWebText)
18
+ ```bash
19
+ python eval.py \
20
+ --config configs/training_configs/train_owt_ELF-B.yml \
21
+ --checkpoint_path embedded-language-flows/ELF-B-owt
22
+ ```
23
+
24
+ ### Conditional Generation (Summarization/Translation)
25
+ ```bash
26
+ # XSum (summarization)
27
+ python eval.py \
28
+ --config configs/training_configs/train_xsum_ELF-B.yml \
29
+ --checkpoint_path embedded-language-flows/ELF-B-xsum
30
+
31
+ # WMT14 De-En (translation)
32
+ python eval.py \
33
+ --config configs/training_configs/train_de-en_ELF-B.yml \
34
+ --checkpoint_path embedded-language-flows/ELF-B-de-en
35
+ ```
36
+
37
+ ## Citation
38
+
39
+ ```bibtex
40
+ @article{elf2026,
41
+ title={ELF: Embedded Language Flows},
42
+ author={Hu, Keya and Qiu, Linlu and Lu, Yiyang and Zhao, Hanhong and Li, Tianhong and Kim, Yoon and Andreas, Jacob and He, Kaiming},
43
+ journal={arXiv preprint arXiv:2605.10938},
44
+ year={2026}
45
+ }
46
+ ```