Update README.md
Browse files
README.md
CHANGED
|
@@ -19,8 +19,8 @@ Beyond Token-Level Cross-Entropy: Fréchet Distributional Post-Training for Auto
|
|
| 19 |
</p>
|
| 20 |
|
| 21 |
<p align="center">
|
| 22 |
-
<a href="https://arxiv.org/abs/
|
| 23 |
-
<img src="https://img.shields.io/badge/arXiv-
|
| 24 |
</a>
|
| 25 |
<a href="https://github.com/CVL-UESTC/FDPT-AR">
|
| 26 |
<img src="https://img.shields.io/github/stars/CVL-UESTC/FDPT-AR?style=social" alt="GitHub stars">
|
|
@@ -83,8 +83,6 @@ bash scripts/download_assets.sh llamagen
|
|
| 83 |
bash scripts/download_assets.sh stats
|
| 84 |
```
|
| 85 |
|
| 86 |
-
Replace `llamagen` with `titok`, `var`, or `gigatok` when needed.
|
| 87 |
-
|
| 88 |
---
|
| 89 |
|
| 90 |
## 🤗 Post-trained Checkpoints
|
|
@@ -125,9 +123,6 @@ using `scripts/download_assets.sh`.
|
|
| 125 |
|
| 126 |
## 🔥 Training
|
| 127 |
|
| 128 |
-
Only the model name, pretrained checkpoint directory, and per-GPU batch size
|
| 129 |
-
need to be specified:
|
| 130 |
-
|
| 131 |
```bash
|
| 132 |
bash scripts/train.sh \
|
| 133 |
--model llamagen-b \
|
|
@@ -155,8 +150,7 @@ Available models and their required checkpoint files are listed below.
|
|
| 155 |
| VAR-d24 | `var-d24` | `var_d24.pth`, `vae_ch160v4096z32.pth` |
|
| 156 |
| GigaTok-B-L | `gigatok-bl` | `GPT_B256_e300_VQ_BL.pt`, `VQ_BL256_e200.pt` |
|
| 157 |
|
| 158 |
-
|
| 159 |
-
`CUDA_VISIBLE_DEVICES` before running the command:
|
| 160 |
|
| 161 |
```bash
|
| 162 |
CUDA_VISIBLE_DEVICES=0,1 bash scripts/train.sh \
|
|
@@ -165,8 +159,6 @@ CUDA_VISIBLE_DEVICES=0,1 bash scripts/train.sh \
|
|
| 165 |
--bs 8
|
| 166 |
```
|
| 167 |
|
| 168 |
-
Here, `--bs` denotes the batch size on each GPU.
|
| 169 |
-
|
| 170 |
---
|
| 171 |
|
| 172 |
## 🖼️ Sampling
|
|
@@ -234,4 +226,4 @@ Upstream-derived files retain their original licenses. See
|
|
| 234 |
|
| 235 |
For questions or collaborations, please contact
|
| 236 |
[Jinhua Zhang](mailto:jinhua.zjh@gmail.com) or
|
| 237 |
-
[Yisong Lin](mailto:yisongl164@gmail.com).
|
|
|
|
| 19 |
</p>
|
| 20 |
|
| 21 |
<p align="center">
|
| 22 |
+
<a href="https://arxiv.org/abs/2505.12742v3">
|
| 23 |
+
<img src="https://img.shields.io/badge/arXiv-2505.12742-b31b1b.svg" alt="arXiv">
|
| 24 |
</a>
|
| 25 |
<a href="https://github.com/CVL-UESTC/FDPT-AR">
|
| 26 |
<img src="https://img.shields.io/github/stars/CVL-UESTC/FDPT-AR?style=social" alt="GitHub stars">
|
|
|
|
| 83 |
bash scripts/download_assets.sh stats
|
| 84 |
```
|
| 85 |
|
|
|
|
|
|
|
| 86 |
---
|
| 87 |
|
| 88 |
## 🤗 Post-trained Checkpoints
|
|
|
|
| 123 |
|
| 124 |
## 🔥 Training
|
| 125 |
|
|
|
|
|
|
|
|
|
|
| 126 |
```bash
|
| 127 |
bash scripts/train.sh \
|
| 128 |
--model llamagen-b \
|
|
|
|
| 150 |
| VAR-d24 | `var-d24` | `var_d24.pth`, `vae_ch160v4096z32.pth` |
|
| 151 |
| GigaTok-B-L | `gigatok-bl` | `GPT_B256_e300_VQ_BL.pt`, `VQ_BL256_e200.pt` |
|
| 152 |
|
| 153 |
+
To select specific GPUs, set `CUDA_VISIBLE_DEVICES` before running the command:
|
|
|
|
| 154 |
|
| 155 |
```bash
|
| 156 |
CUDA_VISIBLE_DEVICES=0,1 bash scripts/train.sh \
|
|
|
|
| 159 |
--bs 8
|
| 160 |
```
|
| 161 |
|
|
|
|
|
|
|
| 162 |
---
|
| 163 |
|
| 164 |
## 🖼️ Sampling
|
|
|
|
| 226 |
|
| 227 |
For questions or collaborations, please contact
|
| 228 |
[Jinhua Zhang](mailto:jinhua.zjh@gmail.com) or
|
| 229 |
+
[Yisong Lin](mailto:yisongl164@gmail.com).
|