README
Browse files
README.md
ADDED
|
@@ -0,0 +1,26 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
tags: [backup]
|
| 3 |
+
---
|
| 4 |
+
|
| 5 |
+
# vgp_models_code_tar
|
| 6 |
+
|
| 7 |
+
Backup of `/pfss/mlde/workspaces/mlde_wsp_IAS_SAMMerge/VLA/doanh/video_world/.hf_stage/models_code` from the `video_gen_physics` workspace. The tree has too many
|
| 8 |
+
small files to commit individually (the Hub allows 128 commits/hour/repo), so it is
|
| 9 |
+
stored as **independent tar shards** of ~8GB under
|
| 10 |
+
`shards/`. Files too large to bundle are stored verbatim under `large/`.
|
| 11 |
+
`manifest.txt` lists how many files each shard holds.
|
| 12 |
+
|
| 13 |
+
Paths inside every tar are relative to `/pfss/mlde/workspaces/mlde_wsp_IAS_SAMMerge/VLA/doanh/video_world/.hf_stage/models_code`, so extract all shards into one
|
| 14 |
+
directory that plays the role of `/pfss/mlde/workspaces/mlde_wsp_IAS_SAMMerge/VLA/doanh/video_world/.hf_stage/models_code`.
|
| 15 |
+
|
| 16 |
+
Excluded: `__pycache__`, `*.pyc`, `.git`, `.venv*`, `.cache/huggingface`, `.env`,
|
| 17 |
+
symlinks. Credentials found in text files were redacted before upload.
|
| 18 |
+
|
| 19 |
+
## Restore
|
| 20 |
+
|
| 21 |
+
```bash
|
| 22 |
+
hf download doanh25032004/vgp_models_code_tar --repo-type model --local-dir ./dl
|
| 23 |
+
DEST=./models_code; mkdir -p "$DEST"
|
| 24 |
+
for t in ./dl/shards/*.tar; do tar -xf "$t" -C "$DEST"; done
|
| 25 |
+
[ -d ./dl/large ] && cp -a ./dl/large/. "$DEST"/
|
| 26 |
+
```
|