| --- |
| tags: [backup] |
| --- |
| |
| # vgp_misc_tar |
|
|
| Backup of `../.hf_stage/misc` from the `video_gen_physics` workspace. The tree has too many |
| small files to commit individually (the Hub allows 128 commits/hour/repo), so it is |
| stored as **independent tar shards** of ~8GB under |
| `shards/`. Files too large to bundle are stored verbatim under `large/`. |
| `manifest.txt` lists how many files each shard holds. |
|
|
| Paths inside every tar are relative to `../.hf_stage/misc`, so extract all shards into one |
| directory that plays the role of `../.hf_stage/misc`. |
|
|
| Excluded: `__pycache__`, `*.pyc`, `.git`, `.venv*`, `.cache/huggingface`, `.env`, |
| symlinks. Credentials found in text files were redacted before upload. |
|
|
| ## Restore |
|
|
| ```bash |
| hf download doanh25032004/vgp_misc_tar --repo-type model --local-dir ./dl |
| DEST=./misc; mkdir -p "$DEST" |
| for t in ./dl/shards/*.tar; do tar -xf "$t" -C "$DEST"; done |
| [ -d ./dl/large ] && cp -a ./dl/large/. "$DEST"/ |
| ``` |
|
|
