Buckets:

Pranav2748's picture
download
raw
891 Bytes
set -u
cd /workspace/decision-reasoner && source .venv/bin/activate
B=hf://buckets/Mercity/Desicion-Model-Custom
t() { echo "$(date -u +%T) $*"; }
t code; hf buckets sync /tmp/claude-0/-workspace/8842c99f-448c-4cba-80ab-3e9c26b892df/scratchpad/bucket_code $B/code --quiet
t run1-results; hf buckets sync results $B/run1/results --exclude "predictions/*.raw.jsonl" --quiet
t run1-data; hf buckets sync data $B/run1/data --exclude "raw/*" --quiet
t run1-logs; hf buckets sync logs $B/run1/logs --exclude "v2_*" --quiet
t run2-logs; hf buckets sync logs $B/run2_v2/logs --include "v2_*" --exclude "*" --quiet
t run2-data; hf buckets sync runs/v2/data $B/run2_v2/data --exclude "raw/*" --quiet
for c in joint_merged gold_only_merged votes_only_merged; do t "ckpt $c"; hf buckets sync /root/offload_checkpoints/$c $B/run1/checkpoints/$c --quiet; done
t DONE

Xet Storage Details

Size:
891 Bytes
·
Xet hash:
111eb0f256f489a59fbd721451a48c31f00f54c1cd828a07b7ea4572faec70f4

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.