stzhao's picture
download
raw
1.06 kB
#!/bin/bash
# Extract DINOv2 latent features for the BridgeDataV2 raw split.
# REPO_ROOT is derived from this script's own location, so it works no matter
# which working directory it is invoked from (e.g. via slurm srun).
set -euo pipefail
SCRIPT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")" && pwd)"
REPO_ROOT="$(cd "${SCRIPT_DIR}/../../.." && pwd)"
# forward.py imports `stage1` / `utils` from RAE/src.
export PYTHONPATH="${REPO_ROOT}/RAE/src:${PYTHONPATH:-}"
# Prefer the project venv (torch, decord, ...); fall back to any python3.
PYTHON_BIN="${REPO_ROOT}/.venv/bin/python"
if [[ ! -x "${PYTHON_BIN}" ]]; then
PYTHON_BIN="$(command -v python3)"
fi
exec "${PYTHON_BIN}" "${REPO_ROOT}/data_processing/tools/forward.py" \
--rae-backbone dinov2 \
--device cuda:0 \
--encoder-path /home/sz128/scratch_sz128/models/dinov2-with-registers-base \
--rae-root /home/sz128/scratch_sz128/models/RAE-collections \
--dataset-name bridgedatav2 \
--video-data-dir-path /home/sz128/scratch_sz128/datasets/bridgedatav2_video/data \
--data-split raw

Xet Storage Details

Size:
1.06 kB
·
Xet hash:
53ba0b43b5f6ed186349742bf6bce2acf907517718a29a8c5488b760f25e0f59

Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.