a12354's picture
Add files using upload-large-folder tool
7d22995 verified
|
Raw
History Blame Contribute Delete
2.33 kB

RATs40K Adapter for ChatTime

This folder adapts ChatTime to the RATs40K univariate anomaly QA task.

It intentionally uses the numeric Observation field only. It does not use FigurePath, so the resulting baseline should be compared with numeric-only Time-RA settings rather than VLM image-input settings.

Required inputs

  • MODEL_PATH: local ChatTime model directory. This is required by default.
  • PYTHON_BIN: Python executable. The shell scripts default to /dev/shm/suiqk/conda_envs/scalerag-ts-v4/bin/python.
  • DATA_PATH: defaults to /mnt/share01/sqk/datasets/RATs40K/RATs-Uni-TSImage_Reason.json.

The scripts do not download HuggingFace weights unless ALLOW_HF_DOWNLOAD=1 is set explicitly.

The default precision is FP16 because the configured four-GPU machine uses Tesla V100 GPUs. SFT defaults to regular FP16 LoRA with LOAD_IN_4BIT=0, PER_DEVICE_TRAIN_BATCH_SIZE=1, and GRADIENT_ACCUMULATION_STEPS=16.

Evaluation defaults to EVAL_BATCH_SIZE=4 per GPU. With four GPUs, the maximum global evaluation batch size is 16.

The task prompt is aligned with Time-RA's univariate USER_DETECTION_PROMPT; ChatTime still receives the normalized/discretized series through its native ### Input section. Evaluation checks prompt token lengths and fails instead of truncating. Defaults are MAX_INPUT_TOKENS=3936, MAX_NEW_TOKENS=160, and MAX_SEQ_LENGTH=4096 for SFT.

Zero-shot

cd /mnt/share01/sqk/ChatTime
MODEL_PATH=/mnt/share01/sqk/models/ChatTime-1-7B-Chat \
bash rats40k_adapter/run_zeroshot_4gpu.sh

SFT + Eval

cd /mnt/share01/sqk/ChatTime
MODEL_PATH=/mnt/share01/sqk/models/ChatTime-1-7B-Chat \
bash rats40k_adapter/run_sft_4gpu.sh

Zero-shot Then SFT + Eval

cd /mnt/share01/sqk/ChatTime
bash rats40k_adapter/run_zeroshot_then_sft_4gpu.sh

Saved Results

  • Zero-shot outputs: /mnt/share01/sqk/ChatTime/rats40k_adapter/outputs/pipeline_20260608_175250/zeroshot
  • SFT outputs: /mnt/share01/sqk/ChatTime/rats40k_adapter/outputs/pipeline_20260608_175250/sft

Useful smoke-test knobs:

MAX_TRAIN_SAMPLES=128 MAX_EVAL_SAMPLES=64 bash rats40k_adapter/run_zeroshot_then_sft_4gpu.sh
MAX_TRAIN_SAMPLES=128 MAX_EVAL_SAMPLES=64 bash rats40k_adapter/run_sft_4gpu.sh
MAX_EVAL_SAMPLES=64 bash rats40k_adapter/run_zeroshot_4gpu.sh