# Large Latent Extension Launchers

This folder contains the launch scripts for the non-location latent CoT runs.

- `launch_nonlocation_sft.sh`
- `launch_nonlocation_grpo.sh`

These are the scripts used for the distributed multi-GPU non-location curriculum.

Useful environment variables:

- `NUM_COT_TOKENS`
- `STAGE_I`
- `NUM_PROCESSES`
- `GPU_IDS`
- `INIT_ADAPTER_DIR`
- `OUTPUT_DIR`
- `LIMIT_TRAIN_ROWS`
- `WANDB_MODE`
- `WANDB_ENTITY`

Example:

```bash
NUM_COT_TOKENS=3 \
STAGE_I=3 \
NUM_PROCESSES=8 \
GPU_IDS=0,1,2,3,4,5,6,7 \
WANDB_MODE=online \
WANDB_ENTITY=training-dynamics \
bash launch_nonlocation_sft.sh
```