msrewa commited on
Commit
6297eb5
·
verified ·
1 Parent(s): 3ce9ca5

Link the code repository

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -55,7 +55,7 @@ This checkpoint is Stage 3 of the PersonaDrive pipeline (in-context fine-tuning)
55
  | Retrieved context points | K = 2 |
56
  | Simulator / benchmark | CARLA 0.9.15 / Bench2Drive |
57
 
58
- The retrieval head (Stages 1–2) is a separate model of about 2 M trained parameters. It is in the code repository: `persona_drive_rag/checkpoints/best_model.pt`.
59
 
60
  ## Files
61
 
@@ -103,11 +103,11 @@ bash scripts/eval/test_one_lb1_route.sh
103
 
104
  - **Style:** set `PERSONADRIVE_ICL_PROFILE` to `fast` (aggressive), `default` (neutral, normal driving), `slow` (conservative) or `normal` (no style; the index built from SimLingo's PDM-lite data). `PERSONADRIVE_NUM_ICL=0` turns retrieval off.
105
  - **Retrieval data:** retrieval needs three things:
106
- - the retrieval head, included in the code repository;
107
- - the FAISS indices under `persona_drive_rag/`;
108
  - the camera frames those indices point to.
109
 
110
- The repository's `datasets/README.md` lists which archives to get for each style. Retrieved frames whose image is missing are skipped. If none can be loaded, the model runs without retrieval.
111
  - **Paper query:** `PERSONADRIVE_LEGACY_ICL_QUERY=1` reproduces the retrieval query used for the paper's results.
112
 
113
  ## Results
@@ -138,7 +138,7 @@ From conservative to aggressive, speed rises by 19.8 % and acceleration by 24.9
138
  Each frame is paired with its K = 2 context points, retrieved from the index of the matching style.
139
  - **Settings:** LoRA on the language model (r 32, α 64, dropout 0.1) with the vision encoder frozen. AdamW at lr 3e-5 (OneCycle, weight decay 0.1); batch 6 per GPU × 4 GPUs with DeepSpeed ZeRO-2 in bf16; 1 epoch.
140
  - **Hardware:** 4× NVIDIA L40S (48 GB), about 12 h.
141
- - **Reproducing the run:** `python simlingo_training/train.py experiment=personadrive_icl_sft` in the code repository. The composed config of this run is `personadrive_icl_sft/.hydra/config.yaml`.
142
 
143
  ## Intended use and limitations
144
 
 
55
  | Retrieved context points | K = 2 |
56
  | Simulator / benchmark | CARLA 0.9.15 / Bench2Drive |
57
 
58
+ The retrieval head (Stages 1–2) is a separate model of about 2 M trained parameters. It is in the code repository: [`persona_drive_rag/checkpoints/best_model.pt`](https://github.com/PervasiveAutonomyLab/PersonaDrive/blob/main/persona_drive_rag/checkpoints/best_model.pt).
59
 
60
  ## Files
61
 
 
103
 
104
  - **Style:** set `PERSONADRIVE_ICL_PROFILE` to `fast` (aggressive), `default` (neutral, normal driving), `slow` (conservative) or `normal` (no style; the index built from SimLingo's PDM-lite data). `PERSONADRIVE_NUM_ICL=0` turns retrieval off.
105
  - **Retrieval data:** retrieval needs three things:
106
+ - the retrieval head, included in the [code repository](https://github.com/PervasiveAutonomyLab/PersonaDrive);
107
+ - the FAISS indices under `persona_drive_rag/`, built as in [Build the retrieval indices](https://github.com/PervasiveAutonomyLab/PersonaDrive#3-build-the-retrieval-indices);
108
  - the camera frames those indices point to.
109
 
110
+ The repository's [`datasets/README.md`](https://github.com/PervasiveAutonomyLab/PersonaDrive/blob/main/datasets/README.md) lists which archives to get for each style. Retrieved frames whose image is missing are skipped. If none can be loaded, the model runs without retrieval.
111
  - **Paper query:** `PERSONADRIVE_LEGACY_ICL_QUERY=1` reproduces the retrieval query used for the paper's results.
112
 
113
  ## Results
 
138
  Each frame is paired with its K = 2 context points, retrieved from the index of the matching style.
139
  - **Settings:** LoRA on the language model (r 32, α 64, dropout 0.1) with the vision encoder frozen. AdamW at lr 3e-5 (OneCycle, weight decay 0.1); batch 6 per GPU × 4 GPUs with DeepSpeed ZeRO-2 in bf16; 1 epoch.
140
  - **Hardware:** 4× NVIDIA L40S (48 GB), about 12 h.
141
+ - **Reproducing the run:** `python simlingo_training/train.py experiment=personadrive_icl_sft` in the [code repository](https://github.com/PervasiveAutonomyLab/PersonaDrive#full-pipeline). The composed config of this run is `personadrive_icl_sft/.hydra/config.yaml`.
142
 
143
  ## Intended use and limitations
144