msrewa commited on
Commit
0e692f3
·
verified ·
1 Parent(s): bc43715

List the normal retrieval index files

Browse files
Files changed (1) hide show
  1. README.md +4 -1
README.md CHANGED
@@ -63,6 +63,9 @@ The retrieval head (Stages 1–2) is a separate model of about 2 M trained param
63
  |---|---:|---|
64
  | `personadrive_icl_sft/checkpoints/epoch=000.ckpt/pytorch_model.pt` | 1.96 GB | **The model.** A single-file PyTorch state dict; load it for evaluation. |
65
  | `personadrive_icl_sft/.hydra/config.yaml` | 2 KB | The training config. The agent builds the model from it and finds `.hydra/` by walking up from the checkpoint path. |
 
 
 
66
 
67
  `pytorch_model.pt` was consolidated from the run's DeepSpeed ZeRO-2 checkpoint (`last.ckpt`). It contains only tensors, so it also loads with `torch.load(..., weights_only=True)`.
68
 
@@ -104,7 +107,7 @@ bash scripts/eval/test_one_lb1_route.sh
104
  - **Style:** set `PERSONADRIVE_ICL_PROFILE` to `fast` (aggressive), `default` (neutral, normal driving), `slow` (conservative) or `normal` (no style; the index built from SimLingo's PDM-lite data). `PERSONADRIVE_NUM_ICL=0` turns retrieval off.
105
  - **Retrieval data:** retrieval needs three things:
106
  - the retrieval head, included in the [code repository](https://github.com/PervasiveAutonomyLab/PersonaDrive);
107
- - the FAISS indices under `persona_drive_rag/`, built as in [Build the retrieval indices](https://github.com/PervasiveAutonomyLab/PersonaDrive#3-build-the-retrieval-indices);
108
  - the camera frames those indices point to.
109
 
110
  The repository's [`datasets/README.md`](https://github.com/PervasiveAutonomyLab/PersonaDrive/blob/main/datasets/README.md) lists which archives to get for each style. Retrieved frames whose image is missing are skipped. If none can be loaded, the model runs without retrieval.
 
63
  |---|---:|---|
64
  | `personadrive_icl_sft/checkpoints/epoch=000.ckpt/pytorch_model.pt` | 1.96 GB | **The model.** A single-file PyTorch state dict; load it for evaluation. |
65
  | `personadrive_icl_sft/.hydra/config.yaml` | 2 KB | The training config. The agent builds the model from it and finds `.hydra/` by walking up from the checkpoint path. |
66
+ | `retrieval/normal/driving_index.faiss` | 221 MB | Vectors of the `normal` (no-style) retrieval index: 54,040 frames of the SimLingo dataset, embedded with the released retrieval head. |
67
+ | `retrieval/normal/frames.json.gz` | 1 MB | The frames those vectors belong to. The SimLingo data itself is not included; `scripts/retrieval/fill_normal_index.py` in the code repository completes the index from your SimLingo download. |
68
+ | `retrieval/normal/driving_index.info.json` | < 1 KB | Index type and size. |
69
 
70
  `pytorch_model.pt` was consolidated from the run's DeepSpeed ZeRO-2 checkpoint (`last.ckpt`). It contains only tensors, so it also loads with `torch.load(..., weights_only=True)`.
71
 
 
107
  - **Style:** set `PERSONADRIVE_ICL_PROFILE` to `fast` (aggressive), `default` (neutral, normal driving), `slow` (conservative) or `normal` (no style; the index built from SimLingo's PDM-lite data). `PERSONADRIVE_NUM_ICL=0` turns retrieval off.
108
  - **Retrieval data:** retrieval needs three things:
109
  - the retrieval head, included in the [code repository](https://github.com/PervasiveAutonomyLab/PersonaDrive);
110
+ - the FAISS indices under `persona_drive_rag/`, built as in [Build the retrieval indices](https://github.com/PervasiveAutonomyLab/PersonaDrive#3-build-the-retrieval-indices) (the `normal` index is completed from `retrieval/normal/` in this repository);
111
  - the camera frames those indices point to.
112
 
113
  The repository's [`datasets/README.md`](https://github.com/PervasiveAutonomyLab/PersonaDrive/blob/main/datasets/README.md) lists which archives to get for each style. Retrieved frames whose image is missing are skipped. If none can be loaded, the model runs without retrieval.