List the normal retrieval index files
Browse files
README.md
CHANGED
|
@@ -63,6 +63,9 @@ The retrieval head (Stages 1–2) is a separate model of about 2 M trained param
|
|
| 63 |
|---|---:|---|
|
| 64 |
| `personadrive_icl_sft/checkpoints/epoch=000.ckpt/pytorch_model.pt` | 1.96 GB | **The model.** A single-file PyTorch state dict; load it for evaluation. |
|
| 65 |
| `personadrive_icl_sft/.hydra/config.yaml` | 2 KB | The training config. The agent builds the model from it and finds `.hydra/` by walking up from the checkpoint path. |
|
|
|
|
|
|
|
|
|
|
| 66 |
|
| 67 |
`pytorch_model.pt` was consolidated from the run's DeepSpeed ZeRO-2 checkpoint (`last.ckpt`). It contains only tensors, so it also loads with `torch.load(..., weights_only=True)`.
|
| 68 |
|
|
@@ -104,7 +107,7 @@ bash scripts/eval/test_one_lb1_route.sh
|
|
| 104 |
- **Style:** set `PERSONADRIVE_ICL_PROFILE` to `fast` (aggressive), `default` (neutral, normal driving), `slow` (conservative) or `normal` (no style; the index built from SimLingo's PDM-lite data). `PERSONADRIVE_NUM_ICL=0` turns retrieval off.
|
| 105 |
- **Retrieval data:** retrieval needs three things:
|
| 106 |
- the retrieval head, included in the [code repository](https://github.com/PervasiveAutonomyLab/PersonaDrive);
|
| 107 |
-
- the FAISS indices under `persona_drive_rag/`, built as in [Build the retrieval indices](https://github.com/PervasiveAutonomyLab/PersonaDrive#3-build-the-retrieval-indices);
|
| 108 |
- the camera frames those indices point to.
|
| 109 |
|
| 110 |
The repository's [`datasets/README.md`](https://github.com/PervasiveAutonomyLab/PersonaDrive/blob/main/datasets/README.md) lists which archives to get for each style. Retrieved frames whose image is missing are skipped. If none can be loaded, the model runs without retrieval.
|
|
|
|
| 63 |
|---|---:|---|
|
| 64 |
| `personadrive_icl_sft/checkpoints/epoch=000.ckpt/pytorch_model.pt` | 1.96 GB | **The model.** A single-file PyTorch state dict; load it for evaluation. |
|
| 65 |
| `personadrive_icl_sft/.hydra/config.yaml` | 2 KB | The training config. The agent builds the model from it and finds `.hydra/` by walking up from the checkpoint path. |
|
| 66 |
+
| `retrieval/normal/driving_index.faiss` | 221 MB | Vectors of the `normal` (no-style) retrieval index: 54,040 frames of the SimLingo dataset, embedded with the released retrieval head. |
|
| 67 |
+
| `retrieval/normal/frames.json.gz` | 1 MB | The frames those vectors belong to. The SimLingo data itself is not included; `scripts/retrieval/fill_normal_index.py` in the code repository completes the index from your SimLingo download. |
|
| 68 |
+
| `retrieval/normal/driving_index.info.json` | < 1 KB | Index type and size. |
|
| 69 |
|
| 70 |
`pytorch_model.pt` was consolidated from the run's DeepSpeed ZeRO-2 checkpoint (`last.ckpt`). It contains only tensors, so it also loads with `torch.load(..., weights_only=True)`.
|
| 71 |
|
|
|
|
| 107 |
- **Style:** set `PERSONADRIVE_ICL_PROFILE` to `fast` (aggressive), `default` (neutral, normal driving), `slow` (conservative) or `normal` (no style; the index built from SimLingo's PDM-lite data). `PERSONADRIVE_NUM_ICL=0` turns retrieval off.
|
| 108 |
- **Retrieval data:** retrieval needs three things:
|
| 109 |
- the retrieval head, included in the [code repository](https://github.com/PervasiveAutonomyLab/PersonaDrive);
|
| 110 |
+
- the FAISS indices under `persona_drive_rag/`, built as in [Build the retrieval indices](https://github.com/PervasiveAutonomyLab/PersonaDrive#3-build-the-retrieval-indices) (the `normal` index is completed from `retrieval/normal/` in this repository);
|
| 111 |
- the camera frames those indices point to.
|
| 112 |
|
| 113 |
The repository's [`datasets/README.md`](https://github.com/PervasiveAutonomyLab/PersonaDrive/blob/main/datasets/README.md) lists which archives to get for each style. Retrieved frames whose image is missing are skipped. If none can be loaded, the model runs without retrieval.
|