MikelWL commited on
Commit
f67f345
·
verified ·
1 Parent(s): e6e13e1

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +65 -3
README.md CHANGED
@@ -1,3 +1,65 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # ICAR Weights (OpenCLIP ViT-L-14, LAION-2B)
2
+
3
+ This repository provides ICAR fine-tuned OpenCLIP ViT-L-14 (LAION-2B) weights,
4
+ including early-exit variants, used in the paper "Image Complexity-Aware Adaptive
5
+ Retrieval for Efficient Vision-Language Models".
6
+
7
+ Paper: https://arxiv.org/abs/2512.15372
8
+ Code: https://github.com/MikelWL/ICAR
9
+
10
+ These weights are intended to be used with the ICAR codebase. The standard
11
+ retrieval setting reported in the paper evaluates COCO/Flickr test queries
12
+ against a gallery augmented with 100k LAION-COCO distractors.
13
+
14
+ ## Contents
15
+
16
+ All weights are stored under the `checkpoints/` directory to match the ICAR
17
+ codebase layout.
18
+
19
+ ### Baselines (full path)
20
+
21
+ - `checkpoints/baseline_coco/latest_checkpoint.pt`
22
+ - `checkpoints/baseline_flickr/latest_checkpoint.pt`
23
+
24
+ ### Early-exit variants (ICAR)
25
+
26
+ - `checkpoints/icar_coco/layer_8/latest_checkpoint.pt`
27
+ - `checkpoints/icar_coco/layer_12/latest_checkpoint.pt`
28
+ - `checkpoints/icar_coco/layer_16/latest_checkpoint.pt`
29
+ - `checkpoints/icar_coco/layer_20/latest_checkpoint.pt`
30
+ - `checkpoints/icar_flickr/layer_8/latest_checkpoint.pt`
31
+ - `checkpoints/icar_flickr/layer_12/latest_checkpoint.pt`
32
+ - `checkpoints/icar_flickr/layer_16/latest_checkpoint.pt`
33
+ - `checkpoints/icar_flickr/layer_20/latest_checkpoint.pt`
34
+
35
+ ## Usage
36
+
37
+ Use the ICAR scripts as the primary entrypoints. See the main repo README for
38
+ reference scripts and required data paths.
39
+
40
+ Example (mixed evaluation):
41
+
42
+ ```bash
43
+ python scripts/evaluate_mixed_preprocessed.py \
44
+ --config icar/configs/coco.yaml \
45
+ --checkpoint checkpoints/icar_coco/layer_12/latest_checkpoint.pt \
46
+ --base-dataset mscoco \
47
+ --base-data-root /path/to/coco-images \
48
+ --laion-data-root /path/to/laion_coco_100k \
49
+ --complexity-scores /path/to/laion_coco_100k_metadata/complexity_scores.json \
50
+ --early-exit-layer 12 \
51
+ --use-icc-routing \
52
+ --icc-checkpoint /path/to/icc_weights.pt \
53
+ --eval-category
54
+ ```
55
+
56
+ ## ICC Weights
57
+
58
+ ICC (Image Complexity Classifier) weights are hosted separately due to
59
+ non-commercial licensing restrictions on the ImageNet-pretrained ConvNeXt-V2
60
+ checkpoint. Please download ICC weights from the dedicated ICC repository.
61
+
62
+ ## License
63
+
64
+ The ICAR weights in this repository follow the OpenCLIP license (MIT).
65
+ See the OpenCLIP repository for details and attribution requirements.