Update README.md
Browse files
README.md
CHANGED
|
@@ -313,14 +313,31 @@ CUDA_VISIBLE_DEVICES=0 python run_qa.py \
|
|
| 313 |
We conduct Neural Architecture Search (NAS) on the ResNet architecture using the ImageNet dataset. You can run the following command:
|
| 314 |
|
| 315 |
```train
|
| 316 |
-
cd neural-architecture-search
|
| 317 |
|
| 318 |
torchrun --nproc_per_node=4 train.py\
|
| 319 |
-
|
| 320 |
-
|
| 321 |
-
|
| 322 |
-
|
| 323 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 324 |
```
|
| 325 |
|
| 326 |
## Evaluation
|
|
@@ -412,10 +429,15 @@ For Network Architecture Search, please run the following command to evaluate o
|
|
| 412 |
|
| 413 |
cd neural-architecture-search
|
| 414 |
|
| 415 |
-
# Required: Download our ResNet-
|
| 416 |
torchrun --nproc_per_node=4 train.py\
|
| 417 |
-
|
| 418 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 419 |
```
|
| 420 |
|
| 421 |
|
|
|
|
| 313 |
We conduct Neural Architecture Search (NAS) on the ResNet architecture using the ImageNet dataset. You can run the following command:
|
| 314 |
|
| 315 |
```train
|
| 316 |
+
cd ../neural-architecture-search
|
| 317 |
|
| 318 |
torchrun --nproc_per_node=4 train.py\
|
| 319 |
+
--data-path /home/cs/Documents/datasets/imagenet\
|
| 320 |
+
--model resnet18 --output-dir resnet18 --weights ResNet18_Weights.IMAGENET1K_V1\
|
| 321 |
+
--batch-size 128 --epochs 10 --lr 0.0004 --lr-step-size 2 --lr-gamma 0.5\
|
| 322 |
+
--lr-warmup-method constant --lr-warmup-epochs 1 --lr-warmup-decay 0.\
|
| 323 |
+
--apply-trp --trp-depths 3 3 3 --trp-planes 256 --trp-lambdas 0.4 0.2 0.1 --print-freq 100
|
| 324 |
+
|
| 325 |
+
# ✅ Test: Acc@1 73.900 Acc@5 91.536
|
| 326 |
+
torchrun --nproc_per_node=4 train.py\
|
| 327 |
+
--data-path /home/cs/Documents/datasets/imagenet\
|
| 328 |
+
--model resnet34 --output-dir resnet34 --weights ResNet34_Weights.IMAGENET1K_V1\
|
| 329 |
+
--batch-size 96 --epochs 10 --lr 0.0004 --lr-step-size 2 --lr-gamma 0.5\
|
| 330 |
+
--lr-warmup-method constant --lr-warmup-epochs 1 --lr-warmup-decay 0.\
|
| 331 |
+
--apply-trp --trp-depths 2 2 2 --trp-planes 256 --trp-lambdas 0.4 0.2 0.1 --print-freq 100
|
| 332 |
+
|
| 333 |
+
|
| 334 |
+
# ✅ Test: Acc@1 76.896 Acc@5 93.136
|
| 335 |
+
torchrun --nproc_per_node=4 train.py\
|
| 336 |
+
--data-path /home/cs/Documents/datasets/imagenet\
|
| 337 |
+
--model resnet50 --output-dir resnet50 --weights ResNet50_Weights.IMAGENET1K_V1\
|
| 338 |
+
--batch-size 64 --epochs 10 --lr 0.0004 --lr-step-size 2 --lr-gamma 0.5\
|
| 339 |
+
--lr-warmup-method constant --lr-warmup-epochs 1 --lr-warmup-decay 0.\
|
| 340 |
+
--apply-trp --trp-depths 1 1 1 --trp-planes 1024 --trp-lambdas 0.4 0.2 0.1 --print-freq 100
|
| 341 |
```
|
| 342 |
|
| 343 |
## Evaluation
|
|
|
|
| 429 |
|
| 430 |
cd neural-architecture-search
|
| 431 |
|
| 432 |
+
# Required: Download our ResNet-34 weights to /path/to/neural-architecture-search/resnet34
|
| 433 |
torchrun --nproc_per_node=4 train.py\
|
| 434 |
+
--data-path /home/cs/Documents/datasets/imagenet\
|
| 435 |
+
--model resnet34 --resume resnet34/model_8.pth --test-only
|
| 436 |
+
|
| 437 |
+
# Required: Download our ResNet-50 weights to /path/to/neural-architecture-search/resnet50
|
| 438 |
+
torchrun --nproc_per_node=4 train.py\
|
| 439 |
+
--data-path /home/cs/Documents/datasets/imagenet\
|
| 440 |
+
--model resnet50 --resume resnet50/model_9.pth --test-only
|
| 441 |
```
|
| 442 |
|
| 443 |
|