|
|
--- |
|
|
title: Transformer Explainability Evaluation Tool |
|
|
emoji: 🏆 |
|
|
colorFrom: pink |
|
|
colorTo: yellow |
|
|
sdk: docker |
|
|
pinned: false |
|
|
short_description: Perturbation Test for ViT Explainability methods |
|
|
--- |
|
|
|
|
|
Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference |
|
|
|
|
|
|
|
|
# How to run backend |
|
|
|
|
|
# backend |
|
|
python flask_backend.py --port 5001 |
|
|
|
|
|
|
|
|
|
|
|
# frontend |
|
|
go to frontenf folder |
|
|
npm install |
|
|
npm run dev |
|
|
|
|
|
## Model Information |
|
|
|
|
|
| model_id | available? | backbone only? | has registers? | input_image_resolution | patch_size | finetuned_head_path | |
|
|
|----------|------------|----------------|-----------------|----------------------|------------|---------------------| |
|
|
| vit_base_patch8_224 | ☐ | ☐ | ☐ | 224 | 8 | - | |
|
|
| vit_base_patch16_224.augreg2_in21k_ft_in1k | ☑ | ☐ | ☐ | 224 | 16 | - | |
|
|
| vit_base_patch16_224 | ☐ | ☑ | ☐ | 224 | 16 | - | |
|
|
| vit_large_patch16_rope_224 | ☐ | ☐ | ☐ | 224 | 16 | - | |
|
|
| vit_huge_patch16_224 | ☐ | ☐ | ☐ | 224 | 16 | - | |
|
|
| vit_large_patch14_224 | ☐ | ☑ | ☐ | 224 | 14 | - | |
|
|
| vit_huge_patch14_224 | ☐ | ☑ | ☐ | 224 | 14 | - | |
|
|
| deit3_small_patch16_224.fb_in22k_ft_in1k | ☑ | ☐ | ☐ | 224 | 16 | - | |
|
|
| deit3_base_patch16_224.fb_in22k_ft_in1k | ☑ | ☑ | ☐ | 224 | 16 | - | |
|
|
| deit3_medium_patch16_224.fb_in22k_ft_in1k | ☑ | ☐ | ☐ | 224 | 16 | - | |
|
|
| deit3_large_patch16_224.fb_in22k_ft_in1k | ☐ | ☐ | ☐ | 224 | 16 | - | |
|
|
| deit3_small_patch16_384.fb_in22k_ft_in1k | ☐ | ☐ | ☐ | 384 | 16 | - | |
|
|
| deit3_base_patch16_384.fb_in22k_ft_in1k | ☐ | ☐ | ☐ | 384 | 16 | - | |
|
|
| deit3_large_patch16_384.fb_in22k_ft_in1k | ☐ | ☐ | ☐ | 384 | 16 | - | |
|
|
| vit_small_patch14_dinov2 | ☐ | ☐ | ☐ | 518 | 14 | - | |
|
|
| vit_base_patch14_dinov2 | ☑ | ☑ | ☐ | 518 | 14 | vit_base_patch14_dinov2_in1k_best.pth | |
|
|
| vit_small_patch14_reg4_dinov2 | ☐ | ☐ | ☑ | 518 | 14 | - | |
|
|
| vit_base_patch14_reg4_dinov2 | ☑ | ☑ | ☑ | 518 | 14 | vit_base_patch14_reg4_dinov2_head_finetuned_best.pth | |
|
|
| vit_base_patch16_dinov3_in1k | ☐ | ☐ | ☐ | 518 | 16 | - | |
|
|
| vit_base_patch16_dinov3 | ☑ | ☑ | ☐ | 518 | 16 | vit_base_patch16_dinov3_in1k_best_20_epochs.pth | |
|
|
| vit_base_patch16_dinov3_qkvb | ☐ | ☐ | ☐ | 518 | 16 | - | |
|
|
|
|
|
|
|
|
# TODO: |
|
|
- add multiple pytorch models support |
|
|
- use timm library |
|
|
- choose model from the dropdown list |
|
|
- View clicked image full screen to view finer details |
|
|
|
|
|
UI Fixes |
|
|
+ add inverse mask |
|
|
+ change the brush size |
|
|
+ add reset mask |
|
|
+ need to pasrse the pertubed image and get the explainability map |
|
|
+ host on hugging face hub |
|
|
>>>>>>> ced0342 (Prepare for Hugging Face Deployment) |
