Update README.md
Browse files
README.md
CHANGED
|
@@ -11,13 +11,7 @@ AdaLoRA-QAT is an efficient, compact foundation model variant designed for accur
|
|
| 11 |
|
| 12 |
### Model Description
|
| 13 |
|
| 14 |
-
AdaLoRA-QAT introduces a two-stage fine-tuning framework for medical image segmentation. Stage 1 utilizes Adaptive Low-Rank Adaptation (AdaLoRA) to dynamically allocate rank capacity to task-relevant transformer layers in full precision. Stage 2 implements full-model quantization-aware fine-tuning (QAT) using a selective mixed-precision strategy, achieving INT8 precision for select layers while preserving fine structural fidelity.
|
| 15 |
-
|
| 16 |
-
- **Developed by:** Prantik Deb, Srimanth Dhondy, N. Ramakrishna, Anu Kapoor, Raju S. Bapi, Tapabrata Chakraborti.
|
| 17 |
-
- **Funded by:** IHub-Data, International Institute of Information Technology Hyderabad. Tapabrata Chakraborti is supported by the Turing-Roche Strategic Partnership and the UCL NIHR Biomedical Research Center.
|
| 18 |
-
- **Model type:** Parameter-Efficient Fine-Tuned (PEFT) Foundation Model for Chest X-ray Segmentation.
|
| 19 |
-
- **License:** MIT License
|
| 20 |
-
- **Finetuned from model:** Segment Anything Model (SAM).
|
| 21 |
|
| 22 |
### Model Sources
|
| 23 |
|
|
@@ -47,12 +41,6 @@ python -u inference/inference.py \
|
|
| 47 |
--save_overlay ./overlay
|
| 48 |
```
|
| 49 |
|
| 50 |
-
## Bias, Risks, and Limitations
|
| 51 |
-
|
| 52 |
-
* Robust generalization across deep learning models remains challenging due to anatomical variability.
|
| 53 |
-
* Generalization is also challenged by pathological distortions and imaging artifacts.
|
| 54 |
-
* The Structural Similarity Index (SSIM) map indicates minor degradations primarily associated with severe motion artifacts or extreme pathologies.
|
| 55 |
-
|
| 56 |
## Training Details
|
| 57 |
|
| 58 |
### Training Data
|
|
|
|
| 11 |
|
| 12 |
### Model Description
|
| 13 |
|
| 14 |
+
AdaLoRA-QAT introduces a two-stage fine-tuning framework for medical image segmentation. Stage 1 utilizes Adaptive Low-Rank Adaptation (AdaLoRA) to dynamically allocate rank capacity to task-relevant transformer layers in full precision. Stage 2 implements full-model quantization-aware fine-tuning (QAT) using a selective mixed-precision strategy, achieving INT8 precision for select layers while preserving fine structural fidelity.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
|
| 16 |
### Model Sources
|
| 17 |
|
|
|
|
| 41 |
--save_overlay ./overlay
|
| 42 |
```
|
| 43 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
## Training Details
|
| 45 |
|
| 46 |
### Training Data
|