vishnudaspk commited on
Commit
cc6b71d
·
verified ·
1 Parent(s): 31527b6

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +302 -0
README.md ADDED
@@ -0,0 +1,302 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ pipeline_tag: image-to-image
6
+ library_name: pytorch
7
+
8
+ tags:
9
+ - medical-imaging
10
+ - computer-vision
11
+ - pytorch
12
+ - pix2pix
13
+ - image-enhancement
14
+ - laparoscopy
15
+ - surgical-smoke-removal
16
+ - defogging
17
+ - gan
18
+ - deep-learning
19
+ - opencv
20
+ - healthcare-ai
21
+
22
+ datasets:
23
+ - custom
24
+
25
+ metrics:
26
+ - psnr
27
+ - ssim
28
+ ---
29
+
30
+ # Laparoscopy Image Defogging AI
31
+
32
+ An AI-powered laparoscopic image enhancement system designed to remove fog, haze, and surgical smoke from minimally invasive surgical imagery using deep learning and image restoration techniques.
33
+
34
+ This repository contains pretrained Pix2Pix UNet-256 generator weights for real-time laparoscopic image defogging and enhancement.
35
+
36
+ ---
37
+
38
+ # Model Details
39
+
40
+ ## Model Description
41
+
42
+ This model is designed to improve the visual clarity of laparoscopic surgical images by removing:
43
+ - Lens fogging
44
+ - Surgical smoke
45
+ - Haze
46
+ - Low contrast artifacts
47
+
48
+ The system combines:
49
+ - Pix2Pix GAN image translation
50
+ - Dark Channel Prior (DCP)
51
+ - Guided filtering
52
+ - CLAHE enhancement
53
+ - Contrast restoration
54
+ - Sharpening and post-processing
55
+
56
+ The model aims to enhance visibility in minimally invasive surgical environments for research and educational applications.
57
+
58
+ ---
59
+
60
+ - **Developed by:** Vishnu Das
61
+ - **Model type:** Pix2Pix GAN / UNet-256 Generator
62
+ - **Framework:** PyTorch
63
+ - **Language(s):** English
64
+ - **License:** MIT
65
+ - **Task:** Image-to-Image Translation / Medical Image Enhancement
66
+
67
+ ---
68
+
69
+ # Model Sources
70
+
71
+ - **Repository:** https://github.com/YOUR_GITHUB_USERNAME/YOUR_REPOSITORY_NAME
72
+ - **Model Repository:** https://huggingface.co/vishnudaspk/Laparoscopy-Image-Defogging-AI
73
+
74
+ ---
75
+
76
+ # Uses
77
+
78
+ ## Direct Use
79
+
80
+ This model can be used for:
81
+ - Laparoscopic image enhancement
82
+ - Surgical smoke removal
83
+ - Fog removal
84
+ - Medical imaging research
85
+ - Computer vision experimentation
86
+ - Deep learning demonstrations
87
+
88
+ ---
89
+
90
+ ## Downstream Use
91
+
92
+ Possible downstream applications:
93
+ - Real-time surgical visualization systems
94
+ - AI-assisted medical imaging pipelines
95
+ - Surgical simulation environments
96
+ - Medical video enhancement workflows
97
+
98
+ ---
99
+
100
+ ## Out-of-Scope Use
101
+
102
+ This model is NOT intended for:
103
+ - Clinical diagnosis
104
+ - Real surgical deployment
105
+ - Medical decision-making
106
+ - Autonomous healthcare systems
107
+
108
+ Outputs should always be reviewed by qualified professionals.
109
+
110
+ ---
111
+
112
+ # Bias, Risks, and Limitations
113
+
114
+ - Performance depends heavily on image quality and training distribution.
115
+ - The model may produce artifacts under severe smoke or lighting conditions.
116
+ - Results may vary across different laparoscopic devices and environments.
117
+ - This system is intended for research and educational purposes only.
118
+
119
+ ---
120
+
121
+ # Recommendations
122
+
123
+ Users should:
124
+ - Validate outputs before use
125
+ - Avoid clinical reliance
126
+ - Test across multiple datasets
127
+ - Use CUDA-enabled GPUs for best performance
128
+
129
+ ---
130
+
131
+ # How to Get Started with the Model
132
+
133
+ ## Installation
134
+
135
+ ```bash
136
+ pip install -r requirements.txt
137
+ ```
138
+
139
+ Recommended:
140
+
141
+ * NVIDIA GPU
142
+ * CUDA-enabled PyTorch
143
+
144
+ ---
145
+
146
+ ## Place Model Weights
147
+
148
+ Place:
149
+
150
+ ```text
151
+ best_net_G.pth
152
+ ```
153
+
154
+ inside:
155
+
156
+ ```text
157
+ scripts/checkpoints/pix2pix_laparoscopy_dc/
158
+ ```
159
+
160
+ ---
161
+
162
+ ## Run Application
163
+
164
+ ```bash
165
+ python app.py
166
+ ```
167
+
168
+ Open:
169
+
170
+ ```text
171
+ http://127.0.0.1:5000
172
+ ```
173
+
174
+ ---
175
+
176
+ # Training Details
177
+
178
+ ## Training Data
179
+
180
+ The model was trained on custom laparoscopic imagery containing varying levels of:
181
+
182
+ * Surgical smoke
183
+ * Fogging
184
+ * Low visibility
185
+ * Illumination artifacts
186
+
187
+ Data preprocessing included:
188
+
189
+ * Resizing
190
+ * Contrast normalization
191
+ * Paired image generation
192
+
193
+ ---
194
+
195
+ ## Training Procedure
196
+
197
+ ### Preprocessing
198
+
199
+ * Image normalization
200
+ * CLAHE enhancement
201
+ * Resizing
202
+ * Data augmentation
203
+
204
+ ---
205
+
206
+ ### Training Hyperparameters
207
+
208
+ * **Architecture:** Pix2Pix UNet-256
209
+ * **Framework:** PyTorch
210
+ * **Training regime:** Mixed precision CUDA training
211
+ * **Loss Functions:** GAN Loss + L1 Loss
212
+
213
+ ---
214
+
215
+ # Evaluation
216
+
217
+ ## Testing Data, Factors & Metrics
218
+
219
+ ### Testing Data
220
+
221
+ Custom laparoscopic test imagery.
222
+
223
+ ---
224
+
225
+ ### Metrics
226
+
227
+ Evaluation metrics include:
228
+
229
+ * PSNR
230
+ * SSIM
231
+ * Visual perceptual quality
232
+
233
+ ---
234
+
235
+ # Results
236
+
237
+ The model demonstrated:
238
+
239
+ * Improved image clarity
240
+ * Reduced haze and smoke artifacts
241
+ * Enhanced contrast and edge visibility
242
+
243
+ ---
244
+
245
+ # Environmental Impact
246
+
247
+ Training performed on:
248
+
249
+ * **Hardware Type:** NVIDIA RTX 4060 GPU
250
+ * **Framework:** PyTorch CUDA
251
+
252
+ ---
253
+
254
+ # Technical Specifications
255
+
256
+ ## Model Architecture and Objective
257
+
258
+ * Pix2Pix GAN
259
+ * UNet-256 Generator
260
+ * Image-to-image translation objective
261
+
262
+ ---
263
+
264
+ ## Compute Infrastructure
265
+
266
+ ### Hardware
267
+
268
+ * NVIDIA RTX 4060 Laptop GPU
269
+
270
+ ### Software
271
+
272
+ * Python
273
+ * PyTorch
274
+ * OpenCV
275
+ * NumPy
276
+ * Flask
277
+
278
+ ---
279
+
280
+ # Citation
281
+
282
+ If you use this project in research or educational work, please cite the repository appropriately.
283
+
284
+ ---
285
+
286
+ # More Information
287
+
288
+ This project was developed as a deep learning and medical imaging research initiative focused on improving surgical visualization quality using AI-powered enhancement techniques.
289
+
290
+ ---
291
+
292
+ # Model Card Authors
293
+
294
+ Vishnu Das
295
+
296
+ ---
297
+
298
+ # Model Card Contact
299
+
300
+ For questions or collaboration:
301
+
302
+ * GitHub: [https://github.com/YOUR_GITHUB_USERNAME](https://github.com/YOUR_GITHUB_USERNAME)