Commit
·
71acd6e
1
Parent(s):
bbebd05
Update index.html
Browse files- index.html +31 -18
index.html
CHANGED
|
@@ -13,35 +13,48 @@
|
|
| 13 |
<p>
|
| 14 |
This is a demo of MLTest on the dataset
|
| 15 |
<a href="https://huggingface.co/datasets/marmal88/skin_cancer"><code>marmal88/skin_cancer</code></a>.
|
|
|
|
| 16 |
</p>
|
| 17 |
<p>
|
| 18 |
The model has been trained on five models: two variants of Swin Transformers, ViT, ResNet, and BEiT. The test results for each model can
|
| 19 |
be inspected in the dashboard below.
|
| 20 |
</p>
|
| 21 |
<p>
|
| 22 |
-
<b>Performance tests</b>:
|
|
|
|
|
|
|
| 23 |
</p>
|
| 24 |
<p>
|
| 25 |
-
<b>Failure clusters</b>:
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
</p>
|
| 27 |
<p>
|
| 28 |
-
<b>Robustness</b>:
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
|
|
|
|
| 45 |
The full list of transforms supported by MLTest can be found in the <a href="https://docs.lakera.ai/configuration/robustness">documentation</a>.
|
| 46 |
</p>
|
| 47 |
<p>
|
|
|
|
| 13 |
<p>
|
| 14 |
This is a demo of MLTest on the dataset
|
| 15 |
<a href="https://huggingface.co/datasets/marmal88/skin_cancer"><code>marmal88/skin_cancer</code></a>.
|
| 16 |
+
Each image is labeled with one of three different kinds of cancers.
|
| 17 |
</p>
|
| 18 |
<p>
|
| 19 |
The model has been trained on five models: two variants of Swin Transformers, ViT, ResNet, and BEiT. The test results for each model can
|
| 20 |
be inspected in the dashboard below.
|
| 21 |
</p>
|
| 22 |
<p>
|
| 23 |
+
<b>Performance tests</b>:
|
| 24 |
+
in order to measure how well the model performs, we compute common performance metrics like accuracy,
|
| 25 |
+
precision, recall, F1 score, and more.
|
| 26 |
</p>
|
| 27 |
<p>
|
| 28 |
+
<b>Failure clusters</b>:
|
| 29 |
+
these clusters give meaningful insights when the model is failing and can be inspected in the "Failure Clusters" tab.
|
| 30 |
+
These failure clusters are automatically detected
|
| 31 |
+
for different combinations of metadata.
|
| 32 |
+
For example, the BEiT transformer has a significantly lower accuracy on images taken of cancers of the back with class label <code>0</code>.
|
| 33 |
</p>
|
| 34 |
<p>
|
| 35 |
+
<b>Robustness</b>: these tests help ML developers evaluate how well their model performs under different conditions.
|
| 36 |
+
These conditions could include different levels of brightness, compression, and many other types of interference.
|
| 37 |
+
</p><p>
|
| 38 |
+
The following robustness tests were enabled for this test case:
|
| 39 |
+
</p>
|
| 40 |
+
<ul>
|
| 41 |
+
<li>kind: Brightness</li>
|
| 42 |
+
<li>kind: CompressImage</li>
|
| 43 |
+
<li>kind: Contrast</li>
|
| 44 |
+
<li>kind: DarkSpots</li>
|
| 45 |
+
<li>kind: GaussianBlur</li>
|
| 46 |
+
<li>kind: GaussianNoise</li>
|
| 47 |
+
<li>kind: Glare</li>
|
| 48 |
+
<li>kind: GlassBlur</li>
|
| 49 |
+
<li>kind: HorizontalFlip</li>
|
| 50 |
+
<li>kind: MedianBlur</li>
|
| 51 |
+
<li>kind: MotionBlur</li>
|
| 52 |
+
<li>kind: OilSpots</li>
|
| 53 |
+
<li>kind: Perspective</li>
|
| 54 |
+
<li>kind: VerticalFlip</li>
|
| 55 |
+
</ul>
|
| 56 |
|
| 57 |
+
<p>
|
| 58 |
The full list of transforms supported by MLTest can be found in the <a href="https://docs.lakera.ai/configuration/robustness">documentation</a>.
|
| 59 |
</p>
|
| 60 |
<p>
|