sdtemple commited on
Commit
9f8b5de
·
verified ·
1 Parent(s): 3e638a2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -23,13 +23,13 @@ The model is trained on 2000 examples for each color and shape combo (64,000 sam
23
  The model is tested/evaluated on the dataset [https://huggingface.co/datasets/sdtemple/colored-shapes](https://huggingface.co/datasets/sdtemple/colored-shapes) which has slightly smaller shapes simulated (out of distribution) relative to the training data.
24
 
25
  - Accuracy: 75%
26
- - Min precision (triangle): 56%
27
- - Max precision (rectangle): 89%
28
- - Min recall (diamond): 59%
29
- - Max recall (triangle): 86%
30
- - AUROC (macro-averaged): 91%
31
  - Min AUROC (diamond): 90%
32
- - Max AUROC (circle): 93%
33
 
34
  Compared to [https://huggingface.co/sdtemple/color-prediction-model](https://huggingface.co/sdtemple/color-prediction-model), it is harder to predict the shape than the color of the object.
35
 
 
23
  The model is tested/evaluated on the dataset [https://huggingface.co/datasets/sdtemple/colored-shapes](https://huggingface.co/datasets/sdtemple/colored-shapes) which has slightly smaller shapes simulated (out of distribution) relative to the training data.
24
 
25
  - Accuracy: 75%
26
+ - Min precision (triangle): 57%
27
+ - Max precision (rectangle): 98%
28
+ - Min recall (diamond): 66%
29
+ - Max recall (triangle): 84%
30
+ - AUROC (macro-averaged): 92%
31
  - Min AUROC (diamond): 90%
32
+ - Max AUROC (circle): 94%
33
 
34
  Compared to [https://huggingface.co/sdtemple/color-prediction-model](https://huggingface.co/sdtemple/color-prediction-model), it is harder to predict the shape than the color of the object.
35