makiisthebes commited on
Commit
50f4c90
·
verified ·
1 Parent(s): 5357119

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +59 -0
README.md CHANGED
@@ -1,3 +1,62 @@
1
  ---
2
  license: mit
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
+ datasets:
4
+ - cifar10
5
+ language:
6
+ - en
7
+ pipeline_tag: image-classification
8
  ---
9
+ # BERT Based Image Classifier
10
+
11
+ <!-- Provide a quick summary of what the model is/does. -->
12
+ This model takes inputs from CIFAR10 dataset, convert them into patches embeddings, with positional information along with Class Token to Transformer, the first representation of last hidden state is used to input of the MLP head which is a classifier.
13
+
14
+ A full complete architect has been given for your understanding, which shows the dimensions and different operations that occur.
15
+ BERT model consists of multiple hidden layers (encoder blocks) which are used.
16
+
17
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/6319030647a84df2a5dd106c/wCHOhmRD0URoTWKEhUvcJ.png)
18
+
19
+
20
+ ## Model Details
21
+
22
+ ### Model Description
23
+
24
+ For greator understanding of how such transformer can be used instead of Convolutions or RNNs in order to classify images, by obtaining a useful representation similar to CNN convolutions and the feature maps produced by them alternative methods.
25
+
26
+
27
+
28
+ - **Developed by:** Michael Peres
29
+ - **Model type:** BERT + MLP Classifier Head
30
+ - **Language(s) (NLP):** Michael
31
+
32
+ ### Model Sources
33
+
34
+ <!-- Provide the basic links for the model. -->
35
+ - **Paper:** https://arxiv.org/abs/1810.04805
36
+
37
+ ## Uses
38
+
39
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
40
+ Classifying images based on CIFAR10 dataset
41
+ Achieved model accuracy of 80%.
42
+
43
+
44
+
45
+ ## How to Get Started with the Model
46
+
47
+ Run the model defined in the python script file.
48
+
49
+ ## Environmental Impact
50
+
51
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
52
+
53
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
54
+
55
+ - **Hardware Type:** NVIDIA A100 80GB PCIe
56
+ - **Hours used:** 05hrs
57
+
58
+
59
+ ## Model Card Contact
60
+
61
+ - michaelperes1@gmail.com
62
+ - ec20433@qmul.ac.uk