Hugging Face's logo

yarongef
/
DistilProtBert

Fill-Mask
Transformers
PyTorch
bert
protein language model
Model card Files
xet
Community
1
yarongef commited on
Commit
3bb6bbf
·
1 Parent(s): 1710191

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -2
README.md CHANGED
@@ -14,8 +14,7 @@ In addition to cross entropy and cosine teacher-student losses, DistilProtBert w
14
 
15
 
16
  Access to [git](https://github.com/yarongef/DistilProtBert)
17
- # DistilProtBert comparison to ProtBert
18
-
19
  | **Model** | **# of parameters** | **# of hidden layers** | **Pretraining dataset** | **# of proteins** | **Pretraining hardware** |
20
  |:--------------:|:-------------------:|:----------------------:|:-----------------------:|:------------------------------:|:------------------------:|
21
  | ProtBert | 420M | 30 | UniRef100 | 216M | 512 16GB Tpus |
 
14
 
15
 
16
  Access to [git](https://github.com/yarongef/DistilProtBert)
17
+ # Model details
 
18
  | **Model** | **# of parameters** | **# of hidden layers** | **Pretraining dataset** | **# of proteins** | **Pretraining hardware** |
19
  |:--------------:|:-------------------:|:----------------------:|:-----------------------:|:------------------------------:|:------------------------:|
20
  | ProtBert | 420M | 30 | UniRef100 | 216M | 512 16GB Tpus |