mstyslavity commited on
Commit
1cef774
·
verified ·
1 Parent(s): 082dca1

A combined monstrosity made up from Roberta, Electra (base) and Deberta, each is "base" (12 hidden layers, d_model = 768), so now there are 36 layers

Files changed (1) hide show
  1. README.md +5 -0
README.md ADDED
@@ -0,0 +1,5 @@
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model:
4
+ - Capreolus/electra-base-msmarco
5
+ ---