SudharsanSundar commited on
Commit
3e21791
·
verified ·
1 Parent(s): 037e797

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ {}
3
+ ---
4
+ # Model Details
5
+ - **Architecture**: Basic/default GPT-2, decoder only
6
+ - **Num params**: ~810M
7
+ - **Num tokens seen**: ~2 B
8
+ - **Dataset**: PubMed Abstracts subset of The Pile