SudharsanSundar commited on
Commit
fee9cea
·
verified ·
1 Parent(s): 3e2e2d8

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -0
README.md ADDED
@@ -0,0 +1,8 @@
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ {}
3
+ ---
4
+ # Model Details
5
+ - **Architecture**: Basic/default GPT-2, decoder only
6
+ - **Num params**: ~204M
7
+ - **Num tokens seen**: ~1.3 B
8
+ - **Dataset**: USPTO subset of The Pile