File size: 174 Bytes
fee9cea |
1 2 3 4 5 6 7 8 |
---
{}
---
# Model Details
- **Architecture**: Basic/default GPT-2, decoder only
- **Num params**: ~204M
- **Num tokens seen**: ~1.3 B
- **Dataset**: USPTO subset of The Pile |
fee9cea |
1 2 3 4 5 6 7 8 |
---
{}
---
# Model Details
- **Architecture**: Basic/default GPT-2, decoder only
- **Num params**: ~204M
- **Num tokens seen**: ~1.3 B
- **Dataset**: USPTO subset of The Pile |