Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
XiangPan
/
L12_K32_1B_OpenWebText2_16384_steps3052
like
0
Transformers
PyTorch
arxiv:
1910.09700
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
L12_K32_1B_OpenWebText2_16384_steps3052
/
config.json
XiangPan
Upload TopK
c47ddda
verified
9 months ago
raw
Copy download link
history
blame
contribute
delete
Safe
60 Bytes
{
"hidden_size"
:
2048
,
"latent_size"
:
16384
,
"k"
:
32
}