Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
yhx12
/
LatentLoop
Like
1
Text Generation
PyTorch
Safetensors
HuggingFaceFW/fineweb-edu
English
latentloop
mixture-of-experts
looped-transformer
pretrained
arxiv:
2610.19975
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
LatentLoop
/
model
41 kB
Ctrl+K
Ctrl+K
1 contributor
History:
1 commit
yhx12
Release LatentLoop 1.3B/40B, 3B/70B and 7B/140B checkpoints
ae9d09b
verified
2 days ago
__init__.py
89 Bytes
Release LatentLoop 1.3B/40B, 3B/70B and 7B/140B checkpoints
2 days ago
config.py
3.65 kB
Release LatentLoop 1.3B/40B, 3B/70B and 7B/140B checkpoints
2 days ago
data.py
5.55 kB
Release LatentLoop 1.3B/40B, 3B/70B and 7B/140B checkpoints
2 days ago
fused_cross_entropy.py
2.7 kB
Release LatentLoop 1.3B/40B, 3B/70B and 7B/140B checkpoints
2 days ago
fused_rotary_embedding.py
2.87 kB
Release LatentLoop 1.3B/40B, 3B/70B and 7B/140B checkpoints
2 days ago
fused_swiglu.py
917 Bytes
Release LatentLoop 1.3B/40B, 3B/70B and 7B/140B checkpoints
2 days ago
latent.py
2.95 kB
Release LatentLoop 1.3B/40B, 3B/70B and 7B/140B checkpoints
2 days ago
model.py
13.6 kB
Release LatentLoop 1.3B/40B, 3B/70B and 7B/140B checkpoints
2 days ago
moe.py
5.59 kB
Release LatentLoop 1.3B/40B, 3B/70B and 7B/140B checkpoints
2 days ago
rmsnorm.py
3.09 kB
Release LatentLoop 1.3B/40B, 3B/70B and 7B/140B checkpoints
2 days ago
