Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
redredredredredred
/
slm-from-scratch-phase3-scaling
like
1
Text Generation
PyTorch
Safetensors
Skylion007/openwebtext
English
gpt
from-scratch
nanogpt
language-model
scaling-laws
educational
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
slm-from-scratch-phase3-scaling
1.1 GB
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
redredredredredred
Add Phase 3 scaling-law checkpoints (75M@500M, 75M@2B, 150M@500M)
e5040e3
verified
16 days ago
150m-500m-tokens
Add Phase 3 scaling-law checkpoints (75M@500M, 75M@2B, 150M@500M)
16 days ago
75m-2b-tokens
Add Phase 3 scaling-law checkpoints (75M@500M, 75M@2B, 150M@500M)
16 days ago
75m-500m-tokens
Add Phase 3 scaling-law checkpoints (75M@500M, 75M@2B, 150M@500M)
16 days ago
tokenizer
Add Phase 3 scaling-law checkpoints (75M@500M, 75M@2B, 150M@500M)
16 days ago
.gitattributes
1.52 kB
initial commit
16 days ago
README.md
4.98 kB
Add Phase 3 scaling-law checkpoints (75M@500M, 75M@2B, 150M@500M)
16 days ago
model.py
5.92 kB
Add Phase 3 scaling-law checkpoints (75M@500M, 75M@2B, 150M@500M)
16 days ago
