Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
lucalp
/
blt-entropy-patcher
like
8
Running
on
Zero
App
Files
Files
Community
1
Fetching metadata from the HF Docker repository...
f3e8125
blt-entropy-patcher
/
bytelatent
411 kB
12 contributors
History:
25 commits
Srinivasan Iyer
using apex rmsnorm (#57)
f3e8125
unverified
10 months ago
configs
This includes fixes that make checkpointing and reloading work correctly. (#35)
11 months ago
data
Fix multiprocessing dataloader checkpointing and use it in the train script (#50)
10 months ago
model
using apex rmsnorm (#57)
10 months ago
plotting
Add plotting code from paper (#17)
11 months ago
preprocess
Allow ArrowIterator to read from json (#45)
10 months ago
tokenizers
Initial commit
about 1 year ago
.DS_Store
Safe
6.15 kB
Initial commit
about 1 year ago
__init__.py
Safe
96 Bytes
Initial commit
about 1 year ago
args.py
12 kB
Fix multiprocessing dataloader checkpointing and use it in the train script (#50)
10 months ago
base_transformer.py
19.8 kB
using apex rmsnorm (#57)
10 months ago
checkpoint.py
11.1 kB
Update checkpointing to use fsspec (#39)
10 months ago
constants.py
Safe
141 Bytes
Initial commit
about 1 year ago
distributed.py
16.2 kB
Add bpb and n_bytes to metric logging (#41)
10 months ago
entropy_model.py
1.41 kB
Changes for training entropy model and correcting attention in local models (#25)
11 months ago
eval.py
8.97 kB
This includes fixes that make checkpointing and reloading work correctly. (#35)
11 months ago
float8.py
Safe
4.89 kB
Initial commit
about 1 year ago
generate.py
17.1 kB
This includes fixes that make checkpointing and reloading work correctly. (#35)
11 months ago
logger.py
Safe
4.44 kB
Update checkpointing to use fsspec (#39)
10 months ago
metrics.py
7.11 kB
Add bpb and n_bytes to metric logging (#41)
10 months ago
norms.py
Safe
4.34 kB
Fix distributed all reduce grad norm (#40)
10 months ago
optim.py
Safe
4.61 kB
Initial commit
about 1 year ago
probe.py
Safe
24 kB
Initial commit
about 1 year ago
profiling.py
Safe
4.4 kB
Initial commit
about 1 year ago
stool.py
7.41 kB
Allow ArrowIterator to read from json (#45)
10 months ago
test_blt.py
Safe
16.3 kB
Initial codes and scripts for training entropy model (#34)
11 months ago
test_entropy_model.py
Safe
2.03 kB
Test first batch matches (#53)
10 months ago
train.py
32.5 kB
Fix multiprocessing dataloader checkpointing and use it in the train script (#50)
10 months ago
transformer.py
7.46 kB
using apex rmsnorm (#57)
10 months ago
