Spaces:

lucalp
/

blt-entropy-patcher

Running on Zero

App Files Files Community

blt-entropy-patcher / bytelatent /args.py

Commit History

Get evals working again. (#46)

7517ac2
unverified

par-meta commited on Mar 11, 2025

Reduce per file resources arrow uses (#77)

63913e4
unverified

par-meta commited on Mar 5, 2025

Add approximate state persistence (#73)

ea1fc75
unverified

par-meta commited on Mar 5, 2025

Remove byte tokenizer and add config args to switch between byte/patch packing (#68)

aeb95f1
unverified

par-meta commited on Feb 25, 2025

Update iterator inheritance, pass file format args, limit iterator (#63)

fc3399e
unverified

par-meta commited on Feb 22, 2025

Make it possible to specify multiple config files (#54)

82ab593
unverified

par-meta commited on Feb 18, 2025

Fix multiprocessing dataloader checkpointing and use it in the train script (#50)

8c61ab5
unverified

par-meta commited on Feb 13, 2025

Allow ArrowIterator to read from json (#45)

936d943
unverified

par-meta commited on Feb 6, 2025

Update checkpointing to use fsspec (#39)

afedb16
unverified

par-meta commited on Feb 6, 2025

This includes fixes that make checkpointing and reloading work correctly. (#35)

7044771
unverified

par-meta commited on Jan 28, 2025

Initial codes and scripts for training entropy model (#34)

7622d28
unverified

par-meta commited on Jan 27, 2025

Use load_async flag to not start MP iterator (#33)

a809259
unverified

par-meta commited on Jan 24, 2025

Changes for training entropy model and correcting attention in local models (#25)

6ffeb66
unverified

par-meta commited on Jan 17, 2025

Replace regular filesystem calls with fsspec + add s3 support (#18)

b0120da
unverified

par-meta commited on Jan 10, 2025

Initial commit

bcc039b

par-meta commited on Dec 12, 2024

Commit History

Get evals working again. (#46) 7517ac2 unverified

Reduce per file resources arrow uses (#77) 63913e4 unverified

Add approximate state persistence (#73) ea1fc75 unverified

Remove byte tokenizer and add config args to switch between byte/patch packing (#68) aeb95f1 unverified

Update iterator inheritance, pass file format args, limit iterator (#63) fc3399e unverified

Make it possible to specify multiple config files (#54) 82ab593 unverified

Fix multiprocessing dataloader checkpointing and use it in the train script (#50) 8c61ab5 unverified

Allow ArrowIterator to read from json (#45) 936d943 unverified

Update checkpointing to use fsspec (#39) afedb16 unverified

This includes fixes that make checkpointing and reloading work correctly. (#35) 7044771 unverified

Initial codes and scripts for training entropy model (#34) 7622d28 unverified

Use load_async flag to not start MP iterator (#33) a809259 unverified

Changes for training entropy model and correcting attention in local models (#25) 6ffeb66 unverified

Replace regular filesystem calls with fsspec + add s3 support (#18) b0120da unverified

Initial commit bcc039b