This includes fixes that make checkpointing and reloading work correctly. (#35) 7044771 unverified par-meta commited on Jan 28, 2025
Initial codes and scripts for training entropy model (#34) 7622d28 unverified par-meta commited on Jan 27, 2025
Use load_async flag to not start MP iterator (#33) a809259 unverified par-meta commited on Jan 24, 2025
Changes for training entropy model and correcting attention in local models (#25) 6ffeb66 unverified par-meta commited on Jan 17, 2025
Replace regular filesystem calls with fsspec + add s3 support (#18) b0120da unverified par-meta commited on Jan 10, 2025