- Modify the directory structure in the Dockerfile to change `/home/user/downloads` to `/home/user/download` and update the script paths accordingly.
- Update the file paths in the development and usage documentation to ensure consistency.
- Change the default port of the WebDAV service from 7860 to 8081 to avoid potential port conflicts.
Updated the log directory structure to change all log paths from `/home/user/logs` to `/home/user/log` to simplify file management. Also update related scripts and configuration files to reflect this change.
- Add a new perform_restic_restore function to docker-entrypoint.sh to perform restic data recovery before service startup.
- Added check_backup_service_conflicts function to check for backup service conflicts to ensure that persistence and restic services cannot be enabled at the same time.
- Update the USAGE.md documentation to add the RESTIC_ENABLED configuration item and emphasize the restriction that persistence and restic services cannot be enabled at the same time.
Enhanced dataset upload and rebuild logic to ensure datasets exist and are private before uploading. Updated relevant API calls to create private datasets.
- Remove LFS cleanup related settings from the configuration file.
- Rename and refactor the `manage_archives` method to `check_and_cleanup_before_upload` to check the archive file count and perform the necessary cleanup before upload.
- Updated scripts to invoke new cleanup logic before upload to ensure more efficient archive management.
Adding Hugging Face data persistence tool and related configurations
- Add rules file to define writing requirements for project code and documentation.
- Add LFS storage cleanup configuration option in the configuration file.
- Added Python scripts to implement Hugging Face data persistence features, including uploading, managing, and restoring archived files.
- Updated Shell scripts to call new Python modules to streamline archive processing.
Enhance persistence configuration and scripts for Hugging Face integration
- Updated Dockerfile to create additional directories for caching and downloads.
- Modified persistence.conf to adjust sync interval and exclude patterns.
- Improved persistence-start.sh to set up Hugging Face cache directory.
- Refined persistence.sh for better error handling and configuration management.
- Added initial backup delay and improved archive handling in scripts.