Update the restic configuration file to shorten the backup interval to 60 seconds and adjust the compression level to maximum to improve the backup efficiency. At the same time, fix the configuration file path in the restic startup script to ensure that the project configuration is loaded correctly.
Add aria2 and webdav configuration template files and update the associated startup scripts to generate configurations from the templates. Modify restic startup scripts to use project configuration templates to simplify configuration management.
Update filebrowser-start.sh script to add environment variable configuration to simplify user customization. Modify the initialization logic for database path, user and port configuration to ensure that detailed configuration information is output at startup.
- Modify the directory structure in the Dockerfile to change `/home/user/downloads` to `/home/user/download` and update the script paths accordingly.
- Update the file paths in the development and usage documentation to ensure consistency.
- Change the default port of the WebDAV service from 7860 to 8081 to avoid potential port conflicts.
Updated the log directory structure to change all log paths from `/home/user/logs` to `/home/user/log` to simplify file management. Also update related scripts and configuration files to reflect this change.
Update the Dockerfile to simplify the directory structure, remove unnecessary file copying steps, and update the documentation to reflect how configuration files are used. Modified the restic startup script to directly reference configuration file paths within containers to ensure clearer logic for configuration file creation and path replacement.
- Update the Dockerfile to keep port 7860 for compatibility with older versions of HuggingFace Spaces.
- Add WebDAV related configuration items and their default values in USAGE.md.
- Added webdav-install.sh script for installing WebDAV (FlyDAV).
- Added webdav-start.sh script to start WebDAV service and load configuration.
- Updated documentation to reflect usage and configuration details of the WebDAV service.
Add restic auto-recovery feature and backup service conflict checking
- Add a new perform_restic_restore function to docker-entrypoint.sh to perform restic data recovery before service startup.
- Added check_backup_service_conflicts function to check for backup service conflicts to ensure that persistence and restic services cannot be enabled at the same time.
- Update the USAGE.md documentation to add the RESTIC_ENABLED configuration item and emphasize the restriction that persistence and restic services cannot be enabled at the same time.
Adding aria2 profile templates and associated startup and installation scripts
- Added aria2 profile template with basic options, RPC options, download options, and more.
- Added prepare-aria2-config.sh script for preparing and generating aria2 configuration.
- A new start-aria2.sh script has been added to start the aria2 service and check port availability.
- A new aria2-install.sh script has been added to install aria2 and its dependencies, and to download the AriaNg Web UI.
- All scripts include logging for debugging and monitoring service status.
Refactoring core service installation and startup scripts
- Removed the creation step for service configuration templates and replaced it with copying the template file from a specified path.
- Updated the creation of startup script templates to simplify the initialization of configuration files.
- Cleaned up unnecessary comments and code to improve the readability and maintainability of scripts.
Enhanced dataset upload and rebuild logic to ensure datasets exist and are private before uploading. Updated relevant API calls to create private datasets.
- Updated logging functions to reflect the installation and startup of core services.
- Remove KodBox related installation steps and replace them with basic dependency installation and configuration templates for core services.
- Add service configuration templates and startup script templates for easy customization of service logic.
- Clean up KodBox-specific directories and configurations that are no longer needed to ensure scripts are generic and extensible.
Remove LFS storage cleanup configuration and refactor pre-upload checking and cleanup logic
- Remove LFS cleanup related settings from the configuration file.
- Rename and refactor the `manage_archives` method to `check_and_cleanup_before_upload` to check the archive file count and perform the necessary cleanup before upload.
- Updated scripts to invoke new cleanup logic before upload to ensure more efficient archive management.
Adding Hugging Face data persistence tool and related configurations
- Add rules file to define writing requirements for project code and documentation.
- Add LFS storage cleanup configuration option in the configuration file.
- Added Python scripts to implement Hugging Face data persistence features, including uploading, managing, and restoring archived files.
- Updated Shell scripts to call new Python modules to streamline archive processing.
Enhance persistence configuration and scripts for Hugging Face integration
- Updated Dockerfile to create additional directories for caching and downloads.
- Modified persistence.conf to adjust sync interval and exclude patterns.
- Improved persistence-start.sh to set up Hugging Face cache directory.
- Refined persistence.sh for better error handling and configuration management.
- Added initial backup delay and improved archive handling in scripts.
