Fix HF Docker build: auto-generate requirements.txt from pyproject.toml

Fix codebase issues: linting, types, tests, and security.

Refactor: Improve code quality, security, and configuration

refactor: major repository cleanup and bug fixes