chore: codebase audit and fixes (ruff, mypy, pytest)

Fix codebase issues: linting, types, tests, and security.

refactor: major repository cleanup and bug fixes