fix(spiders): corrections and removal of dead code

style: Fix all mypy errors and add type hints to untyped function bodies

fix(requests): return the cached fingerprint on second call

feat(spiders/requests): Use a reliable method for fingerprint generation

feat(spiders): Add pause/resume system for crawls

feat(spiders): Add logic to detect blocked requests and retry them

feat(spiders system): a prototype of the new spiders system