fix(checkpoint): correct error message

fix(spiders): corrections and removal of dead code

style(spiders): Lower the default number of concurrent requests

style: Fix all mypy errors and add type hints to untyped function bodies

feat(proxy control): Force a proxy at request level at any given point

fix(requests): return the cached fingerprint on second call

feat(spiders/requests): Use a reliable method for fingerprint generation

feat(spiders): Make graceful shutdown always enabled

fix(spiders): handle errors with manual pause during stream mode

fix(spiders): fix a bug with session stats counter

fix(spiders): Fix for when the pausing system has large queue

feat(spiders): Add pause/resume system for crawls

style(spiders): make parse function abstract

feat(spiders): Change items hook to make it for processing items + add a stat for this

fix(spiders engine): Improve logging

feat(spiders): Add option to logging format and date format

feat: add hook to run after collecting an item

feat(spiders): Add a stream mode to collect items in realtime

feat(spiders): The option to start sessions lazily

style: remove unwanted import from spiders main init file

feat(spiders): add simple export system for the results

fix: make `retry_blocked_request` take the response as well

feat(spiders): Add logic to detect blocked requests and retry them

style(spiders): make the usage of uvloop optional

feat: spiders use uvloop/winloop when available

fix(browsers): Close pages that give error

feat(spiders system): a prototype of the new spiders system