fix: update code and docstrings to remove the old google referer logic

fix(type hints): use correct import for Python < 3.12 (Fixes #163 )

fix(mcp): make mcp use less tokens by striping useless tags

fix: complete MCP schema validation for remaining bare array types

fix: make MCP get schemas validator-safe

style: docstrings corrections for accuracy

style: Fix all mypy errors and add type hints to untyped function bodies

feat(parser)!: Make all selection return selector objects by default

feat(spiders/fetchers): Adding proxy rotation logic and change retry logic

feat(parser): replacing `tldextract` with `tld` library

build: Add w3lib to deps

feat: Change logger to be flexible enough for the spiders classes

fix(browsers): solve a bug with setting referer on the request level

feat(spiders): Add follow function to the response

docs: shorten docstrings for some functions

fix: remove forgotten unused code

fix: update the cookies type hint for the mcp server

fix: update shell signatures for the autocompletion

refactor(fetchers)!: Replace Camoufox with patchright and many optimizations

fix: use the correct signature for the `stealthy_fetch` shortcut

fix(shell): use correct argument name in signatures

fix(shell): dynamically build the signature of shortcuts after last changes

fix(fetcher): Remove non-keywords arguments

refactor(browser fetchers): Make all the type hints dynamic + Faster validation

refactor(requests): Make all the type hints dynamic

feat(TextHandler): Add argument to `clean` method to remove html entities

feat(fetcher): Make `impersonate` able to randomize fingerprint

refactor: Making all the codebase acceptable by PyRight

fix: Fixes for the type checking in the main `init` file

style: Removing dead code/docstrings

docs: Update all pages/docstrings to reflect recent changes

refactor: better implementation for the mcp mode

feat: Make mcp able to use http transport

perf: General code restructure to not use more than needed memory

fix(shell): Fixing a bug with content converting

style: Removing dead code/docstrings and correcting type hints

fix(shell): Fix `view` command edge case

fix(shell): Fix parsing curl `--data-raw`

feat(CLI): Make the session classes available in the shell

fix: fixing body issue with cli view command

fix: Fixes to handle the new extra deps group

fix: Fixes for multiple encoding issues (#80 & #81 )

fix(shell): Fix a small typo

refactor: Make all fetchers as an optional dependency group

style: applying the new ruff rules to all files

fix: fix for shell imported by mistake issue (#76)

style: add flags for tests coverage

fix: improve error handling

perf(parser): A lot of optimizations to speed things up

style: remove unused code