Scrapling / scrapling /engines /static.py

Commit History

fix: update code and docstrings to remove the old google referer logic
a28879b

Karim shoair commited on

style: Fix all mypy errors and add type hints to untyped function bodies
31c2447

Karim shoair commited on

feat(proxy control): Force a proxy at request level at any given point
32daccc

Karim shoair commited on

feat(spiders/fetchers): Adding proxy rotation logic and change retry logic
ed96cdc

Karim shoair commited on

fix: handle a bug with response follow referer flow argument
9b0f6b7

Karim shoair commited on

refactor: internal API changes
bbd0c34

Karim shoair commited on

refactor: internal API changes to be easily used as indicators for spiders
1803348

Karim shoair commited on

docs: fix docstrings for all requests methods
33c6b04

Karim shoair commited on

fix(fetcher): Remove non-keywords arguments
3f07d06

Karim shoair commited on

fix(fetcher): Replace vars logic with one that doesn't require dict attribute
f97abfd

Karim shoair commited on

pref(requests): Optimizing memory by specifiying slots
624e46f

Karim shoair commited on

refactor(requests): Make all the type hints dynamic
a68a70b

Karim shoair commited on

feat(fetcher): Make `impersonate` able to randomize fingerprint
d4c3d51

Karim shoair commited on

docs: removing unnecessary docstrings
43c3636

Karim shoair commited on

fix(requests): Fix multiple configuration issues
8473bef

Karim shoair commited on

refactor: Making the requests logic better and cleaner
906b02a

Karim shoair commited on

refactor: Making all the codebase acceptable by PyRight
e5ecf76

Karim shoair commited on

style(Fetcher): correcting type hints and annotation
f234e85

Karim shoair commited on

style: Correcting return type annotation for Fetcher/AsyncFetcher (#93)
50e4788

Karim shoair commited on

style: Removing dead code/docstrings and correcting type hints
7231786

Karim shoair commited on

fix: Fixes to handle the new extra deps group
e3522be

Karim shoair commited on

refactor: Make all fetchers as an optional dependency group
a85d2c8

Karim shoair commited on

style: applying the new ruff rules to all files
226b463

Karim shoair commited on

style: add flags for tests coverage
9b40891

Karim shoair commited on

style: A lot of type hints correction
916182a

Karim shoair commited on

refactor: huge change, many features/class got a better naming
8e67a4c

Karim shoair commited on

fix: small fix for fetcher
16d0162

Karim shoair commited on

refactor(Fetcher): Fix the issue of caching impersonation state + Less code duplication
76e6484

Karim shoair commited on

fix(FetcherSession): Use Sentinel pattern to solve arguments precedence issue
79e3571

Karim shoair commited on

fix(AsyncFetcher): Fix `stealthy_headers` issue
3872d26

Karim shoair commited on

fix(fetcher): Fix impersonate and headers generation conflict
ad24646

Karim shoair commited on

style(fetcher): Move the default UA line
9ff889c

Karim shoair commited on

feat/fix(Fetcher): Adding http3 support + Fix stealthy_headers
b1f1565

Karim shoair commited on

feat(Fetcher): Replacing httpx + Adding FetcherSession
5f035e4

Karim shoair commited on

fix(fetchers): Adjusting all cookies returned from each fetcher
c9040ed

Karim shoair commited on

fix(Fetcher): Fix the issue of passing cookies
205b950

Karim shoair commited on

chore: migrating to ruff and updating pre-commit hooks
fcedcce

Karim shoair commited on

fix: Adjusting cache size in all the library
1138f08

Karim shoair commited on

fix: Limit caching in all the library
4ed4cfd

Karim shoair commited on

refactor/fix(Fetcher engine): Improvements and fixes
07c686c

Karim shoair commited on

fix(Fetcher): make `stealthy_headers` don't overwrite user headers
c96e900

Karim shoair commited on

feat(Fetcher): Add the redirections history to Fetcher
9b16194

Karim shoair commited on

feat: Adding `AsyncFetcher` class version of `Fetcher`
0056ebe

Karim shoair commited on

style: moving repeated arguments from inside the functions to __init__
3d8defe

Karim shoair commited on

perf: Give repeated usage of `Fetcher` a slight performance increase
7b0e178

Karim shoair commited on

feat: adding the `retries` argument for all methods of `Fetcher` class
413d9d9

Karim shoair commited on

fix: forgot to stage it with last commit
7c92499

Karim shoair commited on

refactor(api)!: Unifying log under 1 logger and removing debug parameter
df3c414

Karim shoair commited on

Sorting all library imports with `isort`
29489df

Karim shoair commited on

Adding proxy support for basic requests
e409d2e

Karim shoair commited on