Scrapling / scrapling /engines

Commit History

style: remove unused import
10ff0d5

Karim shoair commited on

fix: update code and docstrings to remove the old google referer logic
a28879b

Karim shoair commited on

build: pump up deps and browsers versions
7bd4753

Karim shoair commited on

fix: return bare Google URL in referer instead of search query
8b89653

bortles commited on

fix(browsers): make flag concatenation type-safe
814b9a6

Karim shoair Christian Rost commited on

fix(stealth): improve stealth mode by removing unnecessary scripts
cf06b6e

Karim shoair commited on

fix(solver): Solve CF faster and handle websites that show captcha twice
446b9d5

Karim shoair commited on

fix: improve regex precision for Cloudflare challenge detection
979ef6f

RinZ27 commited on

fix: make browser fetchers type hints always present
7d2ea72

Karim shoair commited on

fix: use more accurate naming for proxy rotation strategy
61a910a

Karim shoair commited on

style: Use shorter and more accurate naming for constants
c2dbf4c

Karim shoair commited on

style: Fix all mypy errors and add type hints to untyped function bodies
31c2447

Karim shoair commited on

feat(browsers): Add option to block requests to specific domains
47dd985

Karim shoair commited on

fix(response): Force the body of the response to always be bytes
1b8cc6b

Karim shoair commited on

feat(proxy control): Force a proxy at request level at any given point
32daccc

Karim shoair commited on

feat(spiders/fetchers): Adding proxy rotation logic and change retry logic
ed96cdc

Karim shoair commited on

fix(browsers): Improve stealth and speed by adjusting flags
88b6ab5

Karim shoair commited on

fix(browsers): disable autoplay for all browsers
1d04135

Karim shoair commited on

feat(parser): replacing `tldextract` with `tld` library
e5733cb

Karim shoair commited on

style: update post requests type hints to be more accurate
c3c5ac6

Karim shoair commited on

fix(browsers): solving an issues with leaving playwright loop open when cdp connection fails
8ff23b3

Karim shoair commited on

feat(browsers): Add option to retry tabs that gives errors
024cbba

Karim shoair commited on

fix(browsers): Close pages that give error
8209e61

Karim shoair commited on

feat(response): Option to set the referer as the previous response url.
ec44d0b

Karim shoair commited on

fix: handle a bug with response follow referer flow argument
9b0f6b7

Karim shoair commited on

fix(browsers): solve a bug with setting referer on the request level
c7e573a

Karim shoair commited on

feat(spiders): Add follow function to the response
c0f5705

Karim shoair commited on

refactor: internal API changes
bbd0c34

Karim shoair commited on

fix: add missing line
fff357e

Karim shoair commited on

refactor: internal API changes to be easily used as indicators for spiders
1803348

Karim shoair commited on

fix(StealthyFetcher): disable incognito mode to solve #123
fa0e2ca

Karim shoair commited on

docs: change docstring style for some methods
daaad4e

Karim shoair commited on

fix(async stealth): wait the coroutine of the bounding box
1f369fd

Karim shoair commited on

fix(fingerprints): do not create google referer for IPs
b354df4

Karim shoair commited on

build: update deps
7e1bee4

Karim shoair commited on

docs: shorten docstrings for some functions
1812d2b

Karim shoair commited on

fix: remove forgotten unused code
a7cc20d

Karim shoair commited on

fix: update the cookies type hint for the mcp server
d391239

Karim shoair commited on

fix: remove old proxy logic
f62e5ea

Karim shoair commited on

style: removing unused code
f4f8cc5

Karim shoair commited on

fix: update shell signatures for the autocompletion
05b2188

Karim shoair commited on

refactor(fetchers)!: Replace Camoufox with patchright and many optimizations
ee2299e

Karim shoair commited on

fix: improve the handling of useragent in chrome fetcher
123011a

Karim shoair commited on

fix: Improve stealth of dynamic browser by pinning Chrome's UA version
f5018fb

Karim shoair commited on

docs: add docs for `timezone_id` argument
17e25c2

Karim shoair commited on

feat(dynamicSession): add the option to set timezone of the browser
1d52f39

Karim shoair commited on

refactor(fetchers): rename internal api
a17a010

Karim shoair commited on

fix(fetchers): better handling for infinite `network_idle`
c64a120

Karim shoair commited on

docs: fix docstrings for all requests methods
33c6b04

Karim shoair commited on

fix(fetcher): Remove non-keywords arguments
3f07d06

Karim shoair commited on