Scrapling / scrapling /engines /_browsers /_validators.py

Commit History

style: Fix all mypy errors and add type hints to untyped function bodies
31c2447

Karim shoair commited on

feat(browsers): Add option to block requests to specific domains
47dd985

Karim shoair commited on

feat(spiders/fetchers): Adding proxy rotation logic and change retry logic
ed96cdc

Karim shoair commited on

feat(browsers): Add option to retry tabs that gives errors
024cbba

Karim shoair commited on

fix: remove forgotten unused code
a7cc20d

Karim shoair commited on

fix: remove old proxy logic
f62e5ea

Karim shoair commited on

fix: update shell signatures for the autocompletion
05b2188

Karim shoair commited on

refactor(fetchers)!: Replace Camoufox with patchright and many optimizations
ee2299e

Karim shoair commited on

feat(dynamicSession): add the option to set timezone of the browser
1d52f39

Karim shoair commited on

refactor(browser fetchers): Make all the type hints dynamic + Faster validation
c908f33

Karim shoair commited on

fix(validators): Fix overriding session values with request ones
4836205

Karim shoair commited on

pref(requests): Optimizing memory by specifiying slots
624e46f

Karim shoair commited on

refactor(validation): All browser based fetchers are ~8-15% faster now in most cases
8bf21c0

Karim shoair commited on

feat(DynamicSession): New option to add extra browser flags
b6969b2

Karim shoair commited on

feat(Dynamic fetcher): Add `additional_args` option to customize browser as in StealthyFetcher
0de8025

Karim shoair commited on

feat(fetchers): Add argument to control the user data directory
c61a805

Karim shoair commited on

refactor: Making the requests logic better and cleaner
906b02a

Karim shoair commited on

refactor: Making all the codebase acceptable by PyRight
e5ecf76

Karim shoair commited on

perf: Improving all browser-based fetches by ~15%
da46469

Karim shoair commited on

refactor: Make all fetchers as an optional dependency group
a85d2c8

Karim shoair commited on

feat(browser fetchers): A new option to control page JS
66fd35f

Karim shoair commited on

style: applying the new ruff rules to all files
226b463

Karim shoair commited on

feat(DynamicFetcher): add the ability to add `init_script` to context (#56)
03de577

Karim shoair commited on

feat(StealthyFetcher): add the ability to add `init_script` to context
0ed7f13

Karim shoair commited on

style: A lot of type hints correction
916182a

Karim shoair commited on

style: replacing `os` with `Pathlib` and small optimizations
11165c4

Karim shoair commited on

style: General type hints fixes and imports optimizing
1d98b51

Karim shoair commited on

refactor: huge change, many features/class got a better naming
8e67a4c

Karim shoair commited on

refactor(StealthyFetcher): Remove virtual mode and use persistent context
8400659

Karim shoair commited on

refactor: optimize imports and docstrings correction
df159e9

Karim shoair commited on

feat(fetchers): Improve StealthyFetcher + Adding StealthySession/AsyncStealthySession classes
42a1f3d

Karim shoair commited on

refactor(controllers): Improve type validation
62613cb

Karim shoair commited on

refactor(validators): Optimize imports
e67328d

Karim shoair commited on

feat(fetchers): Adding the foundation of the new browser-based fetchers logic
0cd97d9

Karim shoair commited on