Karim shoair commited on
Commit ·
6bc5321
1
Parent(s): 04eb5f9
docs: use better import for `ProxyRotator` class
Browse files- docs/fetching/static.md +2 -3
docs/fetching/static.md
CHANGED
|
@@ -31,7 +31,7 @@ All methods for making requests here share some arguments, so let's discuss them
|
|
| 31 |
- **proxy**: As the name implies, the proxy for this request is used to route all traffic (HTTP and HTTPS). The format accepted here is `http://username:password@localhost:8030`.
|
| 32 |
- **proxy_auth**: HTTP basic auth for proxy, tuple of (username, password).
|
| 33 |
- **proxies**: Dict of proxies to use. Format: `{"http": proxy_url, "https": proxy_url}`.
|
| 34 |
-
- **proxy_rotator**: A `ProxyRotator` instance for automatic proxy rotation. Cannot be combined with `proxy` or `proxies`.
|
| 35 |
- **headers**: Headers to include in the request. Can override any header generated by the `stealthy_headers` argument
|
| 36 |
- **max_redirects**: Maximum number of redirects. **Defaults to 30**, use -1 for unlimited.
|
| 37 |
- **verify**: Whether to verify HTTPS certificates. **Defaults to True**.
|
|
@@ -194,8 +194,7 @@ with FetcherSession(
|
|
| 194 |
You can also use a `ProxyRotator` with `FetcherSession` for automatic proxy rotation across requests:
|
| 195 |
|
| 196 |
```python
|
| 197 |
-
from scrapling.fetchers import FetcherSession
|
| 198 |
-
from scrapling.engines.toolbelt import ProxyRotator
|
| 199 |
|
| 200 |
rotator = ProxyRotator([
|
| 201 |
'http://proxy1:8080',
|
|
|
|
| 31 |
- **proxy**: As the name implies, the proxy for this request is used to route all traffic (HTTP and HTTPS). The format accepted here is `http://username:password@localhost:8030`.
|
| 32 |
- **proxy_auth**: HTTP basic auth for proxy, tuple of (username, password).
|
| 33 |
- **proxies**: Dict of proxies to use. Format: `{"http": proxy_url, "https": proxy_url}`.
|
| 34 |
+
- **proxy_rotator**: A `ProxyRotator` instance for automatic proxy rotation. Cannot be combined with `proxy` or `proxies`.
|
| 35 |
- **headers**: Headers to include in the request. Can override any header generated by the `stealthy_headers` argument
|
| 36 |
- **max_redirects**: Maximum number of redirects. **Defaults to 30**, use -1 for unlimited.
|
| 37 |
- **verify**: Whether to verify HTTPS certificates. **Defaults to True**.
|
|
|
|
| 194 |
You can also use a `ProxyRotator` with `FetcherSession` for automatic proxy rotation across requests:
|
| 195 |
|
| 196 |
```python
|
| 197 |
+
from scrapling.fetchers import FetcherSession, ProxyRotator
|
|
|
|
| 198 |
|
| 199 |
rotator = ProxyRotator([
|
| 200 |
'http://proxy1:8080',
|