Karim shoair commited on
Commit ·
5c2d1ee
1
Parent(s): 288b1a4
docs(dynamic pages): add an important warning
Browse files- docs/fetching/dynamic.md +5 -1
docs/fetching/dynamic.md
CHANGED
|
@@ -135,7 +135,7 @@ page = DynamicFetcher.fetch('https://example.com', proxy='http://username:passwo
|
|
| 135 |
### Proxy Rotation
|
| 136 |
|
| 137 |
```python
|
| 138 |
-
from scrapling.fetchers import ProxyRotator
|
| 139 |
|
| 140 |
# Set up proxy rotation
|
| 141 |
rotator = ProxyRotator([
|
|
@@ -153,6 +153,10 @@ with DynamicSession(proxy_rotator=rotator, headless=True) as session:
|
|
| 153 |
page3 = session.fetch('https://example3.com', proxy='http://specific-proxy:8080')
|
| 154 |
```
|
| 155 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 156 |
### Downloading Files
|
| 157 |
|
| 158 |
```python
|
|
|
|
| 135 |
### Proxy Rotation
|
| 136 |
|
| 137 |
```python
|
| 138 |
+
from scrapling.fetchers import DynamicSession, ProxyRotator
|
| 139 |
|
| 140 |
# Set up proxy rotation
|
| 141 |
rotator = ProxyRotator([
|
|
|
|
| 153 |
page3 = session.fetch('https://example3.com', proxy='http://specific-proxy:8080')
|
| 154 |
```
|
| 155 |
|
| 156 |
+
!!! warning
|
| 157 |
+
|
| 158 |
+
Remember that by default, all browser-based fetchers and sessions use a persistent browser context with a pool of tabs. However, since browsers can't set a proxy per tab, when you use a ProxyRotator, the fetcher will automatically open a separate context for each proxy, with one tab per context. Once the tab's job is done, both the tab and its context are closed.
|
| 159 |
+
|
| 160 |
### Downloading Files
|
| 161 |
|
| 162 |
```python
|