Karim shoair commited on
Commit
5c2d1ee
·
1 Parent(s): 288b1a4

docs(dynamic pages): add an important warning

Browse files
Files changed (1) hide show
  1. docs/fetching/dynamic.md +5 -1
docs/fetching/dynamic.md CHANGED
@@ -135,7 +135,7 @@ page = DynamicFetcher.fetch('https://example.com', proxy='http://username:passwo
135
  ### Proxy Rotation
136
 
137
  ```python
138
- from scrapling.fetchers import ProxyRotator
139
 
140
  # Set up proxy rotation
141
  rotator = ProxyRotator([
@@ -153,6 +153,10 @@ with DynamicSession(proxy_rotator=rotator, headless=True) as session:
153
  page3 = session.fetch('https://example3.com', proxy='http://specific-proxy:8080')
154
  ```
155
 
 
 
 
 
156
  ### Downloading Files
157
 
158
  ```python
 
135
  ### Proxy Rotation
136
 
137
  ```python
138
+ from scrapling.fetchers import DynamicSession, ProxyRotator
139
 
140
  # Set up proxy rotation
141
  rotator = ProxyRotator([
 
153
  page3 = session.fetch('https://example3.com', proxy='http://specific-proxy:8080')
154
  ```
155
 
156
+ !!! warning
157
+
158
+ Remember that by default, all browser-based fetchers and sessions use a persistent browser context with a pool of tabs. However, since browsers can't set a proxy per tab, when you use a ProxyRotator, the fetcher will automatically open a separate context for each proxy, with one tab per context. Once the tab's job is done, both the tab and its context are closed.
159
+
160
  ### Downloading Files
161
 
162
  ```python