requirements.txt
```text
pydantic>=2.6
httpx>=0.27
beautifulsoup4>=4.12
lxml>=5.1
trafilatura>=1.7
pymupdf>=1.24
pdfminer.six>=20231228
click>=8.1
python-dateutil>=2.9
tiktoken>=0.7 ; platform_system != "Windows"
rapidfuzz>=3.9
setuptools>=68
wheel>=0.41