fix: attachment pdf

tweak: try alleviate oom killed issue

fix: pdf detection

fix: performance issue of jsdom

fix: req cap issues

fix: cap browser request freq to avoid block from google

feat: add referer param

feat: allow passing base64 encoded pdf

feat: expose X-Locale parameter

fix: set-cookie

fix: html rebasing with <base> tag

fix: another approach to suspected DoS abuse

fix

fix

fix

fix

fix: abuse of flooding elements

fix: truncate svg in jsdom

debug: log jsdom and turndown operations

fix: revert screenshot behavior and introduce pageshot

fix: jsdom, cache tolerance, screenshot pricing

feat: with-iframe and full-page screenshot

feat: bring your own html

fix

fix: retry for brave search

fix: scrap timing

fix: brave search operators in headers

feat: expose brave search operators explicitly

fix

fix

fix: dos abuse

fix

feat: x-remove-selector

fix: search descriptions

refactor: options dto

fix: potential circular crawling

fix: abuse blocker

fix

security: detect abuse

fix: pdf cache

fix: setup expire for pdf caches

fix: pdf cache

fix: firebase fail to save large docs

fix: bulk fix multiple issues

feat: extract text from pdf (#70)

feat: links and images summary (#63)

fix: stop using pool

fix: geoip encoding

fix: potential unencoded query

fix: block rough requests