feat: image retention config

chore: tweak deployment

feat: compound response

feat: script injecting and tools

search now requires authentication

fix: walk around locale setting bug

feat: expand shadow dom

chore: tweak deployment

chore: suspend data crunching

fix

fix: uri encoding

fix(adaptive-crawler): fix cache problem

feat: change deployment machine type to improve cpu utilization

chore: fix security dependencies

feat(adaptive-crawler): optimize relevance detection

fix(adaptive-crawler): useSitemap should be rewritten in certain condition

fix(adaptive-crawler): if no sitemap, use recursive instead

fix

fix: pageshot not removed from page snapshot

feat(adaptive-crawl): disable invalid link

fix(adaptive): url hash

chore: deployment tweak

fix: target selector

feat: add adaptive crawler (#112)

tweak: try alleviate oom killed issue

feat: support explicit q passing in search

fix: performance issue of jsdom

fix: cache with locale

feat: allow passing pdf without url param (#111)

fix: cap browser request freq to avoid block from google

feat: add referer param

feat: allow passing base64 encoded pdf

feat: expose X-Locale parameter

feat: return usage tokens in json

fix: set-cookie

fix: alleviate search performance issue

fix: remove select element from markdown to walk around turndown performance issue

chore: reduce fetch count in search

fix: search with failed pages

chore: tweak concurrency

fix: html rebasing with <base> tag

fix

feat: updated rate policy

fix

fix

fix: another approach to suspected DoS abuse

debug: log jsdom and turndown operations

fix: also recover screenshot pricing

fix: revert screenshot behavior and introduce pageshot

fix: jsdom, cache tolerance, screenshot pricing