fix: serper search caching

search: new branch using serper as provider

fix: some invalid uriComponent case

deployment: dedicated server script for cloud-run (#1139)

fix: search params

fix: base parameter

fix: lm and related options

fix: curl with errors

fix

feat: new lm engine

feat: gemini to replace blip2 (#1129)

feat: domain profile (#1127)

feat: fetch page content by curl (#1119)

feat(crawl): viewport options

feat(crawl): token budget

fix: remove http abuse check

chore: tweak deployment

fix: pdf upload in multipart

feat: opt out gfm/table

feat: image retention config

chore: tweak deployment

feat: compound response

feat: script injecting and tools

search now requires authentication

fix: walk around locale setting bug

feat: expand shadow dom

chore: tweak deployment

chore: suspend data crunching

fix

fix: uri encoding

fix(adaptive-crawler): fix cache problem

feat: change deployment machine type to improve cpu utilization

chore: fix security dependencies

feat(adaptive-crawler): optimize relevance detection

fix(adaptive-crawler): useSitemap should be rewritten in certain condition

fix(adaptive-crawler): if no sitemap, use recursive instead

fix

fix: pageshot not removed from page snapshot

feat(adaptive-crawl): disable invalid link

fix(adaptive): url hash

chore: deployment tweak

fix: target selector

feat: add adaptive crawler (#112)

tweak: try alleviate oom killed issue

feat: support explicit q passing in search

fix: performance issue of jsdom

fix: cache with locale

feat: allow passing pdf without url param (#111)

fix: cap browser request freq to avoid block from google

feat: add referer param