deployment: dedicated server script for cloud-run (#1139)

fix: search params

fix: base parameter

fix: lm and related options

feat: new lm engine

feat: gemini to replace blip2 (#1129)

update scrapping options

fix pageshot failure

use browser engine when no-cache is set

feat: domain profile (#1127)

feat: fetch page content by curl (#1119)

feat(crawl): viewport options

feat(crawl): token budget

fix: pdf upload in multipart

feat: opt out gfm/table

feat: image retention config

fix: expect cookie encoding issue

feat: compound response

feat: script injecting and tools

feat: expand shadow dom

feat: add adaptive crawler (#112)

feat: add referer param

feat: allow passing base64 encoded pdf

feat: expose X-Locale parameter

fix: set-cookie

fix: ignore match all target selectors for performance

fix: revert screenshot behavior and introduce pageshot

feat: with-iframe and full-page screenshot

feat: bring your own html

fix: allow POST with url

fix: timeout parameter

fix: stop early return when timeout is explicitly defined

feat: keepImgDataUrl

feat: x-remove-selector

fix: timeout parsing

fix: search descriptions

refactor: options dto

fix: bulk fix multiple issues

feat: extract text from pdf (#70)