fix: deps and bugs

chore: tweak deployment

fix: crawling IP url

fix: expect cookie encoding issue

feat: compound response

feat: script injecting and tools

search now requires authentication

chore: bump deps

fix: turndown rules

chore: add internal slack report

fix: headers in overridden request

fix: salvaging with google cache does not work anymore

fix: walk around locale setting bug

fix: detect poorly transformed contents

fix

fix

fix: bump deps

revert: domain cannot be un-doomed due to google function wrapper

fix: force process quit on firebase issue

feat: expand shadow dom

chore: tweak deployment

chore: suspend data crunching

bump: deps

fix: remove link url escaping

fix

fix: uri encoding

fix(adaptive-crawler): fix cache problem

feat: change deployment machine type to improve cpu utilization

chore

chore: security

chore: fix security dependencies

docs: readme changelog

fix: pdf mode and google web cache

fix: pageshot missing in cache

feat(adaptive-crawler): optimize relevance detection

fix(adaptive-crawler): useSitemap should be rewritten in certain condition

fix: request to unknown domain

fix(adaptive-crawler): if no sitemap, use recursive instead

fix: gfm strikethrough

fix

fix

fix: pageshot not removed from page snapshot

feat(adaptive-crawl): disable invalid link

fix(adaptive): url hash

fix: 3xx not considered errors

fix: iframe should not actively report snapshot

chore: deployment tweak

fix: target selector

feat: add adaptive crawler (#112)

fix