web_reader / backend /functions /src /cloud-functions /adaptive-crawler.ts

Commit History

fix(adaptive-crawler): fix cache problem
f825045

mapleeit commited on

chore: fix security dependencies
86d69ee

mapleeit commited on

feat(adaptive-crawler): optimize relevance detection
a44d9a2

mapleeit commited on

fix(adaptive-crawler): useSitemap should be rewritten in certain condition
af282ee

mapleeit commited on

fix(adaptive-crawler): if no sitemap, use recursive instead
5a4b35e

mapleeit commited on

feat(adaptive-crawl): disable invalid link
8008e53

mapleeit commited on

fix(adaptive): url hash
3f88f8d

mapleeit commited on

feat: add adaptive crawler (#112)
e27bcac
unverified

mapleeit commited on