web_reader / src /dto /crawler-options.ts

Commit History

fix: timeout respect
d2afa9d
unverified

nomagick commited on

feat: serp endpoint (#1180)
12ba1bc
unverified

nomagick commited on

fix: bring back content based respond timing
2a30fce
unverified

nomagick commited on

improve: cache usage and detection of js-required pages
ff595c2
unverified

nomagick commited on

fix: track if snapshot html modified by js
9415c6a
unverified

nomagick commited on

fix: tweak default timing to be more conservative
6027963
unverified

nomagick commited on

fix: custom script may listen to mutationIdle
8121d62
unverified

nomagick commited on

behavior change: ditch content based return timing, adopt mutationIdle as default timing
f7dbadf
unverified

nomagick commited on

docs: mention about discarded
5141814
unverified

nomagick commited on

feat: pdf upload and ip check
45d1682
unverified

nomagick commited on

fix: robots-txt not loaded error conditions
0da71ca
unverified

nomagick commited on

docs: minor fix
4e5abd3
unverified

nomagick commited on

docs: be neutral on brand
ce11f44
unverified

nomagick commited on

feat: md options pass though to turndown
6b9e14d
unverified

nomagick commited on

fix: catch jsdom errors
3020d58
unverified

nomagick commited on

restructure: nolonger a firebase application (#1160)
23a3b80
unverified

nomagick commited on