fix: cookie clone from pristine profile, pool cleanup, intelligent sitemap optimization, download/403 handling, unsupported document classification#789

Merged

younglim merged 17 commits into

fix/cookie-clone-from-pristine-profile

Jul 13, 2026

Commits on Jul 12, 2026

fix: clone cookies from pristine user profile and eagerly clean retired pools

younglim
and
claude
committed
fix: cap browser disk cache at 10MB to prevent storage bloat on long crawls

younglim
and
claude
committed
Disable Eco QOS on Windows to maximise CPU utilisation
younglim
committed
retry cleanUp of browser pools
younglim
committed
fix: reliable browser pool directory cleanup and correct disk cache size
younglim
committed
fix: reliable pool dir cleanup, correct cache size, optimize intelligent sitemap
younglim
committed
Updated todo list
younglim
committed
Updated todo list
younglim
committed
fix: add guiInfoLog for download-as-unsupported, avoid double circuit breaker count on 403 retry
younglim
committed
fix: add guiInfoLog for download-as-unsupported, avoid double circuit breaker count on 403 retry
younglim
committed
fix: always create requestQueue in crawlSitemap for download/403 handling
younglim
committed
Updated AGENTS.md with:
younglim
committed