A catch-all issue for dealing with problematic URLs and sites. - [ ] [NitroPDF Investor Relations Site](https://ir.gonitro.com) triggers a funky cascade of ASP.Net redirects; we need to determine whether we're sending malformed requests. - [ ] [Eldrich Host](http://eldrich.host) is a janky 8 year old pile of Bootstrap stuff, and while the first page is crawled additional links aren't followed. - [ ] [City of Antwerpen](https://www.antwerpen.be) makes heavy use of Shadow DOM elements; #70 is intended to address it.
A catch-all issue for dealing with problematic URLs and sites.