Current web crawler cannot test against internal sites behind firewalls (which require more whitelist requests and other changes that may be difficult).
Would there be ways to run crawler from browser extensions on the client side? This may also help with pages that require logins.
Workflow could be: user opens a site, optionally log in, then run Access Assistant to crawl though the page and other linked pages, instead of having to manually open each page and run test against.
Or, somehow have Access Assistant loop through a list of URL as TXT/CSV/sitemap.xml in a browser session?