Skip to content

v1.0.6

Compare
Choose a tag to compare
@janreges janreges released this 08 Dec 11:11
· 100 commits to main since this release

The primary change is to fix a bug that in some cases caused asynchronous request queue to get stuck in the last stage of crawling.

Changes

  • readme: removed bold links from the intro (it didn't look as good on github as it did in the IDE) b675873
  • readme: improved intro and gif animation with the real output fd9e2d6
  • http auth: for security reasons, we only send auth data to the same 2nd level domain (and possibly subdomains). With HTTP basic auth, the name and password are only base64 encoded and we would send them to foreign domains (which are referred to from the crawled website) 4bc8a7f
  • html report: increased specificity of the .header class for the header, because this class were also used by the generic class at <td class='header'> in security tab 9d270e8
  • html report: improved readability of badge colors in light mode 76c5680
  • crawler: moving the decrement of active workers after parsing URLs from the content, where further filling of the queue could occur (for this reason, queue processing could sometimes get stuck in the final stages) f8f82ab
  • analysis: do not parse/check empty HTML (it produced unnecessary warning) - it is valid to have content-type: text/html but with connect-lengt: 0 (for example case for 'gtm.js?id=') 436d81b