Tag: spidering framework

Katana A next-generation crawling and spidering framework Feature Fast And fully configurable web crawling Standard and Headless mode support JavaScript parsing / crawling Customizable automatic form filling Scope control – Preconfigured field / Regex Customizable output – Preconfigured fields INPUT – STDIN, URL and LIST OUTPUT – STDOUT, FILE, and JSON Crawling Mode Standard Mode Standard crawling modality uses the standard go http library under the hood to handle HTTP…