Hakrawler is a web crawler designed for reconnaissance and endpoint discovery during security assessments and bug bounty work. It is built in Go and provides a lightweight, fast implementation for gathering URLs and locating JavaScript files within web applications.
The tool solves the problem of quickly mapping out a target application's surface area by crawling web pages and extracting links and asset locations. It wraps the Gocolly library to provide a simple command-line interface for this purpose. Users can crawl single URLs, process multiple targets from stdin, apply timeouts, route requests through proxies, and optionally include subdomains in scope. A common gotcha documented in the README occurs when a domain redirects to a subdomain—the tool will return no results unless the final URL in the redirect chain is specified or the subdomain inclusion flag is used.
Hakrawler suits penetration testers, bug bounty hunters, and security researchers who need rapid reconnaissance of web applications. It integrates well into tool chains for subdomain enumeration and HTTP validation workflows. The tool is straightforward enough that it does not require extensive configuration, making it suitable for quick, ad-hoc scanning tasks rather than complex, long-running crawl operations.
Development activity shows consistent maintenance with regular updates addressing user-reported issues and adding features. The project accepts contributions and responds to bug reports, indicating active engagement with its user base. The maintainer provides multiple installation methods including standard Go compilation, Docker images, and package manager support, reflecting attention to accessibility across different environments.
