Dirhunt:  Find web directories without bruteforce.

Dirhunt is a web crawler optimized for searching and analyzing directories. This tool can find interesting things if the server has the "index of" mode enabled. Dirhunt is also useful if the directory listing is not enabled. It detects directories with false 404 errors, directories where an empty index file has been created to hide things, and much more.

Disclaimer:- This project was created for educational purposes and should not be used in environments without legal authorization.

Features

• Process one or multiple sites at a time.
• Process 'Index Of' pages and report interesting files.
• Detect redirectors.
• Detect blank index file created on directory to hide things.
• Process some html files in search of new directories.
• 404 error pages and detect fake 404 errors.
• Filter results by flags.
• Analyze results at end. It also processes date & size of the Index Pages.
• Get new directories using robots.txt, VirusTotal, Google, CommonCrawl(NEW!) & SSL Certificate (NEW!).
• Delay between requests.
• One or multiple proxies option. It can also search for free proxies.
• Save the results to a JSON file
• Resume the aborted scans

https://github.com/Nekmo/dirhunt   

*Beware click the link!