RoboBack is a CLI tool that fetches historical robots.txt files from the Wayback Machine, helping OSINT and bug bounty teams track crawling policies over time 🤖.
-
Updated
Sep 24, 2026 - Python
RoboBack is a CLI tool that fetches historical robots.txt files from the Wayback Machine, helping OSINT and bug bounty teams track crawling policies over time 🤖.
🕵️♂️ Extract links and parameters from web pages swiftly with domHound, a lightweight Chrome extension designed for efficient recon and security analysis.
ASNinformer is a lightweight tool that takes IPs as input, looks up their ASN information, and groups results by ASN in a JSON file.
A lightweight frontend tool for generating powerful Google/Bing dorks for reconnaissance and OSINT
A Chrome extension that extracts, parameters, js urls, links from web pages for fast recon
RoboBack is a command-line tool that allows you to travel back in time and extract historical robots.txt files of a target domain from archive.org
To associate your repository with the narrow-recon topic, visit your repo's landing page and select "manage topics."