Free and open-source vulnerability scanner
Mageni eases for you the vulnerability scanning, assessment, and management process. It is free and open-source.
Install NowAvailable for macOS, Windows, and Linux
Nmap NSE 6.01: http-robots.txt
Information
Severity
Severity
Informational
Family
Family
Nmap NSE
CVSSv2 Base
CVSSv2 Base
0.0
CVSSv2 Vector
CVSSv2 Vector
AV:N/AC:L/Au:N/C:N/I:N/A:N
Created
Created
11 years ago
Modified
Modified
5 years ago
Summary
Checks for disallowed entries in '/robots.txt' on a web server. The higher the verbosity or debug level, the more disallowed entries are shown. SYNTAX: http.pipeline: If set, it represents the number of HTTP requests that'll be pipelined (ie, sent in a single request). This can be set low to make debugging easier, or it can be set high to test how a server reacts (its chosen max is ignored). http-max-cache-size: The maximum memory size (in bytes) of the cache.